Horseman

What is Horseman?

Horseman is a web crawling tool for extracting data from websites. It features GPT3.5 integration for content analysis, over 120 pre-built JavaScript snippets, and an AI assistant that can build custom snippets without any coding. It runs on Windows, Mac OS (Intel and M1/M2), and Linux. Sponsoring the project through GitHub unlocks Early Bird Pricing and perks such as early access to new features.

Who created Horseman?

Horseman was created by a developer known online as “workeffortwaste.”

What is Horseman used for?

• Web crawling & analysis: Crawl the web and analyze page content with GPT3.5 using your own custom prompts.
• Pre-built snippets: Access over 120 JavaScript snippets for a variety of web tasks.
• AI snippet creation: Generate custom snippets with the AI helper — no JavaScript knowledge required.
• Overflow detection: Find and fix elements that overflow the page and cause unwanted scrolling.
• Readability extraction: Intelligently extract content using Mozilla’s readability.js.
• Meta description generation: Summarize page content with GPT and use it to write new, relevant meta descriptions.
• Website insights: Get performance insights through the dedicated Insights feature.

Who is Horseman for?

Horseman suits frontend developers, performance analysts, digital agencies, accessibility experts, SEO specialists, and JavaScript engineers.

How to use Horseman?

1. Install: Download and install Horseman v0.3.2. It is compatible with Windows, Mac OS (Intel and M1/M2 chips), and Linux.
2. Crawl and analyze: Use the GPT3.5 integration to crawl websites and run your own prompts against page content.
3. Use snippets: Apply the built-in JavaScript snippets — small pieces of code that interact with websites — to automate tasks, or ask the AI helper to create custom snippets for you.
4. Extract and optimize: Pull content with readability.js, detect scroll-breaking overflow elements, and generate meta descriptions from GPT summaries.
5. Support the project (optional): Sponsor on GitHub for Early Bird Pricing and early access to new features.