Submit
Ad
Learn more

Open Source Projects tagged "Crawler"

A curated collection of the best open source projects tagged "Crawler". Each listing includes a website screenshot along with a detailed review of its features.

Firecrawl

AI
Turn any website into clean, AI-ready data via API

  • Stars

    Stars growing over the last 30 days199,599

  • Last commit

    8 hours ago

  • License

    AGPL-3.0
API for AI agents to search, scrape, crawl, and interact with the live web, returning clean Markdown, structured JSON, or screenshots from any page.

Open Source Alternative to:

Browserbase

Crawl4AI

AI
LLM-ready web crawler built for AI data pipelines

  • Stars

    87,072

  • Last commit

    4 days ago

  • License

    Apache-2.0
Open-source web crawler and scraper that produces clean, structured output optimized for LLMs, RAG pipelines, and AI agents. Supports async crawling, CSS/XPath/LLM extraction, and stealth browser control.

Open Source Alternative to:

Browserbase

Maxun

AI
No-code web scraping, crawling, and extraction platform

  • Stars

    18,167

  • Last commit

    8 hours ago

  • License

    AGPL-3.0
Turn any website into structured data using a visual recorder, natural language prompts, or API. Includes proxy rotation, scheduling, and webhook integrations.

Open Source Alternative to:

Jina AI
Ad