Open Source Scraping Platforms & SDKs
A curated collection of the best open source platforms and SDKs for building web scraping solutions..
Turn any website into clean, AI-ready data via API
Stars
Stars growing over the last 30 days201,049Last commit
7 hours agoLicense
AGPL-3.0
API for AI agents to search, scrape, crawl, and interact with the live web, returning clean Markdown, structured JSON, or screenshots from any page.
Open Source Alternative to:
LLM-ready web crawler built for AI data pipelines
Stars
87,253Last commit
2 days agoLicense
Apache-2.0
Open-source web crawler and scraper that produces clean, structured output optimized for LLMs, RAG pipelines, and AI agents. Supports async crawling, CSS/XPath/LLM extraction, and stealth browser control.
Open Source Alternative to:
Fast, AI-native web browser built for automation and scraping
Stars
Stars growing quickly over the last 30 days41,932Last commit
5 hours agoLicense
AGPL-3.0
Purpose-built headless browser that delivers 10x faster performance and 10x lower memory usage compared to Chrome headless for web automation and AI workflows.
Open Source Alternative to:
No-code web scraping, crawling, and extraction platform
Stars
18,216Last commit
3 days agoLicense
AGPL-3.0
Turn any website into structured data using a visual recorder, natural language prompts, or API. Includes proxy rotation, scheduling, and webhook integrations.
Open Source Alternative to:
Self-hosted SERP API for Google, Bing, Yandex, and more
Stars
Stars growing over the last 30 days1,572Last commit
18 hours agoLicense
MIT
Query Google, Bing, Yandex, Baidu, DuckDuckGo, and Ecosia through one REST API. Self-host free under MIT, or use the managed cloud option.
Open Source Alternative to:
Bright Data – Web data for AI agents and apps. Built-in unblocking, proxies, and ready-made APIs.
Bright Data