Self-hosted Scraping Platforms & SDKs
A curated collection of the best self-hosted platforms and SDKs for building web scraping solutions..
Turn any website into clean, AI-ready data via API
Stars
Stars growing over the last 30 days195,414Last commit
15 hours agoLicense
AGPL-3.0
API for AI agents to search, scrape, crawl, and interact with the live web, returning clean Markdown, structured JSON, or screenshots from any page.
Open Source Alternative to:
LLM-ready web crawler built for AI data pipelines
Stars
86,281Last commit
4 days agoLicense
Apache-2.0
Open-source web crawler and scraper that produces clean, structured output optimized for LLMs, RAG pipelines, and AI agents. Supports async crawling, CSS/XPath/LLM extraction, and stealth browser control.
Open Source Alternative to:
No-code web scraping, crawling, and extraction platform
Stars
18,045Last commit
12 hours agoLicense
AGPL-3.0
Turn any website into structured data using a visual recorder, natural language prompts, or API. Includes proxy rotation, scheduling, and webhook integrations.
Open Source Alternative to:
Self-hosted SERP API for Google, Bing, Yandex, and more
Stars
Stars growing over the last 30 days1,499Last commit
22 hours agoLicense
MIT
Query Google, Bing, Yandex, Baidu, DuckDuckGo, and Ecosia through one REST API. Self-host free under MIT, or use the managed cloud option.
Open Source Alternative to:
Docmost – Open-source wiki software with real-time collaboration, diagrams, AI, SSO, RBAC permissions and more.
Stellar Hosted