Open Source Scraping Platforms & SDKs using MCP
A curated collection of the best open source platforms and SDKs for building web scraping solutions. using MCP.
LLM-ready web crawler built for AI data pipelines
Stars
81,288Last commit
4 days agoLicense
Apache-2.0
Open-source web crawler and scraper that produces clean, structured output optimized for LLMs, RAG pipelines, and AI agents. Supports async crawling, CSS/XPath/LLM extraction, and stealth browser control.
Open Source Alternative to:
No-code web scraping, crawling, and extraction platform
Stars
17,360Last commit
13 hours agoLicense
AGPL-3.0
Turn any website into structured data using a visual recorder, natural language prompts, or API. Includes proxy rotation, scheduling, and webhook integrations.
Open Source Alternative to:
Stellar Hosted – Managed Open Source software hosting in the EU: secure, compliant, fast.
InfluxDB