A curated collection of the best open source projects tagged "Crawling". Each listing includes a website screenshot along with a detailed review of its features.
No-code web scraping, crawling, and extraction platform
Stars
17,388
Last commit
14 hours ago
License
AGPL-3.0
Turn any website into structured data using a visual recorder, natural language prompts, or API. Includes proxy rotation, scheduling, and webhook integrations.
The purpose-built time series platform for high-velocity ingestion and real-time queries at scale, without sacrificing performance or cost. Download InfluxDB for free.