Open Source Web Crawlers using pnpm
A curated collection of the best open source tools for automatically crawling and extracting data from websites. using pnpm.
Turn any website into clean, AI-ready data via API
Stars
Stars growing over the last 30 days194,956Last commit
1 hour agoLicense
AGPL-3.0
API for AI agents to search, scrape, crawl, and interact with the live web, returning clean Markdown, structured JSON, or screenshots from any page.
Open Source Alternative to:
Bright Data – Web data for AI agents and apps. Built-in unblocking, proxies, and ready-made APIs.
Openlane