Ad
 
Learn More

Self-hosted Web Crawlers

A curated collection of the best self-hosted tools for automatically crawling and extracting data from websites.

Turn any website into clean, AI-ready data via API
  • Stars


    171,968
  • Last commit


    13 hours ago
  • License


    AGPL-3.0
API for AI agents to search, scrape, crawl, and interact with the live web, returning clean Markdown, structured JSON, or screenshots from any page.

Open Source Alternative to:

Favicon