Capture – Capture screenshots, generate PDFs, scrape content, extract metadata, and automate browsers with one API.

Learn more

Open Source Web Crawlers using Github Actions

A curated collection of the best open source tools for automatically crawling and extracting data from websites. using Github Actions.

Firecrawl

Turn any website into clean, AI-ready data via API

Stars
150,932
Forks
8,619
Last commit
10 hours ago

API for AI agents to search, scrape, crawl, and interact with the live web, returning clean Markdown, structured JSON, or screenshots from any page.

Open Source Alternative to:

Browserbase

Crawl4AI

LLM-ready web crawler built for AI data pipelines

Stars
72,615
Forks
7,449
Last commit
19 hours ago

Open-source web crawler and scraper that produces clean, structured output optimized for LLMs, RAG pipelines, and AI agents. Supports async crawling, CSS/XPath/LLM extraction, and stealth browser control.

Open Source Alternative to:

Browserbase

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit