Openlane – Open-source, developer-first platform for automated compliance, risk management, and built-in Trust Center.

Learn more

Open Source Scraping Platforms & SDKs using Bash

A curated collection of the best open source platforms and SDKs for building web scraping solutions. using Bash.

Firecrawl

Turn any website into clean, AI-ready data via API

Stars
135,444
Forks
7,876
Last commit
9 hours ago

API for AI agents to search, scrape, crawl, and interact with the live web, returning clean Markdown, structured JSON, or screenshots from any page.

Open Source Alternative to:

Browserbase

Crawl4AI

LLM-ready web crawler built for AI data pipelines

Stars
68,963
Forks
7,035
Last commit
2 days ago

Open-source web crawler and scraper that produces clean, structured output optimized for LLMs, RAG pipelines, and AI agents. Supports async crawling, CSS/XPath/LLM extraction, and stealth browser control.

Open Source Alternative to:

Browserbase

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit