Sent – A unified API for sending messages across SMS, RCS, and apps like WhatsApp.

Learn more

Open Source Scraping Platforms & SDKs using Bash

A curated collection of the best open source platforms and SDKs for building web scraping solutions. using Bash.

Firecrawl

Turn any website into clean, AI-ready data via API

Stars
148,533
Forks
8,503
Last commit
12 hours ago

API for AI agents to search, scrape, crawl, and interact with the live web, returning clean Markdown, structured JSON, or screenshots from any page.

Open Source Alternative to:

Browserbase

Crawl4AI

LLM-ready web crawler built for AI data pipelines

Stars
71,971
Forks
7,384
Last commit
1 day ago

Open-source web crawler and scraper that produces clean, structured output optimized for LLMs, RAG pipelines, and AI agents. Supports async crawling, CSS/XPath/LLM extraction, and stealth browser control.

Open Source Alternative to:

Browserbase

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit