Open Source AI Gateways
A curated collection of the best open source platforms that route and secure API access to multiple AI models through one unified interface, with authentication, rate limiting, and usage monitoring..
LLM gateway for auth, load balancing, and spend tracking
Stars
Stars growing over the last 30 days62,946Last commit
5 hours agoLicense
Unknown
Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.
Open Source Alternative to:
Complete production stack for AI teams
Stars
13,349Last commit
6 months agoLicense
MIT
Comprehensive AI platform with gateway, observability, guardrails, and prompt management. Access 1,600+ LLMs via unified API with enterprise-grade security.
Open Source Alternative to:
Ultra-fast AI gateway with enterprise-grade reliability
Stars
Stars growing over the last 30 days9,445Last commit
5 hours agoLicense
Apache-2.0
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.
Open Source Alternative to:
Route GenAI traffic with confidence using open source
Stars
Stars growing over the last 30 days2,371Last commit
17 hours agoLicense
Apache-2.0
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.
Open Source Alternative to:
Unified API for all LLM providers with analytics
Stars
Stars growing over the last 30 days1,732Last commit
5 hours agoLicense
MIT
Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring.
Open Source Alternative to:
Sent – Messaging Infrastructure for Developers. One API for SMS, WhatsApp, and RCS across 190+ countries.
Sent