A curated collection of the best open source projects tagged "Llm Proxy". Each listing includes a website screenshot along with a detailed review of its features.
Ultra-fast AI gateway with enterprise-grade reliability
Stars
Stars growing over the last 30 days9,054
Last commit
5 hours ago
License
Apache-2.0
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.
Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring.