Open Source Projects tagged "Llm Gateway"
A curated collection of the best open source projects tagged "Llm Gateway". Each listing includes a website screenshot along with a detailed review of its features.
LLM gateway for auth, load balancing, and spend tracking
Stars
59,829Last commit
3 hours agoLicense
Unknown
Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.
Open Source Alternative to:
Complete production stack for AI teams
Stars
13,106Last commit
4 months agoLicense
MIT
Comprehensive AI platform with gateway, observability, guardrails, and prompt management. Access 1,600+ LLMs via unified API with enterprise-grade security.
Open Source Alternative to:
Ultra-fast AI gateway with enterprise-grade reliability
Stars
8,429Last commit
3 hours agoLicense
Apache-2.0
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.
Open Source Alternative to:
Universal API management for REST, GraphQL, gRPC & async
Stars
10,839Last commit
18 hours agoLicense
Unknown
Fast, scalable API management platform with open source gateway, analytics, dev portal and dashboard. Deploy anywhere with AI-ready governance and security.
Open Source Alternative to:
Unified API for all LLM providers with analytics
Stars
1,665Last commit
4 hours agoLicense
MIT
Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring.
Open Source Alternative to:
Trace, evaluate, and protect every LLM call in one SDK
Stars
10Last commit
1 month agoLicense
AGPL-3.0
An AI gateway that sits on the request path to handle PII redaction, prompt injection blocking, tracing, evals, and cost tracking for OpenAI, Anthropic, and Gemini.
Open Source Alternative to:
CodeRabbit – The leading AI Code Review platform. Ship better quality code in 50% less time, with 90% fewer bugs.
CodeRabbit