Open Source Projects tagged "Llm Gateway"
A curated collection of the best open source projects tagged "Llm Gateway". Each listing includes a website screenshot along with a detailed review of its features.
LLM gateway for auth, load balancing, and spend tracking
Stars
Stars growing over the last 30 days62,891Last commit
8 hours agoLicense
Unknown
Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.
Open Source Alternative to:
Complete production stack for AI teams
Stars
13,341Last commit
6 months agoLicense
MIT
Comprehensive AI platform with gateway, observability, guardrails, and prompt management. Access 1,600+ LLMs via unified API with enterprise-grade security.
Open Source Alternative to:
Ultra-fast AI gateway with enterprise-grade reliability
Stars
Stars growing over the last 30 days9,428Last commit
1 day agoLicense
Apache-2.0
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.
Open Source Alternative to:
Universal API management for REST, GraphQL, gRPC & async
Stars
10,879Last commit
2 days agoLicense
Unknown
Fast, scalable API management platform with open source gateway, analytics, dev portal and dashboard. Deploy anywhere with AI-ready governance and security.
Open Source Alternative to:
Unified API for all LLM providers with analytics
Stars
Stars growing over the last 30 days1,731Last commit
13 hours agoLicense
MIT
Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring.
Open Source Alternative to:
Trace, evaluate, and protect every LLM call in one SDK
Stars
12Last commit
21 hours agoLicense
AGPL-3.0
An AI gateway that sits on the request path to handle PII redaction, prompt injection blocking, tracing, evals, and cost tracking for OpenAI, Anthropic, and Gemini.
Open Source Alternative to:
InfluxDB – The purpose-built time series platform for high-velocity ingestion and real-time queries at scale.
Docmost