Open Source Projects tagged "Ai Gateway"
A curated collection of the best open source projects tagged "Ai Gateway". Each listing includes a website screenshot along with a detailed review of its features.
LLM gateway for auth, load balancing, and spend tracking
Stars
Stars growing over the last 30 days62,891Last commit
8 hours agoLicense
Unknown
Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.
Open Source Alternative to:
Zero trust network access that's better than VPN
Stars
23,346Last commit
2 days agoLicense
AGPL-3.0
Deploy zero trust access to infrastructure, self-hosted apps, and SaaS tools in days. Identity-aware security with seamless user experience.
Open Source Alternative to:
High-performance API gateway with built-in LLM support
Stars
17,303Last commit
2 days agoLicense
Apache-2.0
Apache APISIX is an open-source API gateway built on NGINX and etcd, offering dynamic routing, 100+ plugins, load balancing, authentication, and traffic management for APIs and LLM workloads.
Open Source Alternative to:
Complete production stack for AI teams
Stars
13,341Last commit
6 months agoLicense
MIT
Comprehensive AI platform with gateway, observability, guardrails, and prompt management. Access 1,600+ LLMs via unified API with enterprise-grade security.
Open Source Alternative to:
Ultra-fast AI gateway with enterprise-grade reliability
Stars
Stars growing over the last 30 days9,428Last commit
1 day agoLicense
Apache-2.0
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.
Open Source Alternative to:
Universal API management for REST, GraphQL, gRPC & async
Stars
10,879Last commit
2 days agoLicense
Unknown
Fast, scalable API management platform with open source gateway, analytics, dev portal and dashboard. Deploy anywhere with AI-ready governance and security.
Open Source Alternative to:
Route GenAI traffic with confidence using open source
Stars
Stars growing over the last 30 days2,367Last commit
2 days agoLicense
Apache-2.0
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.
Open Source Alternative to:
Blazing-fast API gateway with linear scalability
Stars
2,702Last commit
6 days agoLicense
Apache-2.0
High-performance, stateless API gateway built for microservices. Handle 80K+ requests/second with transparent pricing and enterprise-grade reliability.
Open Source Alternative to:
Unified API for all LLM providers with analytics
Stars
Stars growing over the last 30 days1,731Last commit
13 hours agoLicense
MIT
Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring.
Open Source Alternative to:
One self-hosted binary replaces Vercel, Sentry, and analytics tools
Stars
Stars growing over the last 30 days904Last commit
23 hours agoLicense
Apache-2.0
Self-hosted platform for small dev teams combining deployments, error tracking, analytics, session replay, uptime monitoring, and managed databases in one dashboard.
Open Source Alternative to:
Trace, evaluate, and protect every LLM call in one SDK
Stars
12Last commit
21 hours agoLicense
AGPL-3.0
An AI gateway that sits on the request path to handle PII redaction, prompt injection blocking, tracing, evals, and cost tracking for OpenAI, Anthropic, and Gemini.
Open Source Alternative to:
InfluxDB – The purpose-built time series platform for high-velocity ingestion and real-time queries at scale.
Docmost