Learn More

Open Source Projects tagged "Ai Gateway"

A curated collection of the best open source projects tagged "Ai Gateway". Each listing includes a website screenshot along with a detailed review of its features.

LLM gateway for auth, load balancing, and spend tracking
  • Stars


    59,829
  • Last commit


    3 hours ago
  • License


    Unknown
Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.

Open Source Alternative to:

Zero trust network access that's better than VPN
  • Stars


    22,951
  • Last commit


    9 hours ago
  • License


    AGPL-3.0
Deploy zero trust access to infrastructure, self-hosted apps, and SaaS tools in days. Identity-aware security with seamless user experience.

Open Source Alternative to:

High-performance API gateway with built-in LLM support
  • Stars


    17,173
  • Last commit


    1 day ago
  • License


    Apache-2.0
Apache APISIX is an open-source API gateway built on NGINX and etcd, offering dynamic routing, 100+ plugins, load balancing, authentication, and traffic management for APIs and LLM workloads.

Open Source Alternative to:

Complete production stack for AI teams
  • Stars


    13,106
  • Last commit


    4 months ago
  • License


    MIT
Comprehensive AI platform with gateway, observability, guardrails, and prompt management. Access 1,600+ LLMs via unified API with enterprise-grade security.

Open Source Alternative to:

Ultra-fast AI gateway with enterprise-grade reliability
  • Stars


    8,429
  • Last commit


    3 hours ago
  • License


    Apache-2.0
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.

Open Source Alternative to:

Universal API management for REST, GraphQL, gRPC & async
  • Stars


    10,839
  • Last commit


    18 hours ago
  • License


    Unknown
Fast, scalable API management platform with open source gateway, analytics, dev portal and dashboard. Deploy anywhere with AI-ready governance and security.

Open Source Alternative to:

Route GenAI traffic with confidence using open source
  • Stars


    2,154
  • Last commit


    20 hours ago
  • License


    Apache-2.0
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.

Open Source Alternative to:

Blazing-fast API gateway with linear scalability
  • Stars


    2,689
  • Last commit


    1 day ago
  • License


    Apache-2.0
High-performance, stateless API gateway built for microservices. Handle 80K+ requests/second with transparent pricing and enterprise-grade reliability.

Open Source Alternative to:

Unified API for all LLM providers with analytics
  • Stars


    1,665
  • Last commit


    3 hours ago
  • License


    MIT
Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring.

Open Source Alternative to:

One self-hosted binary replaces Vercel, Sentry, and analytics tools
  • Stars


    806
  • Last commit


    3 hours ago
  • License


    Apache-2.0
Self-hosted platform for small dev teams combining deployments, error tracking, analytics, session replay, uptime monitoring, and managed databases in one dashboard.

Open Source Alternative to:

Trace, evaluate, and protect every LLM call in one SDK
  • Stars


    10
  • Last commit


    1 month ago
  • License


    AGPL-3.0
An AI gateway that sits on the request path to handle PII redaction, prompt injection blocking, tracing, evals, and cost tracking for OpenAI, Anthropic, and Gemini.

Open Source Alternative to:

Favicon