Openlane – Open-source, developer-first platform for automated compliance, risk management, and built-in Trust Center.

Learn More

LLM Gateway

InfluxDB

The purpose-built time series platform for high-velocity ingestion and real-time queries at scale, without sacrificing performance or cost. Download InfluxDB for free.

Try for free

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface that's compatible with the OpenAI API format for seamless migration.

Key Features:

Unified API Interface - Compatible with OpenAI API format for easy integration
Multi-provider Support - Connect to OpenAI, Anthropic, Google, and more through one gateway
Usage Analytics - Track requests, tokens, response times, and costs across all providers
Performance Monitoring - Compare different models' performance and cost-effectiveness
Secure Key Management - Manage API keys for different providers in one secure place
Self-hosted or Cloud - Deploy on your infrastructure or use hosted version

Simple Integration - Just change your API endpoint and keep your existing code. Works with any language or framework including Python, TypeScript, Java, Rust, Go, PHP, and Ruby.

Flexible Pricing:

Self-Host: 100% free forever with full control over your data
Free Plan: Access to all models with 5% gateway fee
Pro Plan: $50/month with zero fees when using your own API keys

Categories:

AI Gateways

Docmost

Open-source wiki software with real-time collaboration, diagrams, AI, SSO, RBAC permissions and more.

Get started now

Featured projects:

Similar open source projects

Check LLM Gateway alternatives

LiteLLM

LLM gateway for auth, load balancing, and spend tracking

Stars
55,308
Forks
10,258
Last commit
16 hours ago

Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.

Compare with

LLM Gateway

Portkey AI Gateway

Complete production stack for AI teams

Stars
12,626
Forks
1,235
Last commit
2 months ago

Comprehensive AI platform with gateway, observability, guardrails, and prompt management. Access 1,600+ LLMs via unified API with enterprise-grade security.

Compare with

LLM Gateway

Bifrost

Ultra-fast AI gateway with enterprise-grade reliability

Stars
6,965
Forks
980
Last commit
15 hours ago

Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.

Compare with

LLM Gateway

Envoy AI Gateway

Route GenAI traffic with confidence using open source

Stars
1,888
Forks
320
Last commit
21 hours ago

Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.

Compare with

LLM Gateway

Activity score
85/100
Stars
1,492
Forks
167
Last commit
16 hours ago

Activity score
85/100
Stars
1,492
Forks
167
Last commit
16 hours ago
Repository age
1 year

Subscribe to our newsletter

Every Sunday we deconstruct one proprietary app and pick the best open source alternatives worth switching to.