Ad
 
Learn more
Favicon of LLM Gateway

LLM Gateway

Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring.

Screenshot of LLM Gateway website

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface that's compatible with the OpenAI API format for seamless migration.

Key Features:

  • Unified API Interface - Compatible with OpenAI API format for easy integration
  • Multi-provider Support - Connect to OpenAI, Anthropic, Google, and more through one gateway
  • Usage Analytics - Track requests, tokens, response times, and costs across all providers
  • Performance Monitoring - Compare different models' performance and cost-effectiveness
  • Secure Key Management - Manage API keys for different providers in one secure place
  • Self-hosted or Cloud - Deploy on your infrastructure or use hosted version

Simple Integration - Just change your API endpoint and keep your existing code. Works with any language or framework including Python, TypeScript, Java, Rust, Go, PHP, and Ruby.

Flexible Pricing:

  • Self-Host: 100% free forever with full control over your data
  • Free Plan: Access to all models with 5% gateway fee
  • Pro Plan: $50/month with zero fees when using your own API keys
  • Enterprise: Custom solutions with advanced security and 24/7 support

Perfect for developers and organizations looking to optimize their AI infrastructure while maintaining flexibility and control over costs.

Categories:

Share:

Similar open source projects

Favicon

 

  
  • Stars


  • Forks


  • Last commit


Favicon

 

  
  • Stars


  • Forks


  • Last commit


Favicon

 

  
  • Stars


  • Forks


  • Last commit