A curated collection of the best open source platforms that manage, secure, and optimize API access to multiple AI models and services through unified interfaces with authentication, rate limiting, and monitoring capabilities. using Azure.
LLM gateway for auth, load balancing, and spend tracking
Stars
50,519
Forks
8,906
Last commit
27 minutes ago
Acts as a unified proxy across 100+ LLMs, normalizing them to the OpenAI format while handling virtual keys, budgets, rate limits, fallbacks, and cost tracking.
Ultra-fast AI gateway with enterprise-grade reliability
Stars
5,821
Forks
763
Last commit
32 minutes ago
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.