A curated collection of the best open source platforms that manage, secure, and optimize API access to multiple AI models and services through unified interfaces with authentication, rate limiting, and monitoring capabilities. using Azure.
Manage authentication, load balancing, and cost tracking across 100+ LLMs through a single OpenAI-compatible gateway. Trusted by Netflix and enterprise teams.
Ultra-fast AI gateway with enterprise-grade reliability
Stars
5,241
Forks
636
Last commit
6 hours ago
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.