A curated collection of the best open source platforms that manage, secure, and optimize API access to multiple AI models and services through unified interfaces with authentication, rate limiting, and monitoring capabilities. using nvm.
Ultra-fast AI gateway with enterprise-grade reliability
Stars
4,459
Forks
528
Last commit
13 hours ago
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.
Route GenAI traffic with confidence using open source
Stars
1,569
Forks
232
Last commit
1 day ago
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.