A curated collection of the best open source platforms that manage, secure, and optimize API access to multiple AI models and services through unified interfaces with authentication, rate limiting, and monitoring capabilities. using Python.
Manage authentication, load balancing, and cost tracking across 100+ LLMs through a single OpenAI-compatible gateway. Trusted by Netflix and enterprise teams.
Route GenAI traffic with confidence using open source
Stars
1,529
Forks
222
Last commit
2 days ago
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.