A curated collection of the best open source platforms that route and secure API access to multiple AI models through one unified interface, with authentication, rate limiting, and usage monitoring. using Golang.
Ultra-fast AI gateway with enterprise-grade reliability
Stars
7,783
Last commit
42 minutes ago
License
Apache-2.0
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.
Route GenAI traffic with confidence using open source
Stars
1,993
Last commit
8 hours ago
License
Apache-2.0
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.