Open Source Projects tagged "Inference"
A curated collection of the best open source projects tagged "Inference". Each listing includes a website screenshot along with a detailed review of its features.
Route GenAI traffic with confidence using open source
Stars
1,940Last commit
11 hours agoLicense
Apache-2.0
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.
Open Source Alternative to:
GPU orchestration across clouds, Kubernetes, and on-prem
Stars
2,216Last commit
6 hours agoLicense
MPL-2.0
Unified control plane for AI compute that provisions and schedules GPU workloads across any cloud, Kubernetes cluster, or bare-metal server.
Open Source Alternative to:
Unified API for all LLM providers with analytics
Stars
1,556Last commit
6 hours agoLicense
MIT
Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring.
Open Source Alternative to:
CodeRabbit – The leading AI Code Review platform. Ship better quality code in 50% less time, with 90% fewer bugs.
CodeRabbit