Open Source Projects tagged "Cuda"
A curated collection of the best open source projects tagged "Cuda". Each listing includes a website screenshot along with a detailed review of its features.
High-throughput, memory-efficient serving engine for LLMs
Stars
93,122Last commit
4 hours agoLicense
Apache-2.0
Inference and serving engine for large language models, built for speed and hardware efficiency with an OpenAI-compatible API and support for a wide range of open models.
Open Source Alternative to:
Serverless GPU compute with sub-second cold starts
Stars
1,802Last commit
21 hours agoLicense
AGPL-3.0
Run GPU inference, task queues, and sandboxes on serverless infrastructure with sub-second cold starts, autoscaling, and support for your own AWS, GCP, or bare metal.
Open Source Alternative to:
CodeRabbit – The leading AI Code Review platform. Ship better quality code in 50% less time, with 90% fewer bugs.
CodeRabbit