Open Source Projects tagged "Llm Serving"
A curated collection of the best open source projects tagged "Llm Serving". Each listing includes a website screenshot along with a detailed review of its features.
High-throughput, memory-efficient serving engine for LLMs
Stars
92,594Last commit
4 hours agoLicense
Apache-2.0
Inference and serving engine for large language models, built for speed and hardware efficiency with an OpenAI-compatible API and support for a wide range of open models.
Open Source Alternative to:
Capture – Capture screenshots, generate PDFs, scrape content, extract metadata, and automate browsers with one API.
Capture