Learn More

Open Source Projects tagged "Moe"

A curated collection of the best open source projects tagged "Moe". Each listing includes a website screenshot along with a detailed review of its features.

High-throughput, memory-efficient serving engine for LLMs
  • Stars


    92,594
  • Last commit


    4 hours ago
  • License


    Apache-2.0
Inference and serving engine for large language models, built for speed and hardware efficiency with an OpenAI-compatible API and support for a wide range of open models.

Open Source Alternative to:

Favicon