A curated collection of the best open source projects tagged "Ggml". Each listing includes a website screenshot along with a detailed review of its features.
Run LLMs locally with minimal setup, maximum hardware support
Stars
125,499
Last commit
3 hours ago
License
MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.