Ad
Learn more

Open Source Projects tagged "Ggml"

A curated collection of the best open source projects tagged "Ggml". Each listing includes a website screenshot along with a detailed review of its features.

Run LLMs locally with minimal setup, maximum hardware support
  • Stars

    132,150
  • Last commit

    4 hours ago
  • License

    MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.

Open Source Alternative to: