Ad
Learn more

Open Source Local Model Runners using GLSL

A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using GLSL.

Run LLMs locally with minimal setup, maximum hardware support
  • Stars

    132,150
  • Last commit

    8 hours ago
  • License

    MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.

Open Source Alternative to: