Learn More

Open Source Local Model Runners using GLSL

A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using GLSL.

Run LLMs locally with minimal setup, maximum hardware support
  • Stars


    130,224
  • Last commit


    7 hours ago
  • License


    MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.

Open Source Alternative to:

Favicon