Ad
 
Learn More

Open Source Local Model Runners using GLSL

A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using GLSL.

Run LLMs locally with minimal setup, maximum hardware support
  • Stars


    125,296
  • Last commit


    11 hours ago
  • License


    MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.

Open Source Alternative to:

Favicon