Submit
Ad
Learn more

Open Source Local Model Runners using SCSS

A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using SCSS.

llama.cpp

AI
Run LLMs locally with minimal setup, maximum hardware support

  • Stars

    132,037

  • Last commit

    2 hours ago

  • License

    MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.

Open Source Alternative to:

LM Studio

Jan

AI
Run AI models locally or connect to cloud, privately

  • Stars

    45,045

  • Last commit

    11 hours ago

  • License

    Apache-2.0
Jan runs open-source AI models on your own hardware or connects to cloud providers like OpenAI, Anthropic, and Google, keeping your conversations off third-party servers.

Open Source Alternative to:

Claude
Ad