Open Source Local Model Runners using Storybook
A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using Storybook.
Run open-source LLMs locally on your own machine
Stars
180,149Last commit
6 hours agoLicense
MIT
Runs open-source language models locally with a simple setup, plus optional cloud access for larger models when local hardware isn't enough.
Open Source Alternative to:
Run LLMs locally with minimal setup, maximum hardware support
Stars
127,051Last commit
5 hours agoLicense
MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.
Open Source Alternative to:
Stellar Hosted – Managed Open Source software hosting in the EU: secure, compliant, fast.
Openlane