Open Source Local Model Runners using SvelteKit
A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using SvelteKit.
Run LLMs locally with minimal setup, maximum hardware support
Stars
127,051Last commit
5 hours agoLicense
MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.
Open Source Alternative to:
Sevalla – Deploy your app before your coffee gets cold. It’s that easy. Try Sevalla with $50 free credit.
Docmost