Open Source Local Model Runners using Swift
A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using Swift.
Run LLMs locally with minimal setup, maximum hardware support
Stars
124,707Last commit
8 hours agoLicense
MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.
Open Source Alternative to:
Sevalla – Deploy your app before your coffee gets cold. It’s that easy. Try Sevalla with $50 free credit.
Sevalla