Open Source Local Model Runners using MATLAB
A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using MATLAB.
Run open-source LLMs locally on your own machine
Stars
180,817Last commit
2 days agoLicense
MIT
Runs open-source language models locally with a simple setup, plus optional cloud access for larger models when local hardware isn't enough.
Open Source Alternative to:
Run LLMs locally with minimal setup, maximum hardware support
Stars
128,102Last commit
10 hours agoLicense
MIT
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.
Open Source Alternative to:
InfluxDB – The purpose-built time series platform for high-velocity ingestion and real-time queries at scale.
Stellar Hosted