Open Source Local Model Runners using Rust
A curated collection of the best open source run and serve large language models locally or on your own infrastructure. using Rust.
Self-hosted AI runtime for text, voice, vision, and agents
Stars
48,862Last commit
10 hours agoLicense
MIT
Run LLMs, speech, image generation, and autonomous agents on your own hardware with an OpenAI-compatible API and 60+ swappable backends.
Open Source Alternative to:
Run AI models locally or connect to cloud, privately
Stars
44,338Last commit
16 hours agoLicense
Apache-2.0
Jan runs open-source AI models on your own hardware or connects to cloud providers like OpenAI, Anthropic, and Google, keeping your conversations off third-party servers.
Open Source Alternative to:
InfluxDB – The purpose-built time series platform for high-velocity ingestion and real-time queries at scale.
Openlane