Ad
Learn more

Open Source Projects tagged "Llms"

A curated collection of the best open source projects tagged "Llms". Each listing includes a website screenshot along with a detailed review of its features.

Run open-source LLMs locally on your own machine
  • Stars

    185,362
  • Last commit

    7 hours ago
  • License

    MIT
Runs open-source language models locally with a simple setup, plus optional cloud access for larger models when local hardware isn't enough.

Open Source Alternative to:

One interface for every AI model you run or connect
  • Stars

    157,269
  • Last commit

    4 hours ago
  • License

    BSD-3-Clause
Self-hosted AI platform that connects local and cloud models, extends with Python, and keeps your data under your control.

Open Source Alternative to:

High-throughput, memory-efficient serving engine for LLMs
  • Stars

    Stars growing over the last 30 days95,923
  • Last commit

    5 hours ago
  • License

    Apache-2.0
Inference and serving engine for large language models, built for speed and hardware efficiency with an OpenAI-compatible API and support for a wide range of open models.

Open Source Alternative to:

Coding agent that runs on local and open-weight models
  • Stars

    68,740
  • Last commit

    20 days ago
  • License

    Apache-2.0
Coding agent that lets LLMs write and execute code, manage files, and control your computer using local or low-cost models.

Open Source Alternative to:

Self-hosted AI agent for chat, automation, and workflows
  • Stars

    49,682
  • Last commit

    8 hours ago
  • License

    MIT
Lightweight, self-hosted AI agent that runs in a web UI, terminal, or chat app, handling long-running workflows with controlled token budgets.

Open Source Alternative to:

General-purpose AI agent for code, workflows, and more
  • Stars

    55,968
  • Last commit

    5 hours ago
  • License

    Apache-2.0
Local AI agent with a desktop app, CLI, and API that connects to 15+ LLM providers and 70+ extensions for code, research, automation, and data tasks.

Open Source Alternative to:

Run open-source AI models privately on your own device
  • Stars

    77,345
  • Last commit

    1 year ago
  • License

    MIT
GPT4All runs open-source language models locally on Windows, macOS, and Linux with no cloud dependency, keeping your data on your machine.

Open Source Alternative to:

Self-hosted AI runtime for text, voice, vision, and agents
  • Stars

    50,078
  • Last commit

    9 hours ago
  • License

    MIT
Run LLMs, speech, image generation, and autonomous agents on your own hardware with an OpenAI-compatible API and 60+ swappable backends.

Open Source Alternative to:

Open source AI coding agent for the terminal and IDE
  • Stars

    28,839
  • Last commit

    4 hours ago
  • License

    Apache-2.0
Terminal-based AI coding agent that reads your codebase, edits files and runs commands, with support for Qwen, OpenAI, Anthropic, Gemini and local models.

Open Source Alternative to:

AI-powered code completion for seamless development
  • Stars

    33,923
  • Last commit

    4 months ago
  • License

    Apache-2.0
Self-hosted AI coding assistant that enhances productivity with context-aware suggestions and privacy-focused implementation.

Open Source Alternative to:

Open-source vector database for AI search and retrieval
  • Stars

    29,609
  • Last commit

    2 days ago
  • License

    Apache-2.0
Open-source vector database designed for AI applications. Store, search, and retrieve embeddings with semantic similarity matching and metadata filtering.

Open Source Alternative to:

Build unlimited AI apps locally with zero vendor lock-in
  • Stars

    22,125
  • Last commit

    1 day ago
  • License

    Apache-2.0
Create full-stack AI applications using any model or tool. Run entirely on your machine with complete privacy, flexibility, and control over your code.

Open Source Alternative to:

Open-source LLM tracing & evaluation for AI optimization
  • Stars

    Stars growing over the last 30 days12,077
  • Last commit

    5 hours ago
  • License

    Elastic-2.0
Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.

Open Source Alternative to:

Complete production stack for AI teams
  • Stars

    13,292
  • Last commit

    5 months ago
  • License

    MIT
Comprehensive AI platform with gateway, observability, guardrails, and prompt management. Access 1,600+ LLMs via unified API with enterprise-grade security.

Open Source Alternative to:

Smart desktop AI assistant with powerful local knowledge features
  • Stars

    5,375
  • Last commit

    16 hours ago
  • License

    Unknown
Cross-platform desktop AI assistant supporting multiple providers, local knowledge base, and custom prompts. Integrates MCP protocol for enhanced AI tool capabilities.

Open Source Alternative to:

Monitor, debug, and scale LLM applications with ease
  • Stars

    Stars growing over the last 30 days2,896
  • Last commit

    5 days ago
  • License

    Apache-2.0
Open-source observability platform for GenAI and LLM applications. Real-time monitoring, distributed tracing, prompt management, and AI model evaluation built on OpenTelemetry.

Open Source Alternative to:

GPU orchestration across clouds, Kubernetes, and on-prem
  • Stars

    2,296
  • Last commit

    9 hours ago
  • License

    MPL-2.0
Unified control plane for AI compute that provisions and schedules GPU workloads across any cloud, Kubernetes cluster, or bare-metal server.

Open Source Alternative to:

Unified API for all LLM providers with analytics
  • Stars

    1,718
  • Last commit

    5 hours ago
  • License

    MIT
Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring.

Open Source Alternative to: