Best Self-hosted LLM Application Frameworks in 2026

Dify

AI-powered app creation without coding complexities

Stars
139,778
Forks
21,921
Last commit
16 hours ago

Create, deploy, and manage AI-native apps effortlessly with a user-friendly platform that combines LLMs and your data

Open Source Alternative to:

Glide

Langflow

Visual builder for AI-powered applications and workflows

Stars
147,575
Forks
8,885
Last commit
9 hours ago

Low-code platform for building agentic and RAG applications with drag-and-drop components, Python customization, and support for any LLM or vector database.

Open Source Alternative to:

Voiceflow

Langfuse

Open source LLM engineering platform for AI-powered applications

Stars
26,401
Forks
2,676
Last commit
8 hours ago

Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.

Open Source Alternative to:

LangSmith

Supermemory

Lightning-fast memory API for AI applications

Stars
22,341
Forks
2,045
Last commit
1 day ago

Add persistent memory to LLM apps with millisecond recall times. Store, retrieve, and personalize user data across sessions with enterprise-grade security.

Open Source Alternative to:

LangChain

Arize Phoenix

Open-source LLM tracing & evaluation for AI optimization

Stars
9,494
Forks
851
Last commit
10 hours ago

Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.

Open Source Alternative to:

LangSmith

Laminar

AI-powered platform for engineering LLM products

Stars
2,819
Forks
193
Last commit
14 hours ago

Laminar is an open-source platform that helps collect, understand, and utilize data for building high-quality LLM applications.

Open Source Alternative to:

LangChain

Trieve

AI-powered search and RAG platform for faster, more relevant results

Stars
2,647
Forks
241
Last commit
3 months ago

Trieve offers an all-in-one solution for search, recommendations, and RAG with automatic continuous improvement based on user feedback.

Open Source Alternative to:

Pinecone

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit

Stars
Forks
Last commit

Dify

AI-powered app creation without coding complexities

Stars
139,778
Forks
21,921
Last commit
16 hours ago

Create, deploy, and manage AI-native apps effortlessly with a user-friendly platform that combines LLMs and your data

Open Source Alternative to:

Glide

Langflow

Visual builder for AI-powered applications and workflows

Stars
147,575
Forks
8,885
Last commit
9 hours ago

Low-code platform for building agentic and RAG applications with drag-and-drop components, Python customization, and support for any LLM or vector database.

Open Source Alternative to:

Voiceflow

Langfuse

Open source LLM engineering platform for AI-powered applications

Stars
26,401
Forks
2,676
Last commit
8 hours ago

Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.

Open Source Alternative to:

LangSmith

Supermemory

Lightning-fast memory API for AI applications

Stars
22,341
Forks
2,045
Last commit
1 day ago

Add persistent memory to LLM apps with millisecond recall times. Store, retrieve, and personalize user data across sessions with enterprise-grade security.

Open Source Alternative to:

LangChain

Arize Phoenix

Open-source LLM tracing & evaluation for AI optimization

Stars
9,494
Forks
851
Last commit
10 hours ago

Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.

Open Source Alternative to:

LangSmith

Laminar

AI-powered platform for engineering LLM products

Stars
2,819
Forks
193
Last commit
14 hours ago

Laminar is an open-source platform that helps collect, understand, and utilize data for building high-quality LLM applications.

Open Source Alternative to:

LangChain

Trieve

AI-powered search and RAG platform for faster, more relevant results

Stars
2,647
Forks
241
Last commit
3 months ago

Trieve offers an all-in-one solution for search, recommendations, and RAG with automatic continuous improvement based on user feedback.

Open Source Alternative to:

Pinecone

Self-hosted LLM Application Frameworks

A curated collection of the best self-hosted frameworks specifically for building applications using Large Language Models.