Ollama
184kGet up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
Generative Artificial Intelligence (GenAI)MIT
Self-hosted Generative Artificial Intelligence (GenAI)
SelfHostHub lists 14 open-source Generative Artificial Intelligence projects you can host on your own server. The most-starred on GitHub are Ollama (183,749 stars), Open-WebUI (156,087 stars) and LobeHub (83,311 stars). 14 of them document a Docker install, and 2 offer a live demo you can try first.
Replacing a paid app? See open-source alternatives to ChatGPT.
Open-WebUI
156kUser-friendly AI Interface, supports Ollama, OpenAI API.
Generative Artificial Intelligence (GenAI)BSD-3-Clause
LobeHub
83kModern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.
Generative Artificial Intelligence (GenAI)⊘ Proprietary
AnythingLLM
67kAll-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
Generative Artificial Intelligence (GenAI)MIT
LocalAI
50kRun your AI models locally and generate images and audio (alternative to OpenAI and Claude).
Generative Artificial Intelligence (GenAI)MIT
LibreChat
46kEnhanced ChatGPT-compatible AI chat interface supporting multiple AI providers, with multi-user auth, message search, and plugin support.
Generative Artificial Intelligence (GenAI)MIT
Khoj
38kYour AI second brain. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI.
Generative Artificial Intelligence (GenAI)AGPL-3.0
Vane
37kAI-powered search engine (alternative to Perplexity AI).
Generative Artificial Intelligence (GenAI)MIT
Chat UI that works with any LLM. It comes loaded with advanced features like agents, web search, RAG, MCP, deep research, Connectors to 40+ knowledge sources, and more.
Generative Artificial Intelligence (GenAI)MIT
AI-powered deep research tool with multi-source search (arXiv, PubMed, web), PDF text extraction, and encrypted local storage.
Generative Artificial Intelligence (GenAI)MIT
Agenta
4.8kLLMOps platform for prompt management, LLM evaluation, and observability. Build, evaluate, and monitor production-grade LLM applications with collaborative prompt engineering.
Generative Artificial Intelligence (GenAI)MIT
LLM Harbor
3.2kContainerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI.
Generative Artificial Intelligence (GenAI)Apache-2.0
GoModel
1.2kAI gateway written in Go with a unified OpenAI-compatible API for multiple LLM providers, USD cost tracking, budgets, usage analytics, guardrails, caching, and an admin dashboard.
Generative Artificial Intelligence (GenAI)MIT
LLMKube
236Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.
Generative Artificial Intelligence (GenAI)Apache-2.0
How to choose self-hosted Generative Artificial Intelligence software
- Check project health. Stars show popularity, not maintenance. Open the source repository and look at recent commits and releases.
- Match the licence to your use. 1 use a GPL-family licence (copyleft, including AGPL) and 12 use a permissive licence such as MIT, Apache-2.0 or BSD. AGPL matters if you modify the software and offer it to others over a network.
- Pick a stack you can run. The most common platforms here are Docker (14), Python (4), Nodejs (3) and K8S (3). Docker is usually the easiest path for a home server or VPS.
- Try before you migrate. Use a live demo where one exists (2 here), or a throwaway container first, and confirm it can import your existing data before switching.
Frequently asked questions
What is the most popular self-hosted Generative Artificial Intelligence software?
By GitHub stars, the top projects in this category are Ollama (183,749 stars), Open-WebUI (156,087 stars) and LobeHub (83,311 stars).
How many open-source Generative Artificial Intelligence tools are listed?
14 projects are currently listed in the Generative Artificial Intelligence category on SelfHostHub.
Which licences do self-hosted Generative Artificial Intelligence projects use?
The most common licences in this category are MIT (9), Apache-2.0 (2) and BSD-3-Clause (1).
Can I run these Generative Artificial Intelligence tools with Docker?
14 of the 14 projects list Docker as a supported platform. Check each project's documentation for the exact install steps.