SelfHostHub

LLMKube

Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.

236 starsApache-2.0
Visit website ↗Source code

Details

Website
llmkube.com
Source
github.com
Licence
Apache-2.0
Platforms
Go, Docker, K8S
GitHub stars
236
Last update
2026-10-18

Categories

Generative Artificial Intelligence (GenAI)

Alternatives to LLMKube

See all Generative Artificial Intelligence (GenAI) →

Ollama

184k

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

Generative Artificial Intelligence (GenAI)MIT

Open-WebUI

156k

User-friendly AI Interface, supports Ollama, OpenAI API.

Generative Artificial Intelligence (GenAI)BSD-3-Clause

LobeHub

83k

Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.

Generative Artificial Intelligence (GenAI)⊘ Proprietary

AnythingLLM

67k

All-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.

Generative Artificial Intelligence (GenAI)MIT

LocalAI

50k

Run your AI models locally and generate images and audio (alternative to OpenAI and Claude).

Generative Artificial Intelligence (GenAI)MIT

LibreChat

46k

Enhanced ChatGPT-compatible AI chat interface supporting multiple AI providers, with multi-user auth, message search, and plugin support.

Generative Artificial Intelligence (GenAI)MIT