Run Llama, Qwen, DeepSeek and other large models locally with a single command.
LLMKube
Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.
- Category
- 🤖 AI & Search
- Repository
- defilantech/LLMKube
- Stars
- ★ 234
- Forks
- 41
- Language
- Go
- License
- Apache-2.0
- Last updated
- 2026-10-16
- Visits
- 0
DockerGo
Similar projects
An all-in-one AI app: feed any document to an LLM and chat with it, with support for local models and many vector databases.
A fast, easy-to-use open-source search engine with out-of-the-box typo tolerance and relevance ranking.
An OpenAI-compatible local inference service that runs many kinds of models even without a GPU.
User-friendly AI Interface, supports Ollama, OpenAI API.
开源的个人 AI“第二大脑”，可搜索文档与笔记并回答问题。