harbor

Harbor is a CLI and companion app that spins up a complete local LLM stack with one command. It pre-wires backends like Ollama, llama.cpp, and vLLM, frontends like Open WebUI, and hundreds of supporting services such as SearXNG web search, Speaches voice chat, and ComfyUI image generation. Pick the services you want and Harbor handles Docker Compose orchestration, configuration, and cross-service connectivity, so no manual setup is needed.