Harbor
Harbor is a CLI and companion tool that simplifies setting up local LLM stacks with a single command. It includes 129 services like chat frontends, LLM backends, web search, voice, image generation, fine-tuning, and agent tools, all pre-configured to work together. The tool is open-source, MIT licensed, and available for Linux and macOS.
Article intelligence
Key points
- One command spins up complete local AI stacks with pre-configured services.
- Includes 129 services covering chat, LLMs, search, voice, image gen, fine-tuning, agents.
- MIT licensed, no telemetry, runs entirely locally.
Why it matters
This matters because one command spins up complete local AI stacks with pre-configured services.
Technical impact
May affect model selection, inference cost, product capability, and evaluation benchmarks.
CLI + companion to spin up complete local LLM stacks - Harbor | Product Hunt
Harbor
Launching today
CLI + companion to spin up complete local LLM stacks
6 followers
CLI + companion to spin up complete local LLM stacks
6 followers
Visit website
Command line tools
•
AI Infrastructure Tools
Harbor saves you dozens of hours configuring your local AI stack. One command spins up LLM backends, chat frontends, web search, voice, image gen, fine-tuning, agent tools - all pre-configured to talk to each other. Manage your downloaded models, create config profiles, use agentic coding tools with your local LLMs, and much more.
Overview
Reviews
Alternatives
Built with
Team
More
Free
Launch tags:Open Source•Artificial Intelligence•GitHub
Launch Team / Built With
Subscribe
Promoted
Maker
📌
Hey PH 👋
I'm Ivan, Harbor's author.
Been working on this for almost two years. Harbor started because I was tired of spending evenings debugging Docker Compose files every time I wanted to try a new local LLM project. It was supposed to be a weekend script, but the problem turned out to be bigger than I thought and it grew into a catalog of 129 services.
The core idea is that local AI services should work together out of the box. harbor up gives you Open WebUI and Ollama. You add more services by name, like harbor up searxng speaches comfyui, and Harbor handles the wiring between them. SearXNG is already connected to your chat UI. Voice already works. Image gen already works. No Compose files to write, no ports to remember.
The catalog covers a lot of ground. There are 16 chat and creative frontends (Open WebUI, LibreChat, SillyTavern, ComfyUI and others), 21 LLM backends (Ollama, llama.cpp, vLLM, SGLang, KTransformers and others), and 90+ satellites for web search, voice, RAG, vector databases, workflow engines like n8n and Dify, fine-tuning with Unsloth, eval harnesses, monitoring, and more.
Everything runs locally, talks to each other, and is one harbor up away. The latest release adds harbor launch, which is the feature I'm most excited about. It runs coding agents like Claude Code, Codex, Copilot, and OpenCode against your local stack without touching a single env var. harbor launch --web gives them web search too and spins up the whole pipeline behind the scenes. Harbor also exposes an OpenAI-compatible API, so any tool or SDK code that speaks OpenAI can point at your local models as a drop-in replacement.
MIT licensed, no telemetry, everything stays on your machine. CLI and desktop app for Linux and macOS. If you run local models and are tired of gluing things together manually, give it a try.
Happy to answer questions about the architecture, supported services, or how specific workflows work.
Report
16h ago