End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.
linux debian llm llamacpp comfyui vllm ollama open-webui mcp-proxy llama-swap kokoro-fastapi mcpjungle
-
Updated
Oct 10, 2025