Dream Server v2.0.0 — Strix Halo
One command to a full local AI stack. Buy hardware. Run installer. AI running.
Highlights
- AMD Strix Halo support — ROCm 7.2 with unified memory tiers (SH_LARGE, SH_COMPACT), running Qwen3 Coder Next 80B MoE on a single APU
- NVIDIA ultra tier — NV_ULTRA for 90GB+ multi-GPU setups (A100/H100)
- Modular installer — 2591-line monolith rewritten as 6 libraries + 13 phases, each in its own file
- Bootstrap mode — chat in under 2 minutes with a tiny model while the full model downloads in the background
- Extension system — every service is a manifest + compose fragment, hot-pluggable via
dream enable/disable - 13 integrated services — LLM inference, chat UI, voice (STT + TTS), AI agents, workflow automation, RAG, web search, deep research, image generation, and privacy tools
- Management dashboard — real-time GPU metrics, service health, model info, all in one view
- dream-cli — full stack management with mode switching (local/cloud/hybrid), model swapping, presets
What's Included
| Service | Purpose |
|---|---|
| llama-server | LLM inference (CUDA + ROCm) |
| Open WebUI | Chat interface |
| LiteLLM | API gateway (local/cloud/hybrid) |
| OpenClaw | Autonomous AI agents |
| n8n | Workflow automation (400+ integrations) |
| Whisper | Speech-to-text |
| Kokoro | Text-to-speech |
| Qdrant | Vector database for RAG |
| SearXNG | Self-hosted web search |
| Perplexica | Deep research engine |
| ComfyUI | Image generation |
| Privacy Shield | PII scrubbing proxy |
| Dashboard | GPU metrics + service health |
Hardware Auto-Detection
The installer detects your GPU and picks the optimal model:
| Hardware | VRAM | Model |
|---|---|---|
| NVIDIA 8-11 GB | RTX 4060 Ti | Qwen 2.5 7B |
| NVIDIA 12-20 GB | RTX 3090 | Qwen 2.5 14B |
| NVIDIA 20-40 GB | RTX 4090 | Qwen 2.5 32B |
| NVIDIA 40+ GB | A100 | Qwen 2.5 72B |
| NVIDIA 90+ GB | Multi-GPU | Qwen3 Coder Next 80B |
| AMD Strix Halo 64 GB | Ryzen AI MAX+ 395 | Qwen3 30B-A3B |
| AMD Strix Halo 96 GB | Ryzen AI MAX+ 395 | Qwen3 Coder Next 80B |
Install
curl -fsSL https://raw.githubusercontent.com/Light-Heart-Labs/DreamServer/main/dream-server/get-dream-server.sh | bashFull Changelog
See CHANGELOG.md for the complete list of changes.