Skip to content

Commit 44c2201

Browse files
Merge pull request #16 from Light-Heart-Labs/dream-server-v1
Adding Dream Server. One shot setup for local AI democracy. Oh baby...
2 parents b042dc8 + 96e468e commit 44c2201

274 files changed

Lines changed: 57660 additions & 498 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.gitignore

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -41,3 +41,22 @@ secrets/
4141
token-spy/data/
4242
token-spy/*.db
4343
token-spy/*.sqlite
44+
45+
# ============================================
46+
# Dream Server runtime/build artifacts
47+
# ============================================
48+
dream-server/.env
49+
dream-server/.env.*
50+
!dream-server/.env.example
51+
dream-server/data/
52+
dream-server/models/
53+
dream-server/config/openclaw/workspace/
54+
dream-server/dashboard/node_modules/
55+
dream-server/dashboard/dist/
56+
dream-server/preflight-*.log
57+
dream-server/.current-mode
58+
dream-server/.profiles
59+
dream-server/.claude/
60+
dream-server/.pytest_cache/
61+
dream-server/tests/__pycache__/
62+
dream-server/internal/

COLLECTIVE.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -400,6 +400,8 @@ Each component in this repository maps to a specific architectural role:
400400

401401
The toolkit is the infrastructure layer. The [architecture principles](#architecture-principles) are the design layer. Android-Labs is the application layer.
402402

403+
[**Dream Server**](dream-server/) is how all of this ships to users. It packages vLLM, Open WebUI, voice agents, n8n workflows, RAG, and Privacy Shield into a single installer that auto-detects your GPU and gets everything running in 10 minutes. The toolkit components above are the operational backbone that keeps it stable. Dream Server is the product the Collective built — and the fastest way to get local AI running on your own hardware.
404+
403405
You can use the tools without the architecture. But together, they enable something more than the sum of their parts: a system that runs itself.
404406

405407
---

README.md

Lines changed: 62 additions & 498 deletions
Large diffs are not rendered by default.

dream-server/.gitignore

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,24 @@
1+
# Runtime / secrets
2+
.env
3+
.env.*
4+
5+
# Install-time data directories
6+
data/
7+
models/
8+
9+
# OpenClaw workspace (runtime state)
10+
config/openclaw/workspace/
11+
12+
# Dashboard build artifacts
13+
dashboard/node_modules/
14+
dashboard/dist/
15+
16+
# Preflight logs
17+
preflight-*.log
18+
19+
# Internal dev
20+
internal/
21+
22+
# OS junk
23+
.DS_Store
24+
Thumbs.db

dream-server/CONTRIBUTING.md

Lines changed: 63 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,63 @@
1+
# Contributing to Dream Server
2+
3+
Thanks for wanting to help! Here's how to get involved.
4+
5+
## Reporting Issues
6+
7+
Found a bug? Please open an issue with:
8+
- Your hardware (GPU, RAM, OS)
9+
- What you expected to happen
10+
- What actually happened
11+
- Logs if relevant (`docker compose logs`)
12+
13+
## Pull Requests
14+
15+
1. Fork the repo
16+
2. Create a feature branch (`git checkout -b feature/cool-thing`)
17+
3. Make your changes
18+
4. Test on your hardware
19+
5. Submit PR with clear description
20+
21+
## What We're Looking For
22+
23+
**High Value:**
24+
- New workflow templates (n8n JSON exports)
25+
- Hardware-specific optimizations
26+
- Better error messages
27+
- Documentation improvements
28+
29+
**Good First Issues:**
30+
- Fix typos in docs
31+
- Add more troubleshooting cases
32+
- Improve comments in install.sh
33+
34+
**Harder But Appreciated:**
35+
- Multi-GPU support improvements
36+
- New model presets
37+
- Alternative TTS/STT engines
38+
39+
## Testing Your Changes
40+
41+
```bash
42+
# Fresh install test
43+
rm -rf ~/dream-server
44+
./install.sh --dry-run # Check what would happen
45+
./install.sh # Actually install
46+
47+
# Run the status check
48+
./status.sh
49+
```
50+
51+
## Code Style
52+
53+
- Bash: Use ShellCheck. We're not religious about style, just be consistent.
54+
- YAML: 2-space indent, no tabs.
55+
- Markdown: Keep it readable. No 80-char wrapping.
56+
57+
## Questions?
58+
59+
Open an issue or find us in Discord.
60+
61+
---
62+
63+
*Your contributions help bring local AI to everyone.*

dream-server/DEMO-SCRIPT.md

Lines changed: 136 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,136 @@
1+
# Dream Server Client Demo Script
2+
3+
## Overview
4+
This script guides you through a hands-on demo of Dream Server. The demo covers hardware detection, local LLM chat, voice capabilities, and workflow automation.
5+
6+
**Prerequisites:** Dream Server installed and running (`./scripts/validate.sh` shows green)
7+
8+
---
9+
10+
## 1. Hardware Overview
11+
12+
**Talking Points:**
13+
- Show the auto-detected hardware tier
14+
- Explain how Dream Server optimizes for available resources
15+
16+
**Commands:**
17+
```bash
18+
# Show GPU info
19+
nvidia-smi --query-gpu=name,memory.total --format=csv,noheader
20+
21+
# Check what tier Dream Server detected
22+
cat .env | grep -E "LLM_MODEL|MAX_CONTEXT"
23+
```
24+
25+
**Expected Output:**
26+
GPU model and VRAM, plus the model/context settings Dream Server chose.
27+
28+
---
29+
30+
## 2. Local LLM Chat
31+
32+
**Talking Points:**
33+
- Fully local inference — data never leaves the machine
34+
- OpenAI-compatible API — drop-in replacement for existing tools
35+
36+
**Commands:**
37+
```bash
38+
# Chat completion via API
39+
curl -s http://localhost:8000/v1/chat/completions \
40+
-H "Content-Type: application/json" \
41+
-d '{
42+
"model": "local",
43+
"messages": [{"role": "user", "content": "What is Dream Server in one sentence?"}],
44+
"max_tokens": 100
45+
}' | jq '.choices[0].message.content'
46+
```
47+
48+
**Expected Output:**
49+
A coherent response from the local Qwen model (1-3 seconds).
50+
51+
**Then:** Open http://localhost:3000 to show the chat UI.
52+
53+
---
54+
55+
## 3. Voice Capabilities (if enabled)
56+
57+
**Talking Points:**
58+
- Speech-to-text with Whisper
59+
- Text-to-speech with Kokoro
60+
- Full voice-to-voice conversations via LiveKit
61+
62+
**Commands:**
63+
```bash
64+
# Check voice services are running
65+
docker compose ps whisper piper
66+
67+
# Test STT (if you have an audio file)
68+
curl -X POST "http://localhost:9000/asr" \
69+
-F "audio_file=@test.wav" \
70+
-F "output=json"
71+
```
72+
73+
**Then:** If LiveKit is enabled, open http://localhost:7880 for the voice playground.
74+
75+
---
76+
77+
## 4. Workflow Automation with n8n
78+
79+
**Talking Points:**
80+
- Visual workflow builder
81+
- Pre-built workflows for chat, RAG, voice transcription
82+
- Integrates with any API
83+
84+
**Commands:**
85+
```bash
86+
# Check n8n is running
87+
curl -s http://localhost:5678/ | head -1
88+
```
89+
90+
**Then:** Open http://localhost:5678 and show the pre-imported workflows.
91+
92+
---
93+
94+
## 5. RAG Document Q&A (if enabled)
95+
96+
**Talking Points:**
97+
- Upload documents, ask questions
98+
- Qdrant vector database for semantic search
99+
- Answers cite their sources
100+
101+
**Commands:**
102+
```bash
103+
# Check RAG services
104+
docker compose ps qdrant embeddings
105+
```
106+
107+
**Demo flow:** Import the document-qa workflow in n8n, upload a PDF, ask questions.
108+
109+
---
110+
111+
## 6. The Numbers
112+
113+
**Talking Points:**
114+
- **Cost:** $0/month after hardware (vs $15K+/month for 1M cloud requests)
115+
- **Latency:** 1.5-2s for 32B model
116+
- **Capacity:** 30-40 concurrent voice sessions on dual-GPU
117+
- **Privacy:** Data never leaves your premises
118+
119+
---
120+
121+
## Conclusion
122+
123+
**Summary:**
124+
- Full-featured AI stack: chat, voice, workflows, RAG
125+
- Runs on hardware they already own (or can buy once)
126+
- OpenAI-compatible API — existing tools just work
127+
- Total data sovereignty
128+
129+
**Next Steps:**
130+
- Hardware purchase guide: `docs/HARDWARE-GUIDE.md`
131+
- Pricing tiers: `docs/PRICING-TIERS.md`
132+
- Contact for install support
133+
134+
---
135+
136+
*Built by The Collective — Android-17, Todd, and friends*

0 commit comments

Comments
 (0)