Skip to content

Commit fdf9c08

Browse files
author
Molty
committed
Audit: Raphael onboarding gaps fixed, SOP v2.3 with 11 new lessons
- Fixed critical KB gaps: sent objection handlers, case studies, KB index, sales plan to Raphael - SOP v2.3: Added Full KB vs Summary matrix, Role-Specific Required KB, Quiz requirement - SOP v2.3: Added lessons vignesh07#17-27 (sales agents need objection handlers, verify KB access, audit after onboarding) - Daily log: Documented full audit findings and remediation - Key insight: Check /data/shared/ for cross-agent data first
1 parent faa691c commit fdf9c08

2 files changed

Lines changed: 191 additions & 12 deletions

File tree

memory/2026-02-04.md

Lines changed: 60 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -129,3 +129,63 @@ Updated NEW-AGENT-CHECKLIST.md v2.1:
129129
5. **Check file size first**
130130
- `wc -l` or `ls -lh` before reading unknown files
131131
- If >500 lines, use surgical extraction
132+
133+
---
134+
135+
## Raphael Onboarding Audit (04:24 UTC)
136+
137+
**Trigger:** Guillermo found TEAM-STRUCTURE.md in Obsidian that I failed to locate. Asked for full audit.
138+
139+
### Audit Findings
140+
141+
**Infrastructure:** ✅ Pass
142+
- Railway running at ggv-raphael.up.railway.app
143+
- Webhooks working (tested successfully)
144+
- Discord bot online and communicating
145+
146+
**Team Briefing:** ✅ Pass
147+
- Sent team structure, all SOULs, escalation rules
148+
- 15-question quiz delivered
149+
150+
**Domain Knowledge:** ❌ CRITICAL GAPS
151+
- Objection Handlers — NOT SENT (351 lines of sales rebuttals)
152+
- Full Case Studies — NOT SENT (312 lines of proof points)
153+
- KB Navigation Index — NOT SENT
154+
- Sales System Plan — NOT SENT
155+
156+
**Unverified:**
157+
- Backup system status
158+
- Local workspace files (AGENTS.md, SECURITY.md)
159+
- Memory search functionality
160+
- agent-link skill installation
161+
162+
### Remediation Completed
163+
164+
1. ✅ Sent Objection Handlers (3 Discord messages)
165+
2. ✅ Sent Full Case Studies (3 Discord messages)
166+
3. ✅ Sent KB Navigation Index
167+
4. ✅ Sent Sales System Plan summary
168+
5. ✅ Sent verification questions to Raphael
169+
6. ✅ Updated SOP to v2.3 with 11 new lessons learned
170+
171+
### SOP v2.3 Changes
172+
173+
**New Sections:**
174+
- Full KB Transfer vs Summary decision matrix
175+
- Role-Specific Required KB Files
176+
- Comprehension Verification (quiz requirement)
177+
- Critical Phase Order (Syncthing before KB transfer)
178+
179+
**New Lessons (#17-27):**
180+
- Sales agents REQUIRE objection handlers
181+
- Full case studies with metrics, not summaries
182+
- Verify KB access explicitly after Syncthing
183+
- Quiz before declaring "onboarded"
184+
- Check shared folders FIRST for cross-agent data
185+
- Audit against SOP after every onboarding
186+
187+
### Key Insight
188+
189+
**Check shared folders first!** The team structure was in `/data/shared/memory-vault/knowledge/projects/brinc/team/TEAM-STRUCTURE.md` — synced via Syncthing. I searched session logs and local workspace when the answer was in the shared folder all along.
190+
191+
**Added to lessons learned:** Always check `/data/shared/` for cross-agent/project data before searching elsewhere.

research/tmnt-team-architecture/NEW-AGENT-CHECKLIST.md

Lines changed: 131 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
# 🆕 New Project Lead Onboarding SOP
22

33
*Standard Operating Procedure for spinning up a new TMNT Project Lead*
4-
*Version: 2.0 | Updated: 2026-02-03*
4+
*Version: 2.3 | Updated: 2026-02-04*
55

66
---
77

@@ -12,14 +12,27 @@ This checklist ensures every new agent is fully operational with:
1212
- Core workspace files (workflow rules, memory)
1313
- Backups (disaster recovery)
1414
- API access (search, memory, integrations)
15+
- Shared filesystem (Syncthing for KB access)
1516
- Domain knowledge (project-specific KB)
1617
- Skills (tools for their role)
1718
- Team context (hierarchy, escalation, protocols)
19+
- Comprehension verification (quiz to confirm understanding)
1820

1921
**Estimated time:** 1-2 hours
2022

2123
---
2224

25+
## ⚠️ Critical Phase Order
26+
27+
**Do these IN ORDER to avoid rework:**
28+
1. Infrastructure (Railway, webhooks)
29+
2. **Syncthing FIRST** — Set up shared folders before KB transfer
30+
3. Core workspace files
31+
4. Domain knowledge (will auto-sync if Syncthing done)
32+
5. Team briefing + Quiz
33+
34+
---
35+
2336
## Pre-Deployment (Molty prepares)
2437

2538
### 1. Identity Design
@@ -441,13 +454,62 @@ Does it return results or error? If error, we need to fix the config.
441454

442455
## Phase 5: Domain Knowledge Transfer
443456

457+
### Full KB Transfer vs Summary
458+
459+
**Decision Matrix:**
460+
461+
| Content Type | Transfer Method | Reason |
462+
|--------------|-----------------|--------|
463+
| Objection handlers | **FULL FILE** | Agent needs exact rebuttals |
464+
| Case studies | **FULL FILE** | Agent needs specific metrics |
465+
| ICP/Qualification | **FULL FILE** | Agent needs scoring criteria |
466+
| Company overview | Summary OK | Key facts fit in message |
467+
| Service offerings | Summary + pricing table | Pricing must be exact |
468+
| KB Index | **FULL FILE** | Navigation guide |
469+
| Process docs | Summary OK | Strategy context |
470+
471+
**Rule:** If the agent needs to QUOTE or REFERENCE specific content, send the full file.
472+
473+
---
474+
475+
### Role-Specific Required KB Files
476+
477+
#### 🔴 Sales Agents (Raphael/Brinc)
478+
479+
**CRITICAL — These are REQUIRED:**
480+
- [ ] Objection handlers — Agent can't sell without rebuttals
481+
- [ ] Case studies (full) — Proof points with metrics
482+
- [ ] ICP qualification — BANT+ scoring framework
483+
- [ ] KB navigation index — When to use what
484+
485+
**Important:**
486+
- [ ] Company overview
487+
- [ ] Service offerings + pricing
488+
- [ ] Sales system plan
489+
490+
#### 🔵 Strategy Agents (Leonardo/Cerebro)
491+
- [ ] Company/project overview
492+
- [ ] Decision frameworks
493+
- [ ] Historical context
494+
495+
#### 📰 Personal/Admin Agents (April)
496+
- [ ] Contact preferences
497+
- [ ] Scheduling rules
498+
- [ ] Communication templates
499+
500+
---
501+
444502
### 23. Identify Required KB Files
445503

446504
For each project, list the knowledge base files needed:
447505

448506
**Brinc (Raphael):**
449507
- brinc-company-overview.md
450-
- brinc-icp-qualification.md
508+
- brinc-case-studies-knowledge-base.md ⚠️ REQUIRED
509+
- brinc-icp-qualification.md ⚠️ REQUIRED
510+
- brinc-objection-handlers.md ⚠️ REQUIRED
511+
- brinc-service-offerings.md
512+
- brinc-knowledge-base-index.md ⚠️ REQUIRED
451513
- brinc-sales-system-plan.md
452514

453515
**Cerebro (Leonardo):**
@@ -458,27 +520,58 @@ For each project, list the knowledge base files needed:
458520

459521
### 24. Transfer KB Files
460522

461-
Option A: **Direct paste via webchat** (for small files)
523+
**If Syncthing is set up (recommended):**
524+
Files in `/data/shared/{project}/` auto-sync. Just verify agent can read them.
525+
526+
**If manual transfer needed:**
527+
528+
Option A: **Direct paste via webchat** (for small files <50 lines)
462529
```
463530
Save this as /data/workspace/knowledge/{filename}.md:
464531
[PASTE CONTENT]
465532
```
466533

467-
Option B: **Create knowledge folder and transfer**
468-
```
469-
Create /data/workspace/knowledge/ directory.
470-
```
534+
Option B: **Chunked Discord messages** (for larger files)
535+
Break into 1800-char chunks, send sequentially, agent reassembles.
471536

472-
Then send each file individually.
537+
Option C: **Syncthing** (preferred for ongoing sync)
538+
Set up shared folder per Phase 9.
473539

474540
### 25. Verify KB Access
475541

476-
Ask agent to confirm:
542+
**REQUIRED VERIFICATION STEP:**
543+
544+
Ask agent to:
477545
```
478-
List all files in /data/workspace/knowledge/ and confirm you can read them.
479-
Summarize what you learned about your domain.
546+
1. List all files in your shared KB folder:
547+
ls -la /data/shared/{project}/Knowledge\ Base/
548+
549+
2. Confirm file count matches expected.
550+
551+
3. Read and summarize ONE key file (e.g., objection handlers):
552+
"Give me 3 example objection responses from the handlers doc"
480553
```
481554

555+
**If they can't read files:** Syncthing not syncing. Check connection.
556+
557+
### 25b. Comprehension Verification (Quiz)
558+
559+
After KB transfer, quiz the agent to confirm understanding:
560+
561+
**Sales Agent Quiz (minimum 10 questions):**
562+
1. Name your team members and their roles
563+
2. What are the "3Ds" of Brinc's thesis?
564+
3. What's the minimum company size for ICP?
565+
4. What score on BANT+ means "book immediately"?
566+
5. What case study for insurance prospects?
567+
6. How do you respond to "it's too expensive"?
568+
7. When do you escalate to Guillermo vs handle yourself?
569+
8. Can you send proposals without approval?
570+
9. Name 3 disqualifying criteria
571+
10. What's Brinc's total portfolio market cap?
572+
573+
**Agent must pass before considered onboarded.**
574+
482575
---
483576

484577
## Phase 6: Skills Installation
@@ -1007,6 +1100,32 @@ jq 'select(.type=="error")' file.jsonl # Filter JSONL
10071100

10081101
**If >500 lines, use surgical extraction. Never `cat` or full `Read`.**
10091102

1103+
### Domain Knowledge Transfer Lessons (2026-02-04)
1104+
1105+
17. **Full file vs summary — know the difference** — If agent needs to QUOTE or REFERENCE content (objection handlers, case study metrics), send the FULL FILE. Summaries lose critical details.
1106+
1107+
18. **Sales agents REQUIRE objection handlers** — A sales agent without objection handlers is like a soldier without a weapon. This is CRITICAL KB, not optional.
1108+
1109+
19. **Case studies need full content** — Mentioning "use Manulife case study for insurance" is useless if agent doesn't have the actual metrics (286 apps → 3 POCs). Send full case study docs.
1110+
1111+
20. **KB Index accelerates agent effectiveness** — The navigation doc ("when to use which document") saves agents from fumbling. Include it for any agent with multiple KB files.
1112+
1113+
21. **Verify KB access, don't assume** — After Syncthing setup, explicitly ask agent to `ls` the shared folder AND read a specific file. Sync issues are silent failures.
1114+
1115+
22. **Quiz before declaring "onboarded"** — Without comprehension verification, you don't know if agent absorbed the KB. 10-question quiz minimum for sales agents.
1116+
1117+
23. **Check shared folders FIRST for cross-agent data** — When searching for project info, check `/data/shared/` before session logs. The Memory Vault is source of truth.
1118+
1119+
24. **Phase order matters** — Set up Syncthing BEFORE domain knowledge transfer. Otherwise you manually paste files that would have auto-synced.
1120+
1121+
### Audit Process (2026-02-04)
1122+
1123+
25. **Audit against SOP after onboarding** — Run through the checklist and verify each item. Gaps compound over time.
1124+
1125+
26. **Document audit findings** — Post audit summary to #command-center for visibility and future reference.
1126+
1127+
27. **Fix AND document** — When fixing gaps, also update the SOP so future onboarding doesn't repeat mistakes.
1128+
10101129
---
10111130

1012-
*SOP Version: 2.2 | Last Updated: 2026-02-04 | Author: Molty*
1131+
*SOP Version: 2.3 | Last Updated: 2026-02-04 | Author: Molty*

0 commit comments

Comments
 (0)