[META] Airo Mind Wave 2 — meeting intelligence pipeline

[ucguy4u]

Goal

Execute Wave 2 of the offline meeting-intelligence pipeline. MoM is a projection of Meeting IR, not the first LLM step.

North star: M4A/WAV → preprocess → whisper ASR → normalize+chunk → Pass-1 extract → Pass-2 consolidate → IR validate → MoM from IR → eval → persist MeetingRecord + IR (#1657).

Already on main (do not redo)

• fix(mind): CLI compile + export saved minutes as mom.md #1768 export, feat(mind): standalone model hub, HF downloads, warmup-gated chat #1769 models/multilingual scribe, feat(mind): #1657 Stage 2 -- Meeting IR write path (decisions/actions/metrics persisted) #1760/[MIND-LLM-16] Meeting IR persistence + Mind runtime integration (projections, search, cross-meeting memory) #1657 IR write path
• Wave 1 agents A–F merged (feat(mind): HF GGUF discovery + offline catalog cache (#1773) #1775–test(mind): gated Pixel 9 device journey (#1771) #1780, fix(mind): init whisper bridge in device journey test #1783)
• Rust: airo_mind_transcript, airo_mind_meeting, airo_mind_eval, airo_mind_cli (Wave 1 CLI only)
• Agent C IR UI (feat(mind): Meeting IR UI — MoM sections, checkable actions, evidence (#1658) #1777) — verify after J0 populates IR fields

Epic: #1627 · POC ladder: #1641

Merge order

J0 → J1 + J2 + J3 (parallel) → G → H → (POC-2 gate) → I + J4 + J5

Agent tracking

Agent	Branch	Issue	PR	Host	Device	Blockers
J0	agent/mind/pipeline-orchestration	TBD	—	—	—	BLOCKER
J1	agent/mind/audio-preprocess-crossplatform	TBD	—	—	—	J0 contract
J2	agent/mind/cli-full-pipeline-poc2	TBD	—	—	—	J0 contract
J3	agent/mind/golden-multilingual-eval	TBD	—	—	—	J0 contract
G	agent/mind/chat-over-meetings	TBD	—	—	—	J0 contract
H	agent/mind/superapp-scribe-tab	TBD	—	—	—	J0 contract
I	agent/mind/live-transcript	TBD	—	—	—	POC-2 gate
J4	agent/mind/model-bench-poc4	TBD	—	—	—	POC-2 gate
J5	agent/mind/ios-mind-build	TBD	—	—	—	POC-2 gate

Prompts: airo-wt/wave2-prompts/

[ucguy4u]

Wave 2 issue binding (orchestrator)

Agent	Branch	Issue
J0	agent/mind/pipeline-orchestration	#1785
J1	agent/mind/audio-preprocess-crossplatform	#1786
J2	agent/mind/cli-full-pipeline-poc2	#1787
J3	agent/mind/golden-multilingual-eval	#1788
G	agent/mind/chat-over-meetings	#1789
H	agent/mind/superapp-scribe-tab	#1790
I	agent/mind/live-transcript	#1791
J4	agent/mind/model-bench-poc4	#1792
J5	agent/mind/ios-mind-build	#1793

Worktrees: airo-wt/wave2-prompts/ · Merge order: J0 → J1+J2+J3 → G → H → (POC-2) → I+J4+J5

Wave 1 archive: #1770

[ucguy4u]

J0 FFI contract (Wave 2.1 gate)

Host library: airo_mind_llama (generation + meeting-intelligence orchestration)
Speech library: airo_mind_whisper (unchanged — ASR + saveMeeting)
Dart sequencer: MindService.process() — two cdylibs cannot merge (ggml ODR).

New API (airo_mind_llama::api::meeting_intelligence)

// Wire types (FRB-generated Dart mirrors)
pub struct TranscriptSegmentInput { pub id: String, pub start_ms: u64, pub end_ms: u64, pub text: String }
pub struct MeetingIntelligenceInput {
  pub meeting_id: String,
  pub title: Option<String>,
  pub segments: Vec<TranscriptSegmentInput>,
}
pub enum MeetingIntelligenceEvent {
  Extracting { chunk_index: u32, chunk_total: u32 },
  Generating { text: String },           // MoM stream tokens
  MinutesReady { text: String },
  IrReady { decisions, action_items, metrics },  // flattened for saveMeeting
  Cancelled,
}

// Entry — requires initialize() (same as generate_minutes)
pub fn process_meeting_intelligence(
  input: MeetingIntelligenceInput,
  sink: StreamSink<MeetingIntelligenceEvent>,
) -> Result<(), String>

Internal pipeline (Rust, off main isolate):

1. Segment → airo_mind_transcript::process
2. airo_mind_meeting::extract → validate → generate_mom
3. Map MeetingIr → wire IrReady + stream MoM tokens

Dart integration (MindService.process)

Stage	Source
transcribing	whisper transcribeRecording
extracting	new — between transcribe and generating
generating	MoM from IR (not generateMinutes(transcript))
saving	whisper saveMeeting with IR fields
done	+ appendMeetingIrExtractedOp

Cancel

cancel_generation() cancels in-flight extraction/MoM; cancel_transcription() unchanged. MindService.cancelProcessing() calls both.

Errors

Result<(), String> at FFI boundary; Dart yields MindStage.failed with message.

Wave 2.1 agents may spawn — J1/J2/J3/G/H worktrees ready under airo-wt/.

[ucguy4u]

J0 FFI contract (Wave 2.1 gate)

Host library: airo_mind_llama (generation + meeting-intelligence orchestration)
Speech library: airo_mind_whisper (unchanged — ASR + saveMeeting)
Dart sequencer: MindService.process() — two cdylibs cannot merge (ggml ODR).

New API (airo_mind_llama::api::meeting_intelligence)

// Wire types (FRB-generated Dart mirrors)
pub struct TranscriptSegmentInput { pub id: String, pub start_ms: u64, pub end_ms: u64, pub text: String }
pub struct MeetingIntelligenceInput {
  pub meeting_id: String,
  pub title: Option<String>,
  pub segments: Vec<TranscriptSegmentInput>,
}
pub enum MeetingIntelligenceEvent {
  Extracting { chunk_index: u32, chunk_total: u32 },
  Generating { text: String },           // MoM stream tokens
  MinutesReady { text: String },
  IrReady { decisions, action_items, metrics },  // flattened for saveMeeting
  Cancelled,
}

// Entry — requires initialize() (same as generate_minutes)
pub fn process_meeting_intelligence(
  input: MeetingIntelligenceInput,
  sink: StreamSink<MeetingIntelligenceEvent>,
) -> Result<(), String>

Internal pipeline (Rust, off main isolate):

1. Segment → airo_mind_transcript::process
2. airo_mind_meeting::extract → validate → generate_mom
3. Map MeetingIr → wire IrReady + stream MoM tokens

Dart integration (MindService.process)

Stage	Source
transcribing	whisper transcribeRecording
extracting	new — between transcribe and generating
generating	MoM from IR (not generateMinutes(transcript))
saving	whisper saveMeeting with IR fields
done	+ appendMeetingIrExtractedOp

Cancel

cancel_generation() cancels in-flight extraction/MoM; cancel_transcription() unchanged. MindService.cancelProcessing() calls both.

Errors

Result<(), String> at FFI boundary; Dart yields MindStage.failed with message.

Wave 2.1 agents may spawn — J1/J2/J3/G/H worktrees ready under airo-wt/.

[ucguy4u]

Wave 2 orchestrator kickoff — complete

Deliverables

#	Item	Status
1	Meta issue #1784 + agent issues #1785–#1793	✅
2	Prompts airo-wt/wave2-prompts/{J0–J5,G,H,I}-*.md	✅
3	J0 FFI contract	✅ comment above
4	J0 worktree + PR	✅ #1794 — 42/42 host tests

Worktrees (airo-wt/)

Agent	Path	Branch
J0	mind-pipeline-orchestration	agent/mind/pipeline-orchestration
J1	mind-audio-preprocess	agent/mind/audio-preprocess-crossplatform
J2	mind-cli-poc2	agent/mind/cli-full-pipeline-poc2
J3	mind-golden-eval	agent/mind/golden-multilingual-eval
G	mind-chat-over-meetings	agent/mind/chat-over-meetings
H	mind-superapp-scribe-tab	agent/mind/superapp-scribe-tab
I	mind-live-transcript	agent/mind/live-transcript
J4	mind-model-bench-poc4	agent/mind/model-bench-poc4
J5	mind-ios-mind-build	agent/mind/ios-mind-build

Agent tracking

Agent	Issue	PR	Host	Device	Blockers
J0	#1785	#1794	42/42	pending	merge + device IR
J1	#1786	—	—	—	merge J0
J2	#1787	—	—	—	merge J0
J3	#1788	—	—	—	merge J0
G	#1789	—	—	—	merge J0
H	#1790	—	—	—	merge J0
I	#1791	—	—	—	POC-2 gate
J4	#1792	—	—	—	POC-2 gate
J5	#1793	—	—	—	POC-2 gate

Next: merge #1794 → parallel J1+J2+J3 → G → H

---

POC-2 gate (Wave 2.2 unlock)

Wave 2.2 agents (I, J4, J5) start only when both pass:

1. J2 CLI green on Mac — cargo run -p airo_mind_cli full audio→IR→MoM→eval; all 9 gates in airo_mind_eval/src/gates.rs pass with real --predicted-* (not self-score smoke)
2. Device IR proof — Pixel journey asserts MeetingRecord has populated decisions/actionItems/metrics after J0 merge

Gate owner: orchestrator updates this comment when POC-2 clears.

[ucguy4u]

J0 merged ✅

#1794 → main @ f5fbe25a

IR pipeline is on product path: process_meeting_intelligence → saveMeeting with decisions/actionItems/metrics.

Wave 2.1 — unblocked (parallel)

Agent	Issue	Worktree	Prompt
J1	#1786	mind-audio-preprocess	wave2-prompts/J1-audio-preprocess.md
J2	#1787	mind-cli-poc2	wave2-prompts/J2-cli-poc2.md
J3	#1788	mind-golden-eval	wave2-prompts/J3-golden-multilingual-eval.md
G	#1789	mind-chat-over-meetings	wave2-prompts/G-chat-over-meetings.md
H	#1790	mind-superapp-scribe-tab	wave2-prompts/H-superapp-scribe-tab.md

Rebase worktrees: git fetch origin main && git rebase origin/main in each.

Merge order: J1+J2+J3 (any order) → G → H

Device: run gated journey on Pixel to confirm IR fields populate post-merge.