Skip to content

Commit 107bbbf

Browse files
strukalexclaude
authored andcommitted
fix(briefs): E01 neural model id is sdpr_synth_test (already the default)
The existing standard-ocr-workflow-with-corrections.json template already sets ctx.modelId.defaultValue to sdpr_synth_test, so the experiment AI just copies the template and leaves modelId untouched. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
1 parent c1350b9 commit 107bbbf

1 file changed

Lines changed: 3 additions & 3 deletions

File tree

experiments/briefs/01-neural-doc-intelligence.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ Wire the existing trained neural model into a workflow alongside the relevant po
1010
## What's already done (per the user)
1111

1212
- Neural training capability shipped in PR #134 (`BuildMode = neural`, training-hours, `/training/info` endpoint, UI mode selector).
13-
- A neural model is **already trained** — model id is `"test-model"`.
13+
- A neural model is **already trained** — model id is `"sdpr_synth_test"`.
1414
- The user's 33-sample dataset is seeded and synced to blob storage at `seed-local-samples-mix-private-v1`.
1515

1616
So this experiment is mostly **wiring** — no training, no new providers. The Azure DI activities (`azureOcr.submit/poll/extract`) already exist and are registered. You're composing them with the right post-processing nodes for handwritten input.
@@ -19,7 +19,7 @@ So this experiment is mostly **wiring** — no training, no new providers. The A
1919

2020
1. **Define the workflow graph** at `docs-md/graph-workflows/templates/experiment-01-neural-doc-intelligence-workflow.json`. **Start by copying `docs-md/graph-workflows/templates/standard-ocr-workflow-with-corrections.json`**, then:
2121
- Set `metadata.name` to `"Experiment 01 - Neural DI + Post-Processing"`.
22-
- Set `ctx.modelId.defaultValue` to `"test-model"` (the existing trained neural model).
22+
- `ctx.modelId.defaultValue` should be `"sdpr_synth_test"` (the existing trained neural model). The base template already has this — leave it as-is.
2323
- **Drop the `spellcheck` node and its edges** (replace `e7c: characterConfusion → spellcheck` and `e7d: spellcheck → checkConfidence` with a single edge `characterConfusion → checkConfidence`). Spellcheck isn't valuable for our handwritten field set.
2424
- **Don't add `ocr.enrich`** (LLM enrichment is out of scope for E01).
2525
- **Don't add `ocr.documentValidateFields`** / cross-field validation (out of scope for E01).
@@ -42,7 +42,7 @@ So this experiment is mostly **wiring** — no training, no new providers. The A
4242

4343
4. **Write mock-based tests** once stable. Record the trained-neural-model OCR response from step 2, replay in tests under `apps/temporal/src/ocr-providers/` (or a sensible neighbor location) verifying the workflow + post-processors run correctly.
4444

45-
5. **Write `experiments/results/01-neural-doc-intelligence/SUMMARY.md`** with: trained model id (`test-model`), nodes wired, observations from step 2, benchmark run id from step 3, any gaps found in `cleanup`/`normalizeFields`/`characterConfusion` against neural output.
45+
5. **Write `experiments/results/01-neural-doc-intelligence/SUMMARY.md`** with: trained model id (`sdpr_synth_test`), nodes wired, observations from step 2, benchmark run id from step 3, any gaps found in `cleanup`/`normalizeFields`/`characterConfusion` against neural output.
4646

4747
## TODOs captured here
4848

0 commit comments

Comments
 (0)