You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
fix(briefs): E01 neural model id is sdpr_synth_test (already the default)
The existing standard-ocr-workflow-with-corrections.json template already
sets ctx.modelId.defaultValue to sdpr_synth_test, so the experiment AI just
copies the template and leaves modelId untouched.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Copy file name to clipboardExpand all lines: experiments/briefs/01-neural-doc-intelligence.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,7 +10,7 @@ Wire the existing trained neural model into a workflow alongside the relevant po
10
10
## What's already done (per the user)
11
11
12
12
- Neural training capability shipped in PR #134 (`BuildMode = neural`, training-hours, `/training/info` endpoint, UI mode selector).
13
-
- A neural model is **already trained** — model id is `"test-model"`.
13
+
- A neural model is **already trained** — model id is `"sdpr_synth_test"`.
14
14
- The user's 33-sample dataset is seeded and synced to blob storage at `seed-local-samples-mix-private-v1`.
15
15
16
16
So this experiment is mostly **wiring** — no training, no new providers. The Azure DI activities (`azureOcr.submit/poll/extract`) already exist and are registered. You're composing them with the right post-processing nodes for handwritten input.
@@ -19,7 +19,7 @@ So this experiment is mostly **wiring** — no training, no new providers. The A
19
19
20
20
1.**Define the workflow graph** at `docs-md/graph-workflows/templates/experiment-01-neural-doc-intelligence-workflow.json`. **Start by copying `docs-md/graph-workflows/templates/standard-ocr-workflow-with-corrections.json`**, then:
21
21
- Set `metadata.name` to `"Experiment 01 - Neural DI + Post-Processing"`.
22
-
-Set `ctx.modelId.defaultValue`to `"test-model"` (the existing trained neural model).
22
+
-`ctx.modelId.defaultValue`should be `"sdpr_synth_test"` (the existing trained neural model). The base template already has this — leave it as-is.
23
23
-**Drop the `spellcheck` node and its edges** (replace `e7c: characterConfusion → spellcheck` and `e7d: spellcheck → checkConfidence` with a single edge `characterConfusion → checkConfidence`). Spellcheck isn't valuable for our handwritten field set.
24
24
-**Don't add `ocr.enrich`** (LLM enrichment is out of scope for E01).
25
25
-**Don't add `ocr.documentValidateFields`** / cross-field validation (out of scope for E01).
@@ -42,7 +42,7 @@ So this experiment is mostly **wiring** — no training, no new providers. The A
42
42
43
43
4.**Write mock-based tests** once stable. Record the trained-neural-model OCR response from step 2, replay in tests under `apps/temporal/src/ocr-providers/` (or a sensible neighbor location) verifying the workflow + post-processors run correctly.
44
44
45
-
5.**Write `experiments/results/01-neural-doc-intelligence/SUMMARY.md`** with: trained model id (`test-model`), nodes wired, observations from step 2, benchmark run id from step 3, any gaps found in `cleanup`/`normalizeFields`/`characterConfusion` against neural output.
45
+
5.**Write `experiments/results/01-neural-doc-intelligence/SUMMARY.md`** with: trained model id (`sdpr_synth_test`), nodes wired, observations from step 2, benchmark run id from step 3, any gaps found in `cleanup`/`normalizeFields`/`characterConfusion` against neural output.
0 commit comments