You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: experiments/briefs/01-neural-doc-intelligence.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,7 +10,7 @@ Wire the existing trained neural model into a workflow alongside the relevant po
10
10
## What's already done (per the user)
11
11
12
12
- Neural training capability shipped in PR #134 (`BuildMode = neural`, training-hours, `/training/info` endpoint, UI mode selector).
13
-
- A neural model is **already trained** — model id is `"test"`.
13
+
- A neural model is **already trained** — model id is `"test-model"`.
14
14
- The user's 33-sample dataset is seeded and synced to blob storage at `seed-local-samples-mix-private-v1`.
15
15
16
16
So this experiment is mostly **wiring** — no training, no new providers. The Azure DI activities (`azureOcr.submit/poll/extract`) already exist and are registered. You're composing them with the right post-processing nodes for handwritten input.
@@ -19,7 +19,7 @@ So this experiment is mostly **wiring** — no training, no new providers. The A
19
19
20
20
1.**Define the workflow graph** at `docs-md/graph-workflows/templates/experiment-01-neural-doc-intelligence-workflow.json`. **Start by copying `docs-md/graph-workflows/templates/standard-ocr-workflow-with-corrections.json`**, then:
21
21
- Set `metadata.name` to `"Experiment 01 - Neural DI + Post-Processing"`.
22
-
- Set `ctx.modelId.defaultValue` to `"test"` (the existing trained neural model).
22
+
- Set `ctx.modelId.defaultValue` to `"test-model"` (the existing trained neural model).
23
23
-**Drop the `spellcheck` node and its edges** (replace `e7c: characterConfusion → spellcheck` and `e7d: spellcheck → checkConfidence` with a single edge `characterConfusion → checkConfidence`). Spellcheck isn't valuable for our handwritten field set.
24
24
-**Don't add `ocr.enrich`** (LLM enrichment is out of scope for E01).
25
25
-**Don't add `ocr.documentValidateFields`** / cross-field validation (out of scope for E01).
@@ -42,7 +42,7 @@ So this experiment is mostly **wiring** — no training, no new providers. The A
42
42
43
43
4.**Write mock-based tests** once stable. Record the trained-neural-model OCR response from step 2, replay in tests under `apps/temporal/src/ocr-providers/` (or a sensible neighbor location) verifying the workflow + post-processors run correctly.
44
44
45
-
5.**Write `experiments/results/01-neural-doc-intelligence/SUMMARY.md`** with: trained model id (`test`), nodes wired, observations from step 2, benchmark run id from step 3, any gaps found in `cleanup`/`normalizeFields`/`characterConfusion` against neural output.
45
+
5.**Write `experiments/results/01-neural-doc-intelligence/SUMMARY.md`** with: trained model id (`test-model`), nodes wired, observations from step 2, benchmark run id from step 3, any gaps found in `cleanup`/`normalizeFields`/`characterConfusion` against neural output.
0 commit comments