Commit 1ad8e48
vlm: lock DocTags→Markdown parity for picture_classification (#153)
picture_classification scored 1.3% similarity in the live VLM corpus run.
Root-causing it deterministically: our DocTags parser reproduces docling's
groundtruth Markdown for that fixture byte-for-byte (pictures with captions
before the image placeholder, multi-page <page_break>, reading order), so
the divergence is live-model / render variance — which the harness itself
flags as expected ("triage as render, not parser") — not a defect on our
side. Add an end-to-end regression test through convert_vlm that feeds the
model's exact DocTags for the document and asserts the Markdown matches the
groundtruth, so our side of the comparison stays provably correct. Image
leg, so it needs no pdfium and runs in CI everywhere.
Refs #153
Signed-off-by: artiz <artem.kustikov@gmail.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01EY5KAiquN4YpVf2PXEQkVT1 parent 5522d02 commit 1ad8e48
1 file changed
Lines changed: 32 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
169 | 169 | | |
170 | 170 | | |
171 | 171 | | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
172 | 204 | | |
173 | 205 | | |
174 | 206 | | |
| |||
0 commit comments