feat: flat-layout CVAT campaign tools and resilient shard writing by cau-git · Pull Request #206 · docling-project/docling-eval

cau-git · 2026-03-30T18:02:04Z

Summary

Flat-layout CVAT campaign tools

Three new scripts for flat delivery directories (complement to the existing submission-style tools):

Script	Purpose
`convert_flat_cvat_deliveries_to_docling.py`	Batch-converts flat CVAT XML deliveries → DoclingDocument JSON + HTML; supports parallelism, dry-run, and structured run reports
`flat_cvat_deliveries_to_hf.py`	Aggregates flat-batch exports into a HuggingFace-ready parquet dataset
`cvat_task_batch_uploader_flat.py`	Uploads `<task>/images/ + <task>/annotations.xml` layouts as tasks to a CVAT project

`save_shard_to_disk` rework

Returns SaveShardResult (written/skipped counts, next shard id) instead of None
Automatically splits batches into multiple shards when estimated size exceeds 1.5 GB
Per-shard ArrowCapacityError recovery with skipped_records.jsonl audit log

Extensions

cvat_create_annotation_tasks_from_folders.py: added --start-index, --end-index, --chunk-number-offset for resumable chunked runs

Tests

tests/utils/test_save_shard_to_disk.py
tests/campaign_tools/test_cvat_create_annotation_tasks_from_folders.py

I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: a592458 I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: ac622cc I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: 3648bd9 Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: a592458 I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: ac622cc I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: 3648bd9 I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: c05b85e Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: a592458 I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: ac622cc I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: 3648bd9 I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: c05b85e I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: 36044e5 Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

…mory-leaks

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: a592458 I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: ac622cc I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: 3648bd9 I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: c05b85e I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: 36044e5 I, samiuc <sami.ullah.chat@gmail.com>, hereby add my Signed-off-by to this commit: b83a1f0 Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

…mory-leaks

… into sami/fix-memory-leaks

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

…oject/docling-eval into sami/fix-memory-leaks

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

Merge created_groups and ListHierarchyManager.group_containers into a single shared all_groups registry. This eliminates a class of duplicate DocItem refs that arose when list and non-list code paths each created separate groups for the same path_id. Also adds _validate_unique_crefs() as a post-conversion assertion that fires before coordinate scaling. Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

… into cau/upgrade-deps Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

github-actions · 2026-03-30T18:02:15Z

✅ DCO Check Passed

Thanks @cau-git, all your commits are properly signed off. 🎉

mergify · 2026-03-30T18:02:40Z

Merge Protections

Your pull request matches the following merge protections and will not be merged until they are valid.

🔴 Require two reviewer for test updates

This rule is failing.

When test data is updated, we require two reviewers

#approved-reviews-by >= 2

🟢 Enforce conventional commit

Wonderful, this rule succeeded.

Make sure that we follow https://www.conventionalcommits.org/en/v1.0.0/

title ~= ^(fix|feat|docs|style|refactor|perf|test|build|ci|chore|revert)(?:\(.+\))?(!)?:

Adds three scripts for workflows using flat delivery directories (as opposed to the submission-style layout the existing tools expect): - convert_flat_cvat_deliveries_to_docling.py: batch-converts flat CVAT XML deliveries into DoclingDocument JSON + HTML visualizations, with worker parallelism, dry-run, and a structured run report. - flat_cvat_deliveries_to_hf.py: aggregates flat-batch DoclingDocument exports into a HuggingFace-ready parquet dataset. - cvat_task_batch_uploader_flat.py: uploads flat folder layouts (folder/images + folder/annotations.xml) as tasks to a CVAT project. Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

…-deps

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

maxmnemonic

LGTM

samiuc and others added 30 commits December 17, 2025 16:17

fix: Close PIL Image objects to prevent memory leaks.

a592458

prevent PIL Image memory leaks

ac622cc

serialize images to bytes and add EasyOCR test script

3648bd9

style: fix isort import ordering

c05b85e

feat: support omnidocbench parquet format

36044e5

fix: format files

7eb9e85

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

fix: tags check

507d55e

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

fix: update pixel evaluator with NumPy 1.x compatible bit counting.

2d8e18e

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

Merge branch 'main' of github.com:DS4SD/docling-eval into sami/fix-me…

3676c73

…mory-leaks

fix: prevent memory leaks

cf63f3b

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

Merge branch 'main' into sami/fix-memory-leaks

42fe55f

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

reformat and fix type errors

fa86cef

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

fix: build error and import tableformer provider optionally

c79c70f

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

remove comment

af28d4e

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

fix: reset streams and adding image refs

b83a1f0

fix TableStructureModel import path

0d22227

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

Merge branch 'main' of github.com:DS4SD/docling-eval into sami/fix-me…

0a3ac0c

…mory-leaks

Merge branch 'sami/fix-memory-leaks' of github.com:DS4SD/docling-eval…

e2acef0

… into sami/fix-memory-leaks

Update dependencies and uv.lock

c9070c8

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

address review comments

66c62af

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

Merge branch 'sami/fix-memory-leaks' of https://github.com/docling-pr…

1eb3e10

…oject/docling-eval into sami/fix-memory-leaks

dependency upgrades

097ac06

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

Merge branch 'main' into sami/fix-memory-leaks

f2bbf6e

Signed-off-by: samiuc <sami.ullah.chat@gmail.com>

Merge branch 'sami/fix-memory-leaks' of github.com:DS4SD/docling-eval…

c748695

… into cau/upgrade-deps Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

cau-git added 2 commits March 31, 2026 11:29

Merge branch 'main' of github.com:DS4SD/docling-eval into cau/upgrade…

03b0ae2

…-deps

cau-git changed the title ~~chore: Dependency upgrades, lots of fixes~~ feat: flat-layout CVAT campaign tools and resilient shard writing Mar 31, 2026

cau-git added 2 commits March 31, 2026 13:12

upgrade lock and deps

539b523

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

fix import sorting

4809b10

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

cau-git requested a review from maxmnemonic March 31, 2026 11:20

maxmnemonic approved these changes Mar 31, 2026

View reviewed changes

cau-git merged commit 5c9f3fa into main Mar 31, 2026
9 of 10 checks passed

cau-git deleted the cau/upgrade-deps branch March 31, 2026 11:27

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat: flat-layout CVAT campaign tools and resilient shard writing - #206

feat: flat-layout CVAT campaign tools and resilient shard writing#206
cau-git merged 34 commits into
mainfrom
cau/upgrade-deps

cau-git commented Mar 30, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Mar 30, 2026 •

edited

Loading

Uh oh!

mergify Bot commented Mar 30, 2026 •

edited

Loading

Uh oh!

maxmnemonic left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

cau-git commented Mar 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Flat-layout CVAT campaign tools

save_shard_to_disk rework

Extensions

Tests

Uh oh!

github-actions Bot commented Mar 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mergify Bot commented Mar 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merge Protections

🔴 Require two reviewer for test updates

🟢 Enforce conventional commit

Uh oh!

maxmnemonic left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

cau-git commented Mar 30, 2026 •

edited

Loading

`save_shard_to_disk` rework

github-actions Bot commented Mar 30, 2026 •

edited

Loading

mergify Bot commented Mar 30, 2026 •

edited

Loading