|
1 | | -WorldMark benchmark inputs: first-/third-person starting images + action sequences. |
2 | | - first_view/ real|style : 25 first-person starting images (000..024.jpg) + *_action.txt + *_intrinsics |
3 | | - third_view/ real|style : 25 third-person starting images + *_action.txt + *_intrinsics + prompt_*.txt |
4 | | - action_protocol.txt : action_id -> key sequence |
5 | | -The per-image action assignment (*_action.txt) is identical for first and third view. |
6 | | -Each (image, action) pair is one generated video, named {image}_{action:03d}.mp4. |
| 1 | +WorldMark benchmark inputs — read-only, never edit. |
| 2 | + |
| 3 | +Layout |
| 4 | + action_protocol.txt action_id (1..15) -> key sequence |
| 5 | + {view}/ view = first_view | third_view |
| 6 | + {domain}/NNN.jpg domain = real | style; 25 images, 000..024 |
| 7 | + {domain}_intrinsics/NNN_intrinsics.npy |
| 8 | + {domain}_action.txt row i = image i's 5 assigned action_ids |
| 9 | + prompt_{domain}.txt row i = image i's caption (25 rows) |
| 10 | + |
| 11 | +All four {view}/prompt_{domain}.txt exist. Captions differ by view: every first_view caption |
| 12 | +starts with "First-person view." and every third_view caption with "Third-person view." — the |
| 13 | +prompt already carries the view signal, so never reuse a caption across views or domains. |
| 14 | + |
| 15 | +Facts |
| 16 | + *_action.txt is identical between first_view and third_view for a given domain. |
| 17 | + Intrinsics are (4,) float32 [fx, fy, cx, cy], per-image and all distinct, in ORIGINAL-image |
| 18 | + pixel units (cx ~ (W-1)/2, cy ~ (H-1)/2) — transform them for your model's resolution, |
| 19 | + do not pass them through. |
| 20 | + Image sizes are not uniform: real spans 1024x768 .. 1920x1200 (AR 1.33-1.79); |
| 21 | + style is uniformly 1024x1024 (AR 1.00). |
| 22 | + Horizontal FOV spans 22-90 degrees (median ~66 for real, ~45 for style). |
| 23 | + |
| 24 | +Scope |
| 25 | + Each (image, action) pair is one generated video, named {image:03d}_{action:03d}.mp4. |
| 26 | + One (view, domain) pair = 25 images x 5 actions = 125 videos; all four = 500. |
| 27 | + |
| 28 | +See ../generation/README.md to produce videos, and |
| 29 | +../.claude/skills/world-model-adapter/references/output_spec.md for the full I/O contract. |
0 commit comments