fix(jumpscore): align message format and video lookup#1330

Merged

kcz358 merged 16 commits into

EvolvingLMMs-Lab:mainfrom

mathCrazyy:main

May 15, 2026

Commits on May 11, 2026

feat: add jump rope evaluation task
mathCrazyy
committed
fix(mmmu): lazy-load judge server to avoid OpenAI API key error on module import
mathCrazyy
committed
Revert "fix(mmmu): lazy-load judge server to avoid OpenAI API key error on module import"
mathCrazyy
committed
fix(jump_rope): lazy-load HF dataset snapshot to avoid import-time download
mathCrazyy
committed
fix(mmmu): lazy-load judge server to avoid OpenAI API key error on module import
mathCrazyy
committed
ci(task-input-ab): gracefully skip comparison when BASE snapshot fails
mathCrazyy
committed
refactor(jump_rope): rename task directory from jump_rope to jumpscore
mathCrazyy
committed
Revert "fix(mmmu): lazy-load judge server to avoid OpenAI API key error on module import"
mathCrazyy
committed
Revert "ci(task-input-ab): gracefully skip comparison when BASE snapshot fails"
mathCrazyy
committed
fix(jumpscore): configure video cache in yaml
mathCrazyy
committed
fix(jumpscore): expose map metric
mathCrazyy
committed

Commits on May 12, 2026

Commits on May 14, 2026

fix(jumpscore): remove snapshot cache fallback
mathCrazyy
committed

Commits on May 15, 2026