Fix submit_eval_jobs.py for olmo-eval-internal runs#1644

Open

finbarrtimbers wants to merge 8 commits intomainfrom

finbarr/fix-eval-script

Commits on Apr 29, 2026

Default to ai2/oe-data/olmo-eval-latest image; resolve --olmo_eval_ref to SHA at submit time; collapse install script's pip calls. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
finbarrtimbers
committed
Tighten build_install_block contract to require resolved SHA; trim install script header comments. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
finbarrtimbers
committed
Drop dead check in install_olmo_eval.sh; set -u handles unset and caller always provides a ref. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
finbarrtimbers
committed

Commits on May 1, 2026

Split vllm install into a separate venv that symlinks image torch/nvidia; tag spec description with git branch+commit. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
finbarrtimbers
committed