Skip to content

Missing all OLMo-3-1025-7B Stage 1 (pretraining) Olmo-core checkpoints #729

Description

@muchanem

All 1415 stage 1 rows in src/scripts/official/OLMo3/OLMo-3-1025-7B.csv
(https://github.com/allenai/OLMo-core/blob/main/src/scripts/official/OLMo3/OLMo-3-1025-7B.csv) 404 while while every stage-2 (48) and stage-3 (12) checkpoint resolves fine. Tested with the script below

#!/usr/bin/env bash
# Shows that the stage1 (pretraining) Olmo-core checkpoints listed in
# OLMo-3-1025-7B.csv return 404, while stage2/stage3 return 200.
# Samples a few checkpoint dirs per stage and HEADs config.json in each.
CSV="https://github.com/allenai/OLMo-core/raw/refs/heads/main/src/scripts/official/OLMo3/OLMo-3-1025-7B.csv"
rows=$(curl -fsSL "$CSV")

for stage in stage1 stage2 stage3; do
  echo "== $stage =="
  # pick 6 dirs evenly spaced across this stage (endpoints included)
  echo "$rows" | grep -oE "https://[^,]+/$stage/step[0-9]+/" \
    | awk '{a[NR]=$0} END{n=NR; k=(n<6?n:6); for(i=0;i<k;i++) print a[int(i*(n-1)/(k-1))+1]}' \
    | while read -r url; do
        code=$(curl -s -o /dev/null -w '%{http_code}' -I "${url}config.json")
        echo "  $code  ${url}config.json"
      done
done

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions