Skip to content

Commit 926da46

Browse files
ryan-williamsclaude
andcommitted
daily.yml: pre-pull per-year AASHTO crashes.parquet deps
Runs 28915961775 + 28916371434 (both 2026-07-08) failed at the "Re-match NJSP↔NJDOT" step: DVX saw `njdot/data/{2023,2024,2025}/ crashes.parquet` missing on disk, decided to re-run their commit stages, and fell through to `njdot/aashto/normalize.py: not found` (a latent shebang / `uv`-on-PATH issue in the re-run path). Cache is now populated on S3 (pushed manually), but DVX doesn't attempt to fetch when the output file is absent from the workspace — it just runs the cmd. Same fix pattern as `persons.parquet` / `vehicles.parquet` above: pull the per-year outputs before `dvx run` so `is_output_fresh` returns true and the re-execute path isn't taken. Root-cause fix for the shebang path can come separately. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
1 parent 84cac75 commit 926da46

1 file changed

Lines changed: 10 additions & 0 deletions

File tree

.github/workflows/daily.yml

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -79,6 +79,16 @@ jobs:
7979
dvx pull njdot/data/2023/vehicles.parquet.dvc
8080
dvx pull njdot/data/2024/vehicles.parquet.dvc
8181
dvx pull njdot/data/2025/vehicles.parquet.dvc
82+
# Per-year AASHTO `crashes.parquet` — same rationale as persons /
83+
# vehicles above. Consumed transitively by
84+
# `aashto_combined_crashes.parquet` (which is pulled below). Without
85+
# these on disk, DVX sees the intermediate stage's output-fresh
86+
# check pass but the *upstream* per-year stage's output missing,
87+
# tries to re-run `normalize.py`, and hits the shebang-not-found
88+
# path (see #127-adjacent notes).
89+
dvx pull njdot/data/2023/crashes.parquet.dvc
90+
dvx pull njdot/data/2024/crashes.parquet.dvc
91+
dvx pull njdot/data/2025/crashes.parquet.dvc
8292
dvx pull njsp/data/crash-log.parquet.dvc
8393
# NJSP outputs of `njsp update_pqts` (consumed by harmonize, csvs,
8494
# projections, match, three-way-match, d1-import).

0 commit comments

Comments
 (0)