Skip to content

Commit 79f32d3

Browse files
ringsaturnclaude
andcommitted
ci: keep the satellite frame cache for the window plus one hour
A round pulls HOURS + 1 hours of frames, so eight hours covers the six-hour window with an hour of slack (twenty-six for the daily Meteosat window); the scans stay archived at the agencies. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
1 parent 44cd5a1 commit 79f32d3

6 files changed

Lines changed: 10 additions & 10 deletions

File tree

.github/workflows/publish-goeseast.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -108,8 +108,8 @@ jobs:
108108
# A warped frame is 3-6 MB, seven variables share a slot and a day is
109109
# 144 slots, so a day of the cache is some 4.5 GB. The viewer plays a
110110
# six-hour window and the agency archives the scans, so the mirror
111-
# keeps that window and a little slack: a round pulls HOURS + 1 hours.
112-
FRAMES_KEEP_HOURS: "12"
111+
# keeps that window and an hour of slack: a round pulls HOURS + 1 hours.
112+
FRAMES_KEEP_HOURS: "8"
113113
ONCE: ${{ !inputs.loop }}
114114
ROUND_MINUTES: ${{ inputs.round_minutes || '5' }}
115115
# For a looping dispatch: run past the hour, and hand over to the next

.github/workflows/publish-goeswest.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -108,8 +108,8 @@ jobs:
108108
# A warped frame is 3-6 MB, seven variables share a slot and a day is
109109
# 144 slots, so a day of the cache is some 4.5 GB. The viewer plays a
110110
# six-hour window and the agency archives the scans, so the mirror
111-
# keeps that window and a little slack: a round pulls HOURS + 1 hours.
112-
FRAMES_KEEP_HOURS: "12"
111+
# keeps that window and an hour of slack: a round pulls HOURS + 1 hours.
112+
FRAMES_KEEP_HOURS: "8"
113113
ONCE: ${{ !inputs.loop }}
114114
ROUND_MINUTES: ${{ inputs.round_minutes || '5' }}
115115
# For a looping dispatch: run past the hour, and hand over to the next

.github/workflows/publish-himawari.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -108,8 +108,8 @@ jobs:
108108
# A warped frame is 3-6 MB, seven variables share a slot and a day is
109109
# 144 slots, so a day of the cache is some 4.5 GB. The viewer plays a
110110
# six-hour window and the agency archives the scans, so the mirror
111-
# keeps that window and a little slack: a round pulls HOURS + 1 hours.
112-
FRAMES_KEEP_HOURS: "12"
111+
# keeps that window and an hour of slack: a round pulls HOURS + 1 hours.
112+
FRAMES_KEEP_HOURS: "8"
113113
ONCE: ${{ !inputs.loop }}
114114
ROUND_MINUTES: ${{ inputs.round_minutes || '5' }}
115115
# For a looping dispatch: run past the hour, and hand over to the next

.github/workflows/publish-meteosat.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -111,8 +111,8 @@ jobs:
111111
FRAME_CACHE: "true"
112112
# A warped frame is 3-6 MB and a day is 24 slots of six variables. The
113113
# viewer plays a day and the store archives the scans, so the mirror
114-
# keeps that window and a little slack: a round pulls HOURS + 1 hours.
115-
FRAMES_KEEP_HOURS: "30"
114+
# keeps that window and an hour of slack: a round pulls HOURS + 1 hours.
115+
FRAMES_KEEP_HOURS: "26"
116116
ONCE: ${{ !inputs.loop }}
117117
ROUND_MINUTES: ${{ inputs.round_minutes || '5' }}
118118
# For a looping dispatch: run past the hour, and hand over to the next

CLAUDE.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -380,7 +380,7 @@ model starts here; the frontend mirror is `FORECAST_MODELS` in
380380
outside the grid is refused, since a blank warp is also a lost
381381
projection), `assemble.py` caches the
382382
frame (`data/raw/himawari-frames/<variable>/*.tif`, mirrored like the JMA
383-
frames but kept twelve hours, `FRAMES_KEEP_HOURS`, since the agencies
383+
frames but kept eight hours, `FRAMES_KEEP_HOURS`, since the agencies
384384
archive the scans and a day of seven variables is ~4.5 GB) and writes the window series with `gdal_translate -of netCDF`
385385
through a VRT carrying `NETCDF_DIM_*` metadata, `fetch.py` runs a window
386386
(`fetch.py::_fetch_satellite_run` in the top-level module dispatches on

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -589,7 +589,7 @@ secret and read in process with the `R2_*` credentials
589589
dataset bucket's token cannot read it, else that token), with the `cma`
590590
dependency group synced. The Himawari job is the JMA shape with a
591591
frame cache of warped GeoTIFFs (`data/raw/himawari-frames/<variable>/`,
592-
one directory per channel and per Dust RGB gun, kept twelve hours on the
592+
one directory per channel and per Dust RGB gun, kept eight hours on the
593593
bucket — the window plus slack, since NOAA archives the scans and a day of
594594
the cache is some 4.5 GB; `FRAMES_KEEP_HOURS`), a six-hour window
595595
(`HOURS=6`), the `satellite` dependency group

0 commit comments

Comments
 (0)