Initial Status Communications - #84

Merged

mxkpp merged 38 commits into

developmentfrom

maxkipp-status-comms

Jun 3, 2026

Commits on May 30, 2026

Default realization: use fcst mgr for ngen execution instead of ad-hoc subprocess call
mxkpp
committed
cc7990c
Add NgenStatus for extracting status payloads from per-rank log files
mxkpp
committed
a2c4a04
Update docs file refs in pyproject.toml
mxkpp
committed
d0db9e7
Build config: enable (re)install of nwm-ewts
mxkpp
committed
2fc28c5
Move log payload classes to ewts. Scan per-rank logs for payloads and report them for run_default.py, run_forecast.py, and run_calibration.py.
mxkpp
committed
d1baf83
Add status comms PoC via async ngen execution, live status polling, live log parsing
mxkpp
committed
5cf040f
Status comms: update against nwm-ewts changing LogParts from Pydantic BaseModel to dataclass. Async ngen: add optional postprocess call, expose destructor (close).
mxkpp
committed
00e3f38
Check status before postprocess
mxkpp
committed
195c0d7
Dev Container: mount mswm param files to enable full nwm-rte workflows for default, forecast, and calibration in VS Code debugger
mxkpp
committed
5f1be18
VS Code debugger: add debugger configurations for full nwm-rte workflows for default and calibration
mxkpp
committed
07dd4b9
Assert that at least one MPI rank log line was parsed
mxkpp
committed
219ad95
Status comms: Idiomize discovery of ngen MPI rank log file paths and support the env var NGEN_LOG_TO_RTE=YES
mxkpp
committed
3b47b11
Improve log configuration and adjust names of dirs for mode NGEN_LOG_TO_RTE=YES
mxkpp
committed
c0524b8
Assert at least 1 log entry was parsed for each MPI rank
mxkpp
committed
d1f601c
Status comms: add support for non-ngen modules (add nwm-fcst-mgr)
mxkpp
committed
2b6a31c
Remove unused arg, format
mxkpp
committed
5f04d71
Set up logger in ForecastExecutionManager's __init__ instead of preprocess
mxkpp
committed
1904036
Log parsing: use tolerance for unstructured lines that may still contain a Payload
mxkpp
committed
5cfb230
Log parsing: add MSWM
mxkpp
committed
a4d5506
Transmit status of MSWM RealizationBuilder init and build methods
mxkpp
committed
ddf39c5
Remove commented out code
mxkpp
committed
43d693f
Async runner: remove dependency on RTE cfg instance, idiomize exception handling, add optional timeout
mxkpp
committed
67908a2
run_tests.py: DRYify to use new shared classes for async ngen execution and log parsing, remove support for arg quit_forecast_after_forcing_running.
mxkpp
committed
9fa98e3
Consolidate paths for logs (docker build, docker run, ngen, and rte). Add ewts to nwm-rte and use log calls instead of print.
mxkpp
committed
2f08ba1
execution_tests: Fix crashing calibration mode, add header prefix to tests report json
mxkpp
committed
142fb66
exceution_tests: log counts of severe, critical, and fatal lines
mxkpp
committed
bf14727
Update CLI args help
mxkpp
committed
0cd5869
Adjust TODOs
mxkpp
committed
7a249a2
pydantic usage: apply extra="forbid" and strict=True throughout
mxkpp
committed
7bcfb98
Idiomize transmissions
mxkpp
committed
6d551f9
Remove TODOs
mxkpp
committed
5008a65
Move log call
mxkpp
committed
e3f402c
Remove unneeded mswm mount
mxkpp
committed
187ba35
Update poststart.sh to handle new approach of how forcing config files are installed
mxkpp
committed
d48e923

Commits on Jun 1, 2026

Fix error message. Idiomize setup checks. Resolve a Pydantic UserWarning about a test msg
mxkpp
committed
64bf45c
Fix pytest
mxkpp
committed
b4804c8

Commits on Jun 2, 2026

empty-trigger-gha
mxkpp
committed
260705e

Commits on Jun 3, 2026

Add dir for docker build logs
mxkpp
committed
db36ece