Skip to content

Add multiprocessing to medium-range lagged ensemble - #18

Closed
mxkpp wants to merge 3 commits into
developmentfrom
maxkipp-laggedens-n2
Closed

Add multiprocessing to medium-range lagged ensemble#18
mxkpp wants to merge 3 commits into
developmentfrom
maxkipp-laggedens-n2

Conversation

@mxkpp

@mxkpp mxkpp commented Apr 13, 2026

Copy link
Copy Markdown

This enables multiprocessing for medium-range lagged ensemble forecasts, leveraging outputs of partitionGenerator and using the number of processes specified in that intermediary output.

This should be reviewed in conjunction with related PRs on other repositories:

https://github.com/NGWPC/nwm-rte/pull/52

NGWPC/nwm-msw-mgr#54

NGWPC/ngen-forcing#138


# Set list of medium range lagged ensemble runs and hours of forcing lag
ens_members = {
'no_da': 0,

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is the purpose of making this configurable as a global variable, rather than just using 'no_da'?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In the pending usage of nwm-rte, the var is imported by nwm-rte to build the first realization before passing things off to nwm-fcst-mgr for the rest of the lagged ensemble sequence. However since it would be better to avoid building the first realization twice (from nwm-rte and then from nwm-fcst-mgr), this could be reverted when that change is made before merging.

@mxkpp

mxkpp commented Apr 16, 2026

Copy link
Copy Markdown
Author

Closing but not deleting the branch yet. Will reopen a new PR from this branch after making changes there: https://github.com/NGWPC/nwm-fcst-mgr/tree/maxkipp-laggedens-n2-2

Which was based on branch jwade_NGWPC-10211_wcoss

@mxkpp mxkpp closed this Apr 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants