Releases: ufs-community/land-DA_workflow
ufs-land-da-v3.0.0
The Earth Prediction Innovation Center (EPIC) and the Unified Forecast System (UFS) community are pleased to announce the public release of the Land Data Assimilation (DA) System v3.0.0. This release builds on the v2.0.0 system (October 2024) by expanding coupling options, improving automation, and strengthening platform support. The Land DA v3.0.0 release includes:
-
Workflow enhancements:
-
Coupling & Model Configurations
- Added ATMosphere-Land (ATML) coupling for the UFS Weather Model, enabling FV3ATM to run interactively with the Noah‑MP land model.
- Added ECMWF Reanalysis 5th-generation data (ERA5) through the Data ATmosphere Model (DATM) forcing component as a new option for LND coupling, allowing DATM to drive the Noah‑MP land surface model.
- Updated the ATML physics suite from FV3_GFS_v17_p8 to FV3_GFS_v17_p8_ugwpv1.
-
Observations & DA Capabilities
- Added Interactive Multi‑sensor Snow and Ice Mapping System (IMS) snow observations as an additional snow DA option.
- Introduced H(x) analysis mode for soil moisture DA using Soil Moisture Active Passive (SMAP) and Soil Moisture Operational Products System (SMOPS) products, enabling forward‑operator evaluation workflows.
-
Joint Effort for Data assimilation Integration (JEDI) Integration & Analysis Configurations
- Integrated the JEDI Configuration Builder (JCB) to automatically generate JEDI input YAML files.
- Added support for user‑provided custom JEDI YAMLs, offering full flexibility for advanced experiments.
- Added JEDI DA algorithm 3D-Var.
-
Usability Improvements
- Enhanced post‑processing and plotting scripts for improved diagnostics.
- Added a Python-based experiment setup tool to generate new cases from a configuration file.
- Developed a script to automate the launch/run sequence for experiments.
- Simplified CTest scripts to streamline testing and reduce maintenance overhead.
- Added input data files for severe snowstorm cases to support Coupled Assimilation Research and Development Environment (CADRE).
-
-
Software Prerequisites:
- Upgraded the software environment to spack-stack v1.9.2.
- Transitioned from JEDI Skylab to the JEDI Bundle aligned with the Global Data Assimilation System (GDAS) App, ensuring consistency with operational DA development.
-
RDHPCS Platform Deployment and Container Support:
- Tier-1 Platforms: Ursa, Gaea-C6, Orion, and Hercules
- Added full support for Ursa and Gaea-C6.
- Nightly Jenkins Workflow End to End (WE2E) test suites now run across all Tier-1 platforms.
- Singularity Containers:
- Extended container support to enhance portability and reproducibility across diverse platforms.
- Tier-1 Platforms: Ursa, Gaea-C6, Orion, and Hercules
-
Documentation: The v3.0.0 User's Guide has been updated to reflect these enhancements to the Land DA System, and test cases with all associated data files are publicly available in the Land DA data bucket. Interested users can get support by submitting a question through the Land DA GitHub Discussions’s Q & A page.
CADRE-EPIC-DA-Training-2025
This is for the CADRE-EPIC DA Training 2025.
ufs-land-da-v2.0.0
The Earth Prediction Innovation Center (EPIC) and the Unified Forecast System (UFS) community are proud to announce the public release of the Land Data Assimilation (DA) System version 2.0.0. This release is an update to the version 1.2.0 release from December 2023 and reflects a number of changes currently available in the land-DA_workflow development branch. To improve the internal structure and maintainability of the UFS land-DA_workflow repository, developers have refactored the workflow to adhere more closely to the National Center for Environmental Prediction's (NCEP) Central Operations (NCO) Implementation Standards. Additionally, developers have incorporated the Unified Workflow (UW) Tools open-source Python package to improve Rocoto workflow generation and automate common Land DA tasks needed for standard numerical weather prediction (NWP) systems. The new release includes the following feature updates:
- Updated configuration:
- Coupled configuration with UFS Weather Model (WM) Noah-MP land component and the data atmosphere (DATM) component
- Global C96 resolution data provided for a Jan. 1-31, 2000 analysis experiment.
- Workflow refactoring to adhere to NCO Implementation Standards
- Removed standalone land-driver and vector2tile components (PR #129)
- Removed land driver from CTest (PR #123)
- Workflow updates:
- Updated directory structure for NCO compliance (e.g., PR #75, PR #49, and many other PRs)
- Incorporation of uwtools rocoto tool to produce the Rocoto workflow XML file from a YAML configuration file (PR #47)
- Incorporation of uwtools template tool to render a configuration file from a template (PR #153)
- Added cycled run capability (PR #101)
- Added workflow end-to-end (WE2E) testing (PR #131)
- Provided automated run option using cron (PR #110)
- Added analysis plotting task (PR #107)
- Software Prerequisites:
- RDHPCS Platform Deployment and Container Support:
- Tier-1 Platforms: Hera, Orion, and Hercules
- Singularity Containers:
- Observation Database Update: The Global Historical Climatology Network (GHCN) daily snow depth observation data have been processed with the JEDI IODA converter for January 1-31, 2000. The IODA-processed data is accessible via the Land DA data bucket.
- Documentation: The v2.0.0 User's Guide has been updated to reflect these improvements to the Land DA System, and test cases with all associated data files are also available to the public in the Land DA data bucket). Interested users can get support by submitting a question through the GitHub Discussions Q & A page.
ufs-land-da-v1.2.0
The Earth Prediction Innovation Center (EPIC) and the Unified Forecast System (UFS) community are proud to announce the public release of the Land Data Assimilation (DA) System version 1.2.0. This release is an update to the version 1.1.0 release from May 2023 and reflects a number of changes currently available in the land-DA_workflow development branch. In the Land DA System, the Noah-MP land surface model (LSM) in the UFS Weather Model (WM) and the Joint Effort for Data assimilation Integration (JEDI) system are used to assimilate snow depth data via the Local Ensemble Transform Kalman Filter-Optimal Interpolation (LETKF-OI) algorithm. The new release includes the following updates:
-
Integration of the UFS Noah-MP land component into the Land DA System for use as an alternative to the Common Community Physics Package (CCPP) Noah-MP LSM land driver. The coupling layer of the land component is developed using the Earth System Modeling Framework (ESMF) and the National Unified Operational Prediction Capability (NUOPC) interoperability layer.
-
Updates to model forcing options for use of the UFS land component
-
Provided a new analysis option in the cubed-sphere native grid using GSWP3 forcing
-
Established global land grid-point consistency with the head of the UFS WM baseline test cases
-
Added a new sample configuration file (settings_DA_cycle_gswp3)
-
Included an additional ECMWF ERA5 reanalysis forcing option in the existing vector-to-tile conversion analysis process
-
-
CTest suite upgrades—the ERA5 CTests now test the operability of seven major components of Land DA: vector2tile, create_ens, letkfoi_snowda, apply_jediincr, tile2vector, land_driver, and ufs_datm_land
-
Upgrade of the JEDI DA system to JEDI Skylab v4.0
-
Updates to sample datasets for the release (see the Land DA data bucket)
-
Singularity container (ubuntu20.04-intel-landda-release-public-v1.2.0.img) updates to support the changes described above
-
Documentation updates to reflect the changes for this release
The v1.2.0 User's Guide has been updated to reflect these improvements to the Land DA System, and test cases with all associated data files are also available to the public in the Land DA data bucket). Interested users can get support by submitting a question through the GitHub Discussions Q & A page.
Known Issues:
- For the GSWP3 forcing option, an artificial GHCN snow depth observation file is provided for a single-cycle analysis test for 2000-01-03. The GHCN observation database will be extended in the near future.
ufs-land-da-v1.1.0
Since the release of the UFS Land Data Assimilation (DA) System v1.0.0, the land DA workflow code base is charting a path forward to unify the Noah-MP forecast model with the UFS Weather Model. JEDI analysis code bases have been updated to use the JEDI Skylab v3.0 release. This is a minor release to include several new features.
Added changes are:
- Migrated the original land-offline_workflow and Land-DA_update GitHub repositories to the land-DA_workfow (https://github.com/ufs-community/land-DA_workflow) and land-DA (https://github.com/ufs-community/land-DA) repositories, respectively.
- Replaced fv3-bundle and ioda-bundle with jedi-bundle release/skylab-v3: https://github.com/JCSDA/jedi-bundle
- Updated spack-stack and modulefiles to support UFS Weather Model build
- Updated CMakeLists.txt to add the option to build the UFS Weather Model (UFS WM) land application as an external project
- Updated Singularity container to support the changes described above: ubuntu20.04-intel-ue-landda.img
Known issue:
- Git Action Workflow yaml for the Docker-based build and ctest was turned off due to the limited disk space provided in the Git Action free runner. Alternatives under investigation are binary library containerization approach and Jenkins CI/CD workflow pipeline.
A User’s Guide is available here to provide further information about the Land DA System and instructions for running and testing the system. Data files required to run Land DA are available to the public in the Land DA data bucket. Interested users can get support by submitting a question through GitHub Discussions GitHub Discussions Q & A page.