RegressionTests_hercules.log

====START OF HERCULES REGRESSION TESTING LOG====

UFSWM hash used in testing:
ab503d17408e832e65b90319aa8bfc4ff339c1b7

Submodule hashes used in testing:
 fc153862cfcc01fc4da513a2ff56af0bbd1234e0 AQM (v0.2.0-73-gfc15386)
 642e81395472d5887b54f601b60ee607ed39bf09 AQM/src/model/CMAQ (CMAQv5.2.1_07Feb2018-6194-g642e81395)
 9f53664ef2e607ad25d6b6c939f2eac9ec818ee6 CDEPS-interface/CDEPS (cdeps0.4.17-432-g9f53664)
 def9c53b17d6722cc9991ba72ddae8ad2d5d25d9 CICE-interface/CICE (CICE6.0.0-445-gdef9c53)
 4954a6f9033f78e5c32bf33780384cbf2d0843e6 CICE-interface/CICE/icepack (Icepack1.1.0-225-g4954a6f)
 c14c1ef3f4d06506bdc48fbe8200b56b6b8b30ff CMEPS-interface/CMEPS (cmeps_v0.4.1-2334-gc14c1ef)
 69049ec0c26b3160c3dbe1980b2feb78470a37a6 CMakeModules (v1.0.0-36-g69049ec)
 9ff3df9545dd582f415f682d3297e8c6c841e5cb GOCART (sdr_v2.1.2.6-291-g9ff3df9)
 05a3f7ae291b59a2ab7611a042f2fc99be31dc61 LM4-driver (baseline_change_240904-7-g05a3f7a)
 c03c4f68816030f726785daf0db6150aa1e9cc6f LM4-driver/LM4 (land_lad2_2021.02)
 72563d619896492a9c61e2b7cdbe6a9cdbbd7920 MOM6-interface/MOM6 (dev/master/repository_split_2014.10.10-10791-g72563d619)
 c38ddb7ebdd2d58c517b63a99bbdc8e348732db2 MOM6-interface/MOM6/pkg/CVMix-src (c38ddb7)
 29e64d652786e1d076a05128c920f394202bfe10 MOM6-interface/MOM6/pkg/GSW-Fortran (29e64d6)
 2c7b3bc2a8096f6232020c47507593058795102e NOAHMP-interface/noahmp (v3.7.1-471-g2c7b3bc)
 2e2cfaa320ddc2d1b7ac21832904f131f0271836 UFSATM (heads/develop)
 22bc1a5de8a19996310aedc3482931616cd74a1b UFSATM/ccpp/framework (2025-10-15-dev-5-g22bc1a5)
 eee1edf1c03d5d96abe379c167a1e2dd67a8c136 UFSATM/ccpp/physics (EP4-2263-geee1edf1)
 c62efd27caa26f660edf24232f33f154e608b77a UFSATM/ccpp/physics/physics/MP/TEMPO/TEMPO (v2.1.3~3)
 41c5fcd950fed09b8afe186dede266824eca7fd3 UFSATM/ccpp/physics/physics/Radiation/RRTMGP/rte-rrtmgp (41c5fcd)
 0c00ba42a222a26754348c6f103a8e97d26f33e7 UFSATM/ccpp/physics/physics/SFC_Layer/MYNN/MYNN (remotes/origin/ccpp/dev)
 3e5db3750e382976b4d6011c6d9c1437b0cf34f6 UFSATM/fv3/atmos_cubed_sphere (201912_public_release-502-g3e5db37)
 38d2177aef842a5c6abe26ffe876804b95fd9e0a UFSATM/mpas/MPAS-Model (remotes/origin/master-60-g38d2177a)
 7d9597c471470be061ab8853dd62bcd03f15d6aa UFSATM/upp (upp_v10.2.0-354-g7d9597c4)
-5afd607642ae0fd6a53b137230336386beb47ce6 UFSATM/upp/sorc/libIFI.fd
-3d35332fe66e3e63a285cc8d96facdf255a33481 UFSATM/upp/sorc/ncep_post.fd/post_gtg.fd
 dcc9da76c2d32c6ca7a5318a56db033295d9f43c WW3 (6.07.1-531-gdcc9da76)
 6b2d73f28d946eed74e474db22769602e41c422b fire_behavior (v0.2.0-71-g6b2d73f)
 ae192f119b8614b4476a1b04ba55f6fb93e2953d stochastic_physics (ufs-v2.0.0-298-gae192f1)


NOTES:
[Times](Memory) are at the end of each compile/test in format [MM:SS](Size).
The first time is for the full script (prep+run+finalize).
The second time is specifically for the run phase.
Times/Memory will be empty for failed tests.

BASELINE DIRECTORY: /work2/noaa/epic/hercules/UFS-WM_RT/NEMSfv3gfs/develop-20260331
COMPARISON DIRECTORY: /work2/noaa/stmp/jiwang/stmp/jiwang/FV3_RT/rt_2586150

RT.SH OPTIONS USED:
* (-a) - HPC PROJECT ACCOUNT: marine-cpu
* (-e) - USE ECFLOW

PASS -- COMPILE 's2swa_32bit_intel' [28:11, 26:15] ( 1 warnings 1092 remarks )
PASS -- TEST 'cpld_control_gefs_intel' [33:24, 19:16](3094 MB)
PASS -- TEST 'cpld_restart_gefs_intel' [22:07, 06:23](2768 MB)
PASS -- TEST 'cpld_dcp_gefs_intel' [33:30, 18:15](3169 MB)

PASS -- COMPILE 's2sw_32bit_pdlib_intel' [23:11, 21:24] ( 1 warnings 1073 remarks )
PASS -- TEST 'cpld_control_gfsv17_intel' [18:18, 15:44](2014 MB)
PASS -- TEST 'cpld_control_gfsv17_iau_intel' [20:55, 17:32](2322 MB)
PASS -- TEST 'cpld_restart_gfsv17_intel' [08:46, 06:03](1354 MB)
PASS -- TEST 'cpld_restart_gfsv17_iau_intel' [11:32, 07:20](2208 MB)
PASS -- TEST 'cpld_mpi_gfsv17_intel' [19:19, 16:18](1920 MB)

PASS -- COMPILE 's2s_32bit_sfs_intel' [24:11, 22:14] ( 1 warnings 987 remarks )
PASS -- TEST 'cpld_control_sfs_intel' [16:32, 11:07](2313 MB)
PASS -- TEST 'cpld_restart_sfs_intel' [13:14, 06:33](1652 MB)

PASS -- COMPILE 's2s_32bit_sfs_debug_intel' [06:11, 04:43] ( 359 warnings 987 remarks )
PASS -- TEST 'cpld_debug_sfs_intel' [15:08, 10:56](2332 MB)

PASS -- COMPILE 's2sw_32bit_pdlib_debug_intel' [06:11, 04:45] ( 359 warnings 1385 remarks )
PASS -- TEST 'cpld_debug_gfsv17_intel' [21:29, 18:59](1997 MB)

PASS -- COMPILE 's2swa_intel' [23:11, 21:42] ( 1 warnings 1092 remarks )
PASS -- TEST 'cpld_control_p8_intel' [12:11, 09:16](2256 MB)
PASS -- TEST 'cpld_control_p8.v2.sfc_intel' [11:11, 08:48](2262 MB)
PASS -- TEST 'cpld_restart_p8_intel' [07:25, 04:23](1956 MB)
PASS -- TEST 'cpld_2threads_p8_intel' [14:59, 12:14](2384 MB)
PASS -- TEST 'cpld_decomp_p8_intel' [11:52, 09:10](2249 MB)
PASS -- TEST 'cpld_mpi_p8_intel' [10:07, 07:30](2134 MB)
PASS -- TEST 'cpld_control_ciceC_p8_intel' [11:09, 08:40](2260 MB)
PASS -- TEST 'cpld_control_c192_p8_intel' [17:58, 14:42](2936 MB)
PASS -- TEST 'cpld_restart_c192_p8_intel' [09:47, 05:22](2956 MB)

PASS -- COMPILE 's2swl_intel' [23:11, 21:20] ( 1 warnings 1095 remarks )
PASS -- TEST 'cpld_control_p8_lnd_intel' [11:10, 08:12](2149 MB)
PASS -- TEST 'cpld_restart_p8_lnd_intel' [06:29, 03:58](1683 MB)

PASS -- COMPILE 's2s_aoflux_intel' [24:11, 23:03] ( 1 warnings 998 remarks )
PASS -- TEST 'cpld_control_noaero_p8_agrid_intel' [07:09, 04:27](2144 MB)

PASS -- COMPILE 's2sw_pdlib_intel' [22:11, 20:51] ( 1 warnings 1083 remarks )
PASS -- TEST 'cpld_control_c48_5deg_intel' [07:40, 05:26](3053 MB)
PASS -- TEST 'cpld_warmstart_c48_5deg_intel' [03:40, 01:43](3037 MB)
PASS -- TEST 'cpld_restart_c48_5deg_intel' [02:38, 01:00](2477 MB)
PASS -- TEST 'cpld_control_c24_5deg_intel' [02:27, 00:57](2243 MB)
PASS -- TEST 'cpld_warmstart_c24_5deg_intel' [02:28, 00:34](2239 MB)
PASS -- TEST 'cpld_restart_c24_5deg_intel' [02:28, 00:24](1541 MB)
PASS -- TEST 'cpld_control_c24_9deg_intel' [02:27, 00:54](2239 MB)
PASS -- TEST 'cpld_warmstart_c24_9deg_intel' [02:28, 00:34](2227 MB)
PASS -- TEST 'cpld_restart_c24_9deg_intel' [02:28, 00:25](1551 MB)
PASS -- TEST 'cpld_control_c12_9deg_intel' [02:25, 00:33](2168 MB)
PASS -- TEST 'cpld_warmstart_c12_9deg_intel' [02:26, 00:27](2157 MB)
PASS -- TEST 'cpld_restart_c12_9deg_intel' [02:24, 00:22](1510 MB)

PASS -- COMPILE 'atm_dyn32_intel' [13:11, 11:15] ( 1 warnings 539 remarks )
PASS -- TEST 'control_CubedSphereGrid_intel' [03:29, 02:03](1609 MB)
PASS -- TEST 'control_CubedSphereGrid_parallel_intel' [04:37, 02:13](1617 MB)
PASS -- TEST 'control_latlon_intel' [04:25, 02:13](1618 MB)
PASS -- TEST 'control_wrtGauss_netcdf_parallel_intel' [03:28, 02:09](1606 MB)
PASS -- TEST 'control_c48_intel' [07:32, 05:41](1710 MB)
PASS -- TEST 'control_c48.v2.sfc_intel' [07:31, 05:21](843 MB)
PASS -- TEST 'control_c48_lnd_iau_intel' [07:33, 05:53](1710 MB)
PASS -- TEST 'control_c192_intel' [08:49, 06:26](1817 MB)
PASS -- TEST 'control_c384_intel' [10:32, 07:55](2008 MB)
PASS -- TEST 'control_c384gdas_intel' [11:35, 07:46](1484 MB)
PASS -- TEST 'control_stochy_intel' [03:23, 01:28](676 MB)
PASS -- TEST 'control_stochy_restart_intel' [02:26, 00:52](554 MB)
PASS -- TEST 'control_lndp_intel' [03:23, 01:22](680 MB)
PASS -- TEST 'control_iovr4_gfdlmpv3_intel' [05:41, 03:13](972 MB)
PASS -- TEST 'control_p8_intel' [06:01, 03:26](1903 MB)
PASS -- TEST 'control_p8.v2.sfc_intel' [05:11, 02:40](1907 MB)
PASS -- TEST 'control_p8_ugwpv1_intel' [06:04, 03:19](1903 MB)
PASS -- TEST 'control_p8_ugwpv1_tempo_intel' [05:04, 02:52](1928 MB)
PASS -- TEST 'control_p8_ugwpv1_tempo_aerosol_intel' [06:11, 03:29](1938 MB)
PASS -- TEST 'control_p8_ugwpv1_tempo_aerosol_hail_intel' [03:57, 02:04](2426 MB)
PASS -- TEST 'control_restart_p8_intel' [03:50, 01:34](1218 MB)
PASS -- TEST 'control_noqr_p8_intel' [05:59, 03:17](1897 MB)
PASS -- TEST 'control_restart_noqr_p8_intel' [03:52, 01:31](1225 MB)
PASS -- TEST 'control_decomp_p8_intel' [05:59, 03:32](1898 MB)
PASS -- TEST 'control_2threads_p8_intel' [05:59, 03:48](1991 MB)
PASS -- TEST 'control_p8_lndp_intel' [07:43, 05:26](1910 MB)
PASS -- TEST 'control_p8_rrtmgp_intel' [06:08, 03:52](1967 MB)
PASS -- TEST 'control_p8_mynn_intel' [06:04, 03:55](1928 MB)
PASS -- TEST 'merra2_thompson_intel' [07:07, 04:30](1913 MB)
PASS -- TEST 'merra2_hf_thompson_intel' [07:53, 05:39](1915 MB)
PASS -- TEST 'regional_control_intel' [06:38, 05:04](1199 MB)
PASS -- TEST 'regional_restart_intel' [04:25, 02:34](1186 MB)
PASS -- TEST 'regional_decomp_intel' [06:29, 04:56](1191 MB)
PASS -- TEST 'regional_2threads_intel' [06:24, 04:19](1095 MB)
PASS -- TEST 'regional_noquilt_intel' [06:32, 04:45](1495 MB)
PASS -- TEST 'regional_netcdf_parallel_intel' [06:25, 04:44](1199 MB)
PASS -- TEST 'regional_2dwrtdecomp_intel' [06:23, 04:41](1206 MB)
PASS -- TEST 'regional_wofs_intel' [07:23, 05:28](2091 MB)

PASS -- COMPILE 'atm_dyn32_rad32_intel' [16:11, 14:31] ( 1 warnings 519 remarks )
PASS -- TEST 'control_p8_rrtmgp_rad32_intel' [05:59, 04:03](1949 MB)

PASS -- COMPILE 'rrfs_intel' [11:11, 09:41] ( 4 warnings 490 remarks )
PASS -- TEST 'rap_control_intel' [05:49, 03:26](1124 MB)
PASS -- TEST 'regional_spp_sppt_shum_skeb_intel' [05:49, 03:10](1437 MB)
PASS -- TEST 'rap_decomp_intel' [05:48, 03:48](1091 MB)
PASS -- TEST 'rap_2threads_intel' [06:47, 04:25](1160 MB)
PASS -- TEST 'rap_restart_intel' [03:54, 01:50](1112 MB)
PASS -- TEST 'rap_sfcdiff_intel' [05:37, 03:29](1126 MB)
PASS -- TEST 'rap_sfcdiff_decomp_intel' [05:37, 03:45](1094 MB)
PASS -- TEST 'rap_sfcdiff_restart_intel' [03:52, 01:58](1107 MB)
PASS -- TEST 'hrrr_control_intel' [04:52, 03:09](1088 MB)
PASS -- TEST 'hrrr_control_decomp_intel' [05:41, 03:18](1052 MB)
PASS -- TEST 'hrrr_control_2threads_intel' [05:38, 04:09](1137 MB)
PASS -- TEST 'hrrr_control_restart_intel' [03:28, 01:44](1056 MB)
PASS -- TEST 'rrfs_v1beta_intel' [08:56, 06:28](1220 MB)
PASS -- TEST 'rrfs_v1nssl_intel' [09:20, 07:51](2012 MB)
PASS -- TEST 'rrfs_v1nssl_nohailnoccn_intel' [09:19, 07:21](2177 MB)

PASS -- COMPILE 'csawmg_intel' [10:11, 08:58] ( 1 warnings 459 remarks )
PASS -- TEST 'control_csawmg_intel' [07:27, 05:18](1077 MB)
PASS -- TEST 'control_ras_intel' [04:20, 02:49](837 MB)

PASS -- COMPILE 'wam_intel' [11:10, 09:52] ( 1 warnings 442 remarks )
PASS -- TEST 'control_wam_intel' [14:40, 13:08](1687 MB)

PASS -- COMPILE 'atm_debug_dyn32_intel' [06:10, 04:26] ( 494 warnings 628 remarks )
PASS -- TEST 'control_CubedSphereGrid_debug_intel' [03:26, 01:58](1623 MB)
PASS -- TEST 'control_wrtGauss_netcdf_parallel_debug_intel' [03:23, 02:00](1633 MB)
PASS -- TEST 'control_stochy_debug_intel' [04:16, 02:36](846 MB)
PASS -- TEST 'control_lndp_debug_intel' [04:18, 02:23](842 MB)
PASS -- TEST 'control_csawmg_debug_intel' [07:24, 05:10](1146 MB)
PASS -- TEST 'control_ras_debug_intel' [04:16, 02:24](862 MB)
PASS -- TEST 'control_diag_debug_intel' [04:25, 02:28](1708 MB)
PASS -- TEST 'control_debug_p8_intel' [05:32, 03:23](1923 MB)
PASS -- TEST 'regional_debug_intel' [17:26, 15:31](1160 MB)
PASS -- TEST 'rap_control_debug_intel' [06:17, 04:16](1228 MB)
PASS -- TEST 'hrrr_control_debug_intel' [06:20, 04:10](1228 MB)
PASS -- TEST 'hrrr_gf_debug_intel' [06:17, 04:14](1227 MB)
PASS -- TEST 'hrrr_c3_debug_intel' [06:17, 04:10](1239 MB)
PASS -- TEST 'rap_unified_drag_suite_debug_intel' [06:17, 04:16](1235 MB)
PASS -- TEST 'rap_diag_debug_intel' [06:24, 04:26](1318 MB)
PASS -- TEST 'rap_cires_ugwp_debug_intel' [06:17, 04:21](1235 MB)
PASS -- TEST 'rap_unified_ugwp_debug_intel' [06:17, 04:19](1247 MB)
PASS -- TEST 'rap_lndp_debug_intel' [06:17, 04:14](1237 MB)
PASS -- TEST 'rap_progcld_thompson_debug_intel' [06:20, 04:13](1231 MB)
PASS -- TEST 'rap_noah_debug_intel' [06:19, 04:07](1235 MB)
PASS -- TEST 'rap_sfcdiff_debug_intel' [06:17, 04:10](1237 MB)
PASS -- TEST 'rap_noah_sfcdiff_cires_ugwp_debug_intel' [08:17, 06:44](1232 MB)
PASS -- TEST 'rap_clm_lake_debug_intel' [06:19, 04:13](1237 MB)

PASS -- COMPILE 'wam_debug_intel' [04:10, 03:00] ( 457 warnings 442 remarks )

PASS -- COMPILE 'rrfs_dyn32_phy32_intel' [10:10, 08:35] ( 4 warnings 457 remarks )
PASS -- TEST 'regional_spp_sppt_shum_skeb_dyn32_phy32_intel' [04:48, 03:04](1306 MB)
PASS -- TEST 'rap_control_dyn32_phy32_intel' [04:47, 02:34](1061 MB)
PASS -- TEST 'hrrr_control_dyn32_phy32_intel' [04:56, 02:28](1027 MB)
PASS -- TEST 'rap_2threads_dyn32_phy32_intel' [05:36, 03:46](1080 MB)
PASS -- TEST 'hrrr_control_2threads_dyn32_phy32_intel' [05:40, 03:36](1071 MB)
PASS -- TEST 'hrrr_control_decomp_dyn32_phy32_intel' [04:37, 02:37](991 MB)
PASS -- TEST 'rap_restart_dyn32_phy32_intel' [03:44, 01:27](972 MB)
PASS -- TEST 'hrrr_control_restart_dyn32_phy32_intel' [03:18, 01:25](958 MB)
PASS -- TEST 'conus13km_control_intel' [04:51, 02:31](1468 MB)
PASS -- TEST 'conus13km_2threads_intel' [03:37, 01:21](1337 MB)
PASS -- TEST 'conus13km_decomp_intel' [04:37, 02:34](1522 MB)
PASS -- TEST 'conus13km_restart_intel' [03:37, 01:31](1275 MB)

PASS -- COMPILE 'rrfs_dyn32_phy32_faster_cdeps_intel' [11:10, 09:26] ( 4 warnings 487 remarks )
PASS -- TEST 'conus13km_gl_inline_intel' [03:58, 01:54](1051 MB)

PASS -- COMPILE 'rrfs_dyn64_phy32_intel' [10:10, 08:42] ( 4 warnings 457 remarks )
PASS -- TEST 'rap_control_dyn64_phy32_intel' [05:33, 03:19](1104 MB)

PASS -- COMPILE 'rrfs_dyn32_phy32_debug_intel' [04:10, 03:03] ( 330 warnings 463 remarks )
PASS -- TEST 'rap_control_debug_dyn32_phy32_intel' [06:16, 04:32](1123 MB)
PASS -- TEST 'hrrr_control_debug_dyn32_phy32_intel' [06:20, 04:23](1114 MB)
PASS -- TEST 'conus13km_debug_intel' [21:43, 19:52](1548 MB)
PASS -- TEST 'conus13km_debug_qr_intel' [21:44, 19:27](1155 MB)
PASS -- TEST 'conus13km_debug_2threads_intel' [22:36, 20:53](1369 MB)
PASS -- TEST 'conus13km_debug_decomp_intel' [22:29, 20:31](1589 MB)
PASS -- TEST 'conus13km_radar_tten_debug_intel' [21:28, 19:23](1589 MB)

PASS -- COMPILE 'rrfs_dyn64_phy32_debug_intel' [04:10, 03:04] ( 330 warnings 457 remarks )
PASS -- TEST 'rap_control_dyn64_phy32_debug_intel' [06:20, 04:13](1214 MB)

PASS -- COMPILE 'hafsw_intel' [13:11, 11:45] ( 1 warnings 681 remarks )
PASS -- TEST 'hafs_regional_atm_intel' [05:43, 03:23](985 MB)
PASS -- TEST 'hafs_regional_atm_gfdlmpv3_intel' [07:18, 05:04](1187 MB)
PASS -- TEST 'hafs_regional_atm_thompson_gfdlsf_intel' [04:24, 02:53](1275 MB)
PASS -- TEST 'hafs_regional_atm_wav_intel' [16:53, 14:23](1100 MB)
PASS -- TEST 'hafs_regional_1nest_atm_intel' [06:47, 04:39](588 MB)
PASS -- TEST 'hafs_regional_telescopic_2nests_atm_intel' [07:54, 05:30](607 MB)
PASS -- TEST 'hafs_global_1nest_atm_intel' [04:35, 02:14](428 MB)
PASS -- TEST 'hafs_global_multiple_4nests_atm_intel' [08:32, 05:56](492 MB)
PASS -- TEST 'hafs_regional_specified_moving_1nest_atm_intel' [04:45, 03:04](603 MB)
PASS -- TEST 'hafs_regional_storm_following_1nest_atm_intel' [04:47, 02:55](602 MB)
PASS -- TEST 'hafs_global_storm_following_1nest_atm_intel' [02:23, 00:53](446 MB)
PASS -- TEST 'gnv1_nested_intel' [05:29, 02:55](1761 MB)

PASS -- COMPILE 'hafs_mom6w_intel' [13:10, 11:19] ( 1 warnings 977 remarks )
PASS -- TEST 'hafs_regional_storm_following_1nest_atm_ocn_wav_mom6_intel' [14:46, 11:34](824 MB)

PASS -- COMPILE 'hafs_all_intel' [12:10, 10:52] ( 1 warnings 623 remarks )
PASS -- TEST 'hafs_regional_docn_intel' [08:45, 06:53](1054 MB)
PASS -- TEST 'hafs_regional_docn_oisst_intel' [08:44, 06:57](1054 MB)

PASS -- COMPILE 'datm_cdeps_intel' [19:10, 17:47] ( 569 remarks )
PASS -- TEST 'datm_cdeps_control_cfsr_intel' [04:15, 02:25](1848 MB)
PASS -- TEST 'datm_cdeps_restart_cfsr_intel' [03:19, 01:33](1795 MB)
PASS -- TEST 'datm_cdeps_control_gefs_intel' [04:15, 02:21](1085 MB)
PASS -- TEST 'datm_cdeps_iau_gefs_intel' [04:16, 02:16](1090 MB)
FAILED: UNABLE TO COMPLETE COMPARISON -- TEST 'datm_cdeps_stochy_gefs_intel' [, ]( MB)
PASS -- TEST 'datm_cdeps_ciceC_cfsr_intel' [04:15, 02:29](1847 MB)
PASS -- TEST 'datm_cdeps_mx025_cfsr_intel' [07:53, 05:57](1704 MB)
PASS -- TEST 'datm_cdeps_mx025_gefs_intel' [07:52, 05:44](1172 MB)
PASS -- TEST 'datm_cdeps_multiple_files_cfsr_intel' [04:16, 02:28](1854 MB)
PASS -- TEST 'datm_cdeps_3072x1536_cfsr_intel' [05:18, 03:49](4834 MB)
PASS -- TEST 'datm_cdeps_gfs_intel' [05:18, 03:54](4834 MB)

PASS -- COMPILE 'datm_cdeps_debug_intel' [05:10, 03:40] ( 2 warnings 569 remarks )
PASS -- TEST 'datm_cdeps_debug_cfsr_intel' [07:17, 05:28](1774 MB)

PASS -- COMPILE 'datm_cdeps_land_intel' [02:10, 00:43] ( 129 remarks )
PASS -- TEST 'datm_cdeps_lnd_gswp3_intel' [02:31, 00:59](335 MB)
PASS -- TEST 'datm_cdeps_lnd_era5_intel' [02:23, 00:40](555 MB)
PASS -- TEST 'datm_cdeps_lnd_era5_rst_intel' [02:28, 00:23](556 MB)

PASS -- COMPILE 'atm_ds2s_docn_pcice_intel' [27:11, 26:01] ( 1 warnings 656 remarks )
PASS -- TEST 'atm_ds2s_docn_pcice_intel' [06:09, 03:14](2044 MB)

PASS -- COMPILE 'atml_intel' [11:10, 09:34] ( 9 warnings 593 remarks )
PASS -- TEST 'control_p8_atmlnd_intel' [05:09, 02:44](1887 MB)
PASS -- TEST 'control_restart_p8_atmlnd_intel' [03:44, 01:35](1205 MB)

PASS -- COMPILE 'atml_debug_intel' [05:10, 03:38] ( 501 warnings 593 remarks )
PASS -- TEST 'control_p8_atmlnd_debug_intel' [07:58, 05:45](1909 MB)

PASS -- COMPILE 'atmw_intel' [12:10, 10:16] ( 1 warnings 568 remarks )
PASS -- TEST 'atmwav_control_noaero_p8_intel' [03:52, 01:37](1942 MB)

PASS -- COMPILE 'atmaero_intel' [14:11, 12:45] ( 1 warnings 460 remarks )
PASS -- TEST 'atmaero_control_p8_intel' [06:51, 04:10](2004 MB)
PASS -- TEST 'atmaero_control_p8_rad_intel' [06:42, 04:35](1782 MB)
PASS -- TEST 'atmaero_control_p8_rad_micro_intel' [06:42, 04:35](1802 MB)

PASS -- COMPILE 'atmaq_intel' [12:10, 10:18] ( 1 warnings 645 remarks )
PASS -- TEST 'regional_atmaq_intel' [16:24, 13:09](2942 MB)
PASS -- TEST 'regional_atmaq_canopy_intel' [19:09, 16:44](2943 MB)

PASS -- COMPILE 'atmaq_debug_intel' [04:10, 02:53] ( 474 warnings 645 remarks )
PASS -- TEST 'regional_atmaq_debug_intel' [34:05, 31:41](2953 MB)

PASS -- COMPILE 'atm_fbh_intel' [10:10, 08:16] ( 4 warnings 466 remarks )
PASS -- TEST 'cpld_regional_atm_fbh_intel' [11:23, 09:53](1080 MB)

PASS -- COMPILE 'atm_gnu' [05:10, 04:02] ( 38 warnings )
PASS -- TEST 'control_c48_gnu' [09:39, 07:56](1581 MB)
PASS -- TEST 'control_stochy_gnu' [04:20, 02:19](587 MB)
PASS -- TEST 'control_ras_gnu' [05:17, 03:46](590 MB)
PASS -- TEST 'control_p8_gnu' [05:59, 03:28](1520 MB)
PASS -- TEST 'control_p8_ugwpv1_gnu' [05:43, 03:33](1540 MB)

PASS -- COMPILE 'rrfs_gnu' [05:10, 03:58] ( 38 warnings )
PASS -- TEST 'rap_control_gnu' [06:34, 04:17](936 MB)
PASS -- TEST 'rap_decomp_gnu' [06:43, 04:16](935 MB)
PASS -- TEST 'rap_2threads_gnu' [05:47, 03:37](989 MB)
PASS -- TEST 'rap_restart_gnu' [04:54, 02:21](674 MB)
PASS -- TEST 'rap_sfcdiff_gnu' [06:40, 04:15](934 MB)
PASS -- TEST 'rap_sfcdiff_decomp_gnu' [06:40, 04:23](935 MB)
PASS -- TEST 'rap_sfcdiff_restart_gnu' [05:02, 02:17](673 MB)
PASS -- TEST 'hrrr_control_gnu' [05:52, 04:04](931 MB)
PASS -- TEST 'hrrr_control_noqr_gnu' [05:35, 04:04](917 MB)
PASS -- TEST 'hrrr_control_2threads_gnu' [05:49, 03:37](984 MB)
PASS -- TEST 'hrrr_control_decomp_gnu' [05:41, 04:06](930 MB)
PASS -- TEST 'hrrr_control_restart_gnu' [04:20, 02:10](666 MB)
PASS -- TEST 'hrrr_control_restart_noqr_gnu' [04:23, 02:10](749 MB)
PASS -- TEST 'rrfs_v1beta_gnu' [09:59, 07:53](930 MB)

PASS -- COMPILE 'csawmg_gnu' [05:10, 03:25] ( 38 warnings )
PASS -- TEST 'control_csawmg_gnu' [08:29, 06:43](831 MB)

PASS -- COMPILE 'atm_dyn32_debug_gnu' [08:11, 06:22] ( 41 warnings )
PASS -- TEST 'control_diag_debug_gnu' [03:26, 01:13](1366 MB)
PASS -- TEST 'regional_debug_gnu' [08:27, 06:33](885 MB)
PASS -- TEST 'rap_control_debug_gnu' [04:20, 02:13](946 MB)
PASS -- TEST 'hrrr_control_debug_gnu' [03:22, 02:01](944 MB)
PASS -- TEST 'hrrr_gf_debug_gnu' [04:40, 02:10](944 MB)
PASS -- TEST 'hrrr_c3_debug_gnu' [04:22, 02:15](944 MB)
PASS -- TEST 'rap_diag_debug_gnu' [04:27, 02:17](1032 MB)
PASS -- TEST 'rap_noah_sfcdiff_cires_ugwp_debug_gnu' [05:17, 03:25](942 MB)
PASS -- TEST 'rap_progcld_thompson_debug_gnu' [03:18, 02:07](949 MB)
PASS -- TEST 'control_ras_debug_gnu' [03:17, 01:20](581 MB)
PASS -- TEST 'control_stochy_debug_gnu' [03:18, 01:27](573 MB)
PASS -- TEST 'control_debug_p8_gnu' [04:40, 02:20](1533 MB)
PASS -- TEST 'rap_clm_lake_debug_gnu' [04:22, 02:09](948 MB)
PASS -- TEST 'gnv1_c96_no_nest_debug_gnu' [05:52, 03:48](953 MB)

PASS -- COMPILE 'wam_debug_gnu' [03:10, 01:55] ( 38 warnings )
PASS -- TEST 'control_wam_debug_gnu' [07:41, 05:40](1387 MB)

PASS -- COMPILE 'atm_debug_dyn32_gnu' [05:10, 03:09] ( 38 warnings )
PASS -- TEST 'control_csawmg_debug_gnu' [05:33, 03:27](819 MB)

PASS -- COMPILE 'rrfs_dyn32_phy32_gnu' [05:10, 03:53] ( 38 warnings )
PASS -- TEST 'rap_control_dyn32_phy32_gnu' [05:45, 04:03](788 MB)
PASS -- TEST 'hrrr_control_dyn32_phy32_gnu' [05:57, 03:58](789 MB)
PASS -- TEST 'rap_2threads_dyn32_phy32_gnu' [05:35, 03:35](837 MB)
PASS -- TEST 'hrrr_control_2threads_dyn32_phy32_gnu' [05:42, 03:51](834 MB)
PASS -- TEST 'hrrr_control_decomp_dyn32_phy32_gnu' [06:07, 03:59](787 MB)
PASS -- TEST 'rap_restart_dyn32_phy32_gnu' [03:48, 02:05](643 MB)
PASS -- TEST 'hrrr_control_restart_dyn32_phy32_gnu' [03:19, 02:05](644 MB)
PASS -- TEST 'conus13km_control_gnu' [05:59, 03:55](1031 MB)
PASS -- TEST 'conus13km_2threads_gnu' [03:48, 02:02](1015 MB)
PASS -- TEST 'conus13km_decomp_gnu' [05:44, 04:05](1037 MB)
PASS -- TEST 'conus13km_restart_gnu' [05:00, 02:13](761 MB)

PASS -- COMPILE 'atm_dyn64_phy32_gnu' [13:10, 12:02] ( 41 warnings )
PASS -- TEST 'rap_control_dyn64_phy32_gnu' [06:36, 04:26](819 MB)

PASS -- COMPILE 'atm_dyn32_phy32_debug_gnu' [08:10, 06:45] ( 41 warnings )
PASS -- TEST 'rap_control_debug_dyn32_phy32_gnu' [03:18, 02:03](802 MB)
PASS -- TEST 'hrrr_control_debug_dyn32_phy32_gnu' [03:23, 01:55](797 MB)
PASS -- TEST 'conus13km_debug_gnu' [10:37, 08:41](1050 MB)
PASS -- TEST 'conus13km_debug_qr_gnu' [10:33, 08:38](775 MB)
PASS -- TEST 'conus13km_debug_2threads_gnu' [10:28, 09:04](1034 MB)
PASS -- TEST 'conus13km_debug_decomp_gnu' [10:27, 08:38](1056 MB)
PASS -- TEST 'conus13km_radar_tten_debug_gnu' [10:29, 08:31](1123 MB)

PASS -- COMPILE 'atm_dyn64_phy32_debug_gnu' [07:10, 06:06] ( 41 warnings )
PASS -- TEST 'rap_control_dyn64_phy32_debug_gnu' [03:22, 01:57](823 MB)

PASS -- COMPILE 's2sw_32bit_pdlib_gnu' [18:11, 16:17] ( 38 warnings )
PASS -- TEST 'cpld_control_gfsv17_gnu' [17:02, 14:27](1569 MB)

PASS -- COMPILE 's2sw_32bit_pdlib_debug_gnu' [04:10, 02:27] ( 1921 warnings )
PASS -- TEST 'cpld_debug_gfsv17_gnu' [10:12, 07:13](1587 MB)

PASS -- COMPILE 's2s_32bit_sfs_gnu' [20:11, 18:23] ( 38 warnings )
PASS -- TEST 'cpld_control_sfs_gnu' [22:15, 16:49](1814 MB)

PASS -- COMPILE 's2s_32bit_sfs_debug_gnu' [03:10, 02:02] ( 1171 warnings )
PASS -- TEST 'cpld_debug_sfs_gnu' [11:01, 06:55](1824 MB)

PASS -- COMPILE 'datm_cdeps_gnu' [17:11, 15:11]
PASS -- TEST 'datm_cdeps_control_cfsr_gnu' [04:14, 02:45](1605 MB)

PASS -- COMPILE 'atm_mpas_dyn32_gnu' [04:11, 03:04] ( 1 warnings )
PASS -- TEST 'control_gfs_mpas_gnu' [02:20, 00:36](6437 MB)

SYNOPSIS:
Starting Date/Time: 20260402 13:04:57
Ending Date/Time: 20260402 14:37:43
Total Time: 01h:33m:23s
Compiles Completed: 51/51
Tests Completed: 241/242
Failed Tests:
* TEST datm_cdeps_stochy_gefs_intel: FAILED: UNABLE TO COMPLETE COMPARISON
-- LOG: /work/noaa/marine/Jiande.Wang/HERCULES/UFS-add-restart-PR/ufs-weather-model/tests/logs/log_hercules/run_datm_cdeps_stochy_gefs_intel.log

NOTES:
A file 'test_changes.list' was generated with list of all failed tests.
You can use './rt.sh -c -b test_changes.list' to create baselines for the failed tests.
If you are using this log as a pull request verification, please commit 'test_changes.list'.

Result: FAILURE

====END OF HERCULES REGRESSION TESTING LOG====