-
Notifications
You must be signed in to change notification settings - Fork 757
Port subset of em_real tests from regression tests #2215
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: develop
Are you sure you want to change the base?
Conversation
This script is based on the very well-named script.csh out of the also very well-named repo : https://github.com/wrf-model/SCRIPTS While it runs the rd_l2_norm.py, if not present it does not error out. Instead diffwrf is used as that is more precise in its comparisons.
These tests are based on : https://github.com/kkeene44/wrf-coop/blob/version16_update/build.csh
The regression test results:
|
|
||
|
||
|
||
################################################################################ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@kkeene44 or @weiwangncar (who ever is more familiar with the Scala tests) I think it would be good for someone to spot-check this to make sure I have the equivalent logic being used in Scala tests to run the namelists.
The analogous info from large test matrix found in the Scala tests can be found in the .ci/wrf_em_real_tests.jsonc
file.
TYPE: enhancement
KEYWORDS: testing, em_real
SOURCE: internal
DESCRIPTION OF CHANGES:
Problem:
In the continued effort to port the regression tests to a usable format outside a single container environment, a generalized testing framework is now in place. However, this currently lacks the full set of tests.
Solution:
This implements a subset of the em_real tests, notably the tests that are stable, bitwise reproducible, and do not rely on in situ modification of configuration.
TESTS CONDUCTED: