Skip to content

Add performance check #20

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

Add performance check #20

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
100 changes: 99 additions & 1 deletion tests/integration/global_time_series/cases_global_time_series.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -145,6 +145,103 @@
}
)

# https://github.com/E3SM-Project/zppy/pull/694#discussion_r2023998012
# zi-global-time-series --use_ocn False --input /lcrc/group/e3sm2/ac.wlin/E3SMv3/v3.LR.historical_0051 --input_subdir archive/ocn/hist --moc_file mocTimeSeries_1985-2014.nc --case_dir /lcrc/group/e3sm/ac.forsyth2/E3SMv3_20250331_try2/v3.LR.historical_0051 --experiment_name v3.LR.historical_0051 --figstr v3.LR.historical_0051 --color Blue --ts_num_years 30 --plots_original None --plots_atm TREFHT --plots_ice None --plots_lnd FSH --plots_ocn None --nrows 4 --ncols 2 --results_dir ./zi --regions glb,n,s --make_viewer True --start_yr 1985 --end_yr 2014
#
# real 2m29.004s
# user 2m8.127s
# sys 0m8.645s
"""
Output, with extra lines removed:
Running main
2025-04-02 09:27:49,826 [INFO]: __main__.py(main:45) >> Update time series figures
Copy link
Collaborator Author

@forsyth2 forsyth2 Apr 2, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I had to remove the extra 2 log lines from the output. We should definitely prioritize #10 to make parsing logs easier.

2025-04-02 09:28:35,126 [INFO]: coupled_global.py(process_data:271) >> glb region globalAnnual was computed successfully for these variables: ['TREFHT', 'FSH']
2025-04-02 09:28:35,126 [ERROR]: coupled_global.py(process_data:274) >> glb region globalAnnual could not be computed for these variables: []
2025-04-02 09:28:35,126 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=glb, component=original
2025-04-02 09:28:35,126 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=glb, component=atm
2025-04-02 09:28:35,128 [INFO]: coupled_global_plotting.py(make_plot_pdfs:581) >> Using reduced figsize
2025-04-02 09:28:35,129 [INFO]: coupled_global_plotting.py(make_plot_pdfs:586) >> Figure size=[675. 412.5]
2025-04-02 09:28:35,129 [INFO]: coupled_global_plotting.py(make_plot_pdfs:589) >> Plotting plot 0 on page 0. This is plot 0 in total.
2025-04-02 09:28:35,140 [INFO]: coupled_global_plotting.py(plot_generic:413) >> plot_generic for TREFHT, rgn=glb
2025-04-02 09:28:36,572 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=glb, component=ice
2025-04-02 09:28:36,572 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=glb, component=lnd
2025-04-02 09:28:36,573 [INFO]: coupled_global_plotting.py(make_plot_pdfs:581) >> Using reduced figsize
2025-04-02 09:28:36,573 [INFO]: coupled_global_plotting.py(make_plot_pdfs:586) >> Figure size=[675. 412.5]
2025-04-02 09:28:36,573 [INFO]: coupled_global_plotting.py(make_plot_pdfs:589) >> Plotting plot 0 on page 0. This is plot 0 in total.
2025-04-02 09:28:36,580 [INFO]: coupled_global_plotting.py(plot_generic:413) >> plot_generic for FSH, rgn=glb
2025-04-02 09:28:38,787 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=glb, component=ocn
2025-04-02 09:28:38,787 [INFO]: coupled_global.py(run:312) >> These glb region plots generated successfully: ['TREFHT', 'FSH']
2025-04-02 09:28:38,787 [ERROR]: coupled_global.py(run:313) >> These glb region plots could not be generated successfully: []
2025-04-02 09:29:13,242 [INFO]: coupled_global.py(process_data:271) >> n region globalAnnual was computed successfully for these variables: ['TREFHT', 'FSH']
2025-04-02 09:29:13,243 [ERROR]: coupled_global.py(process_data:274) >> n region globalAnnual could not be computed for these variables: []
2025-04-02 09:29:13,243 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=n, component=original
2025-04-02 09:29:13,243 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=n, component=atm
2025-04-02 09:29:13,243 [INFO]: coupled_global_plotting.py(make_plot_pdfs:581) >> Using reduced figsize
2025-04-02 09:29:13,243 [INFO]: coupled_global_plotting.py(make_plot_pdfs:586) >> Figure size=[675. 412.5]
2025-04-02 09:29:13,244 [INFO]: coupled_global_plotting.py(make_plot_pdfs:589) >> Plotting plot 0 on page 0. This is plot 0 in total.
2025-04-02 09:29:13,250 [INFO]: coupled_global_plotting.py(plot_generic:413) >> plot_generic for TREFHT, rgn=n
2025-04-02 09:29:14,334 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=n, component=ice
2025-04-02 09:29:14,334 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=n, component=lnd
2025-04-02 09:29:14,335 [INFO]: coupled_global_plotting.py(make_plot_pdfs:581) >> Using reduced figsize
2025-04-02 09:29:14,335 [INFO]: coupled_global_plotting.py(make_plot_pdfs:586) >> Figure size=[675. 412.5]
2025-04-02 09:29:14,335 [INFO]: coupled_global_plotting.py(make_plot_pdfs:589) >> Plotting plot 0 on page 0. This is plot 0 in total.
2025-04-02 09:29:14,341 [INFO]: coupled_global_plotting.py(plot_generic:413) >> plot_generic for FSH, rgn=n
2025-04-02 09:29:16,778 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=n, component=ocn
2025-04-02 09:29:16,779 [INFO]: coupled_global.py(run:312) >> These n region plots generated successfully: ['TREFHT', 'FSH']
2025-04-02 09:29:16,779 [ERROR]: coupled_global.py(run:313) >> These n region plots could not be generated successfully: []
2025-04-02 09:29:50,685 [INFO]: coupled_global.py(process_data:271) >> s region globalAnnual was computed successfully for these variables: ['TREFHT', 'FSH']
2025-04-02 09:29:50,685 [ERROR]: coupled_global.py(process_data:274) >> s region globalAnnual could not be computed for these variables: []
2025-04-02 09:29:50,685 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=s, component=original
2025-04-02 09:29:50,685 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=s, component=atm
2025-04-02 09:29:50,685 [INFO]: coupled_global_plotting.py(make_plot_pdfs:581) >> Using reduced figsize
2025-04-02 09:29:50,686 [INFO]: coupled_global_plotting.py(make_plot_pdfs:586) >> Figure size=[675. 412.5]
2025-04-02 09:29:50,686 [INFO]: coupled_global_plotting.py(make_plot_pdfs:589) >> Plotting plot 0 on page 0. This is plot 0 in total.
2025-04-02 09:29:50,692 [INFO]: coupled_global_plotting.py(plot_generic:413) >> plot_generic for TREFHT, rgn=s
2025-04-02 09:29:51,784 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=s, component=ice
2025-04-02 09:29:51,784 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=s, component=lnd
2025-04-02 09:29:51,784 [INFO]: coupled_global_plotting.py(make_plot_pdfs:581) >> Using reduced figsize
2025-04-02 09:29:51,785 [INFO]: coupled_global_plotting.py(make_plot_pdfs:586) >> Figure size=[675. 412.5]
2025-04-02 09:29:51,785 [INFO]: coupled_global_plotting.py(make_plot_pdfs:589) >> Plotting plot 0 on page 0. This is plot 0 in total.
2025-04-02 09:29:51,791 [INFO]: coupled_global_plotting.py(plot_generic:413) >> plot_generic for FSH, rgn=s
2025-04-02 09:29:54,149 [INFO]: coupled_global_plotting.py(make_plot_pdfs:554) >> make_plot_pdfs for rgn=s, component=ocn
2025-04-02 09:29:54,149 [INFO]: coupled_global.py(run:312) >> These s region plots generated successfully: ['TREFHT', 'FSH']
2025-04-02 09:29:54,149 [ERROR]: coupled_global.py(run:313) >> These s region plots could not be generated successfully: []
2025-04-02 09:29:54,175 [INFO]: coupled_global_viewer.py(create_viewer:39) >> Creating viewer for atm
2025-04-02 09:29:54,175 [INFO]: coupled_global_viewer.py(create_viewer:45) >> Adding group All Variables
2025-04-02 09:29:54,271 [INFO]: coupled_global.py(coupled_global:352) >> Viewer URL for atm: table_atm/index.html
2025-04-02 09:29:54,271 [INFO]: coupled_global_viewer.py(create_viewer:39) >> Creating viewer for lnd
2025-04-02 09:29:54,271 [INFO]: coupled_global_viewer.py(create_viewer:45) >> Adding group Energy Flux
2025-04-02 09:29:54,290 [INFO]: coupled_global.py(coupled_global:352) >> Viewer URL for lnd: table_lnd/index.html
2025-04-02 09:29:54,291 [INFO]: coupled_global_viewer.py(create_viewer_index:91) >> Creating viewer index
2025-04-02 09:29:54,293 [INFO]: coupled_global.py(coupled_global:366) >> Viewer index URL: global_time_series_1985-2014_results_performance/index.html
Copying global_time_series_1985-2014_results_performance to /lcrc/group/e3sm/public_html/diagnostic_output/ac.forsyth2/zi-test-webdir//global_time_series_1985-2014_results_performance
"""
parameters_performance: Parameters = Parameters(
{
"use_ocn": "False",
"input": "/lcrc/group/e3sm2/ac.wlin/E3SMv3/v3.LR.historical_0051",
"input_subdir": "archive/ocn/hist",
"moc_file": "mocTimeSeries_1985-2014.nc",
"case_dir": "/lcrc/group/e3sm/ac.forsyth2/E3SMv3_20250331_try2/v3.LR.historical_0051", # Note different case dir than the other Parameters objects in this file
"experiment_name": "v3.LR.historical_0051",
"figstr": "v3.LR.historical_0051",
"color": "Blue",
"ts_num_years": "30",
"plots_original": "None",
"plots_atm": "TREFHT",
"plots_ice": "None",
"plots_lnd": "FSH",
"plots_ocn": "None",
"nrows": "4",
"ncols": "2",
"results_dir": "global_time_series_1985-2014_results_performance", # Note different results dir than the other Parameters objects in this file
"regions": "glb,n,s",
"make_viewer": "True",
"start_yr": "1985",
"end_yr": "2014",
}
)


def generate_results(parameters: Parameters):
print(f"Generating results for {parameters.results_dir}")
Expand Down Expand Up @@ -181,4 +278,5 @@ def run_all_cases():
if __name__ == "__main__":
# TODO: Create actual pytest cases, including image comparison checks
# (See https://github.com/E3SM-Project/zppy-interfaces/issues/5)
run_all_cases()
# run_all_cases()
generate_results(parameters_performance)
Loading