Shared project folder on Perlmutter where users can pull historical data for restarts?

[etpalmer63]

Hi,

I'd like to ask if there is a shared project directory on Perlmutter where users can pull data for historical simulations? In particular, I'm assisting a user who wants to do a restart from dates like 1950-01-01 or 1980-01-01.

Thanks!

Erik Palmer
Software Integration Engineer
NERSC

[jingyizhuo]

Thanks Erik!

Just a quick supplement. I am looking for restart IC files for E3SMv2 with --res ne30pg2_EC30to60E2r2 --compset WCYCL20TR.

Thank you in advance!

Jingyi Zhuo
Postdoctoral Research Scientist
Lamont-Doherty Earth Observatory
Columbia University

[jacob-stu-allen]

Hello,

Stopping by to say that this would be really helpful to implement if it doesn't already exist or the current permissions don't allow for E3SM users (rather than devs) to access directories containing restarts from piControl/Historical scenarios.

Thanks,
Jacob

[chengzhuzhang]

Hello, the E3SM production simulations are archived on NERSC HPSS (where restart files are also included). Data locations and how to retrieve can be found here:

As far as I know, most simulations have restart files saved every 5 years. An example file directory path as follows:

archive/rest/1855-01-01-00000/

To extract the restart files on NERSC, it takes two steps:

1. To activate E3SM-Unified environment by:

source /global/common/software/e3sm/anaconda_envs/load_latest_e3sm_unified_pm-cpu.sh

2. To retrieve files with zstash command to get 1855 restart files:

zstash extract --hpss=/home/projects/e3sm/www/WaterCycle/E3SMv2/LR/v2.LR.historical_0101 "archive/rest/1855-01-01-00000/*"

The output from zstash extract command shown as follows:

(e3sm_unified_1.9.1rc1_login) chengzhu@perlmutter:login34:/global/cfs/cdirs/e3sm/zhang40/tests> zstash extract --hpss=/home/projects/e3sm/www/WaterCycle/E3SMv2/LR/v2.LR.historical_0101 "archive/rest/1855-01-01-00000/*" > out.txt
INFO: Transferring file from HPSS: zstash/00005b.tar
INFO: zstash/00005b.tar exists. Checking expected size matches actual size.
INFO: Opening tar archive zstash/00005b.tar
INFO: Extracting archive/rest/1855-01-01-00000/rpointer.atm
INFO: Extracting archive/rest/1855-01-01-00000/rpointer.drv
INFO: Extracting archive/rest/1855-01-01-00000/rpointer.ice
INFO: Extracting archive/rest/1855-01-01-00000/rpointer.lnd
INFO: Extracting archive/rest/1855-01-01-00000/rpointer.ocn
INFO: Extracting archive/rest/1855-01-01-00000/rpointer.rof
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.cpl.r.1855-01-01-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.eam.h0.1854-12.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.eam.h1.1854-12-07-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.eam.h2.1854-12-07-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.eam.h3.1854-12-07-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.eam.h4.1854-12-07-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.eam.h5.1854-12-07-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.eam.h6.1854-12.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.eam.i.1855-01-01-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.eam.r.1855-01-01-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.eam.rs.1855-01-01-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.elm.h0.1854-12.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.elm.h1.1855-01-01-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.elm.r.1855-01-01-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.elm.rh0.1855-01-01-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.elm.rh1.1855-01-01-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.mosart.r.1855-01-01-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.mosart.rh0.1855-01-01-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.mosart.rh1.1855-01-01-00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.mpaso.rst.1855-01-01_00000.nc
INFO: Extracting archive/rest/1855-01-01-00000/v2.LR.historical_0101.mpassi.rst.1855-01-01_00000.nc
INFO: No failures detected when extracting the files. If you have a log file, run "grep -i Exception <log-file>" to double check.

[jacob-stu-allen]

Fantastic - thank you!

[jingyizhuo]

This is really helpful! Thank you!