Skip to content

Commit accc5d9

Browse files
chengzhuzhangchengzhuzhang
committed
address review
1 parent cb81ca7 commit accc5d9

File tree

3 files changed

+16
-27
lines changed

3 files changed

+16
-27
lines changed

‎docs/source/AITraining/index.rst‎

Lines changed: 8 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,22 +1,24 @@
11
AI Training Datasets
22
====================
33

4-
The E3SM project and `Allen Institute for AI (Ai2) <https://allenai.org/>`_ work together to develop datasets for AI and machine learning applications. E3SMv2 and E3SMv3 have been processed by Ai2 to make them publicly accessible and easier to use for research purposes.
4+
The E3SM project and `Allen Institute for AI (Ai2) <https://allenai.org/>`_ have developed several datasets for AI and machine learning applications. These datasets have been postprocessed for ingestion by the `ACE <https://github.com/ai2cm/ace?tab=readme-ov-file#ai2-climate-emulator>`_/`FourCastNet <https://github.com/NVlabs/FourCastNet>`_ emulator.
55

66
Dataset Details
77
***************
88

9-
- **E3SMv2**: 73-year EAMv2 simulation (F2010, perpetual 2010 forcing, repeating annual SST cycle from 2005-2014 average). 6-hourly outputs: 42 years training, 10 years validation, 10 years test. More details see: `Duncan et al. 2024 <https://agupubs.onlinelibrary.wiley.com/doi/full/10.1029/2024JH000136>`_
9+
- **EAMv2**: 73-year EAMv2 simulation (F2010, perpetual 2010 forcing, repeating annual SST cycle from 2005-2014 average). 6-hourly outputs. More details see: `Duncan et al. 2024 <https://agupubs.onlinelibrary.wiley.com/doi/full/10.1029/2024JH000136>`_
1010

11-
- **E3SMv3**: 51-year EAMv3 AMIP-style simulation (1970-2020, F2010 with AMIP SSTs, constant 2010 CO2). Includes multiple ENSO cycles and global warming trend. More details see: `Wu et al. 2025 <https://agupubs.onlinelibrary.wiley.com/doi/10.1029/2025JH000774>`_
11+
- **EAMv3**: 51-year EAMv3 AMIP-style simulation (1970-2020, F2010 with AMIP SSTs, constant 2010 CO2). Includes multiple ENSO cycles and global warming trend. More details see: `Wu et al. 2025 <https://agupubs.onlinelibrary.wiley.com/doi/10.1029/2025JH000774>`_
12+
13+
- **E3SMv3**: Coupled pre-industrial and historical training data (coming soon)
1214

1315
- **SCREAMv1**: Simple Cloud-Resolving E3SM Atmosphere Model version 1 training data (coming soon)
1416

1517
.. tip::
16-
Check the ``archive_content`` text file to see files included in each tar archive. You can selectively download the files you need.
18+
Check the ``archive_contents`` text file to see files included in each tar archive. You can selectively download the files you need.
1719

18-
Table of AI training datasets
19-
******************************
20+
Data Access
21+
***********
2022

2123
.. toctree::
2224
:maxdepth: 2

‎docs/source/AITraining/simulation_data/index.rst‎

Lines changed: 1 addition & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -1,24 +1,7 @@
11
***************
2-
Simulation Data
2+
Simulation Data
33
***************
44

5-
6-
7-
Dataset Details
8-
***************
9-
10-
- **E3SMv2**: 73-year EAMv2 simulation (F2010, perpetual 2010 forcing, repeating annual SST cycle from 2005-2014 average). 6-hourly outputs: 42 years training, 10 years validation, 10 years test.
11-
12-
- **E3SMv3**: 51-year EAMv3 AMIP-style simulation (1970-2020, F2010 with AMIP SSTs, constant 2010 CO2). Includes multiple ENSO cycles and global warming trend.
13-
14-
- **SCREAMv1**: Simple Cloud-Resolving E3SM Atmosphere Model version 1 training data (coming soon)
15-
16-
.. tip::
17-
Check the ``archive_content`` text file to see files included in each tar archive. You can selectively download the files you need.
18-
19-
Table of AI training datasets
20-
******************************
21-
225
.. toctree::
236
:maxdepth: 2
247

‎docs/source/AITraining/simulation_data/simulation_table.rst‎

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,13 +5,17 @@ AI Training Datasets simulation table
55
+-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
66
| Dataset | Status | Data Size | HPSS Path | HPSS URL |
77
+===================================================================+=================+===========================================================================+===============================================================================+=====================================================================================================================+
8-
| **E3SMv2** | | | | |
8+
| **EAMv2** | | | | |
99
+-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
10-
| E3SMv2 AI Training Dataset | Available | 1.2T | /home/projects/e3sm/www/AI_training_data/e3sm-v2-climsst-180x360-gaussian | `Link <https://portal.nersc.gov/archive/home/projects/e3sm/www/AI_training_data/e3sm-v2-climsst-180x360-gaussian>`_ |
10+
| EAMv2 AI Training Dataset | Available | 1.2T | /home/projects/e3sm/www/AI_training_data/e3sm-v2-climsst-180x360-gaussian | `Link <https://portal.nersc.gov/archive/home/projects/e3sm/www/AI_training_data/e3sm-v2-climsst-180x360-gaussian>`_ |
11+
+-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
12+
| **EAMv3** | | | | |
13+
+-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
14+
| EAMv3 AI Training Dataset | Available | 1.3T | /home/projects/e3sm/www/AI_training_data/e3sm-v3-amip-180x360-gaussian | `Link <https://portal.nersc.gov/archive/home/projects/e3sm/www/AI_training_data/e3sm-v3-amip-180x360-gaussian>`_ |
1115
+-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
1216
| **E3SMv3** | | | | |
1317
+-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
14-
| E3SMv3 AI Training Dataset | Available | 1.3T | /home/projects/e3sm/www/AI_training_data/e3sm-v3-amip-180x360-gaussian | `Link <https://portal.nersc.gov/archive/home/projects/e3sm/www/AI_training_data/e3sm-v3-amip-180x360-gaussian>`_ |
18+
| E3SMv3 Coupled AI Training Dataset | Coming Soon | TBD | TBD | TBD |
1519
+-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
1620
| **SCREAMv1** | | | | |
1721
+-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+

0 commit comments

Comments
 (0)