diff --git a/docs/source/AITraining/index.rst b/docs/source/AITraining/index.rst new file mode 100644 index 0000000..f42b9b1 --- /dev/null +++ b/docs/source/AITraining/index.rst @@ -0,0 +1,26 @@ +AI Training Datasets +==================== + +The E3SM project and `Allen Institute for AI (Ai2) `_ have developed several datasets for AI and machine learning applications. These datasets have been postprocessed for ingestion by the `ACE `_/`FourCastNet `_ emulator. + +Dataset Details +*************** + +- **EAMv2**: 73-year EAMv2 simulation (F2010, perpetual 2010 forcing, repeating annual SST cycle from 2005-2014 average). 6-hourly outputs. More details see: `Duncan et al. 2024 `_ + +- **EAMv3**: 51-year EAMv3 AMIP-style simulation (1970-2020, F2010 with AMIP SSTs, constant 2010 CO2). Includes multiple ENSO cycles and global warming trend. More details see: `Wu et al. 2025 `_ + +- **E3SMv3**: Coupled pre-industrial and historical training data (coming soon) + +- **SCREAMv1**: Simple Cloud-Resolving E3SM Atmosphere Model version 1 training data (coming soon) + +.. tip:: + Check the ``archive_contents`` text file to see files included in each tar archive. You can selectively download the files you need. + +Data Access +*********** + +.. toctree:: + :maxdepth: 2 + + simulation_data/simulation_table \ No newline at end of file diff --git a/docs/source/AITraining/simulation_data/index.rst b/docs/source/AITraining/simulation_data/index.rst new file mode 100644 index 0000000..be7a57d --- /dev/null +++ b/docs/source/AITraining/simulation_data/index.rst @@ -0,0 +1,8 @@ +*************** +Simulation Data +*************** + +.. toctree:: + :maxdepth: 2 + + simulation_table \ No newline at end of file diff --git a/docs/source/AITraining/simulation_data/simulation_table.rst b/docs/source/AITraining/simulation_data/simulation_table.rst new file mode 100644 index 0000000..787a8c7 --- /dev/null +++ b/docs/source/AITraining/simulation_data/simulation_table.rst @@ -0,0 +1,23 @@ +******************************************** +AI Training Datasets simulation table +******************************************** + ++-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+ +| Dataset | Status | Data Size | HPSS Path | HPSS URL | ++===================================================================+=================+===========================================================================+===============================================================================+=====================================================================================================================+ +| **EAMv2** | | | | | ++-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+ +| EAMv2 AI Training Dataset | Available | 1.2T | /home/projects/e3sm/www/AI_training_data/e3sm-v2-climsst-180x360-gaussian | `Link `_ | ++-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+ +| **EAMv3** | | | | | ++-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+ +| EAMv3 AI Training Dataset | Available | 1.3T | /home/projects/e3sm/www/AI_training_data/e3sm-v3-amip-180x360-gaussian | `Link `_ | ++-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+ +| **E3SMv3** | | | | | ++-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+ +| E3SMv3 Coupled AI Training Dataset | Coming Soon | TBD | TBD | TBD | ++-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+ +| **SCREAMv1** | | | | | ++-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+ +| SCREAMv1 AI Training Dataset | Coming Soon | TBD | TBD | TBD | ++-------------------------------------------------------------------+-----------------+---------------------------------------------------------------------------+-------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+ diff --git a/docs/source/index.rst b/docs/source/index.rst index 51de892..ba47ee6 100644 --- a/docs/source/index.rst +++ b/docs/source/index.rst @@ -21,6 +21,7 @@ simulations. v3/index SCREAMv0/index SCREAMv1/index + AITraining/index