-
Notifications
You must be signed in to change notification settings - Fork 54
Release 2.1.0
This page provides end user documentation for spack-stack-2.1.0 of 2026/02/27. The purpose of this document is mainly to provide information on using spack-stack environments on fully supported tier 1 platforms; certain additional information is included (e.g. known issues) that likely differs between releases of spack-stack. For all other information not covered here, refer to the Developer and advanced user docs.
Fully supported sites for this release are listed in the order of deployment. The spack-stack-2.1.0 release is deployed in subdirectory spack-stack-2.1.0 under the top-level spack-stack directory in the table on each of the systems.
TABLE NEEDS REVIEW
| Organization | System | Compilers | Location of top-level spack-stack directory | Maintainers |
|---|---|---|---|---|
| HPC systems | ||||
| NASA | Discover SCU17 | GCC, oneAPI | /gpfsm/dswdev/jcsda/spack-stack/scu17 |
JCSDA |
| NAS | GCC, oneAPI | /nobackup/gmao_SIteam/spack-stack |
NASA GMAO | |
| U.S. Navy (NRL) | Atlantis | GCC, oneAPI, LLVM | /gpfs/neptune/spack-stack |
NRL |
| U.S. Navy (HPCMP) | Blueback | GCC, oneAPI | /p/app/projects/NEPTUNE/spack-stack |
NRL |
| Narwhal | GCC, oneAPI | /p/app/projects/NEPTUNE/spack-stack |
NRL | |
| Nautilus | GCC, oneAPI | /p/app/projects/NEPTUNE/spack-stack |
NRL | |
| NOAA | Derecho | GCC, oneAPI | /glade/work/epicufsrt/contrib/spack-stack/derecho |
EPIC |
| Gaea-C6 | GCC, oneAPI | /ncrc/proj/epic/spack-stack/c6 |
EPIC | |
| Hercules | GCC, oneAPI | /apps/contrib/spack-stack |
EPIC | |
| Orion | oneAPI | /apps/contrib/spack-stack |
EPIC | |
| Ursa | GCC, oneAPI | /contrib/spack-stack |
EPIC | |
| Acorn | Intel Classic, oneAPI | /lfs/h1/emc/nceplibs/noscrub/spack-stack/ |
NOAA EMC | |
| Cloud platforms | ||||
| NOAA | Parallel Works AWS | GCC, oneAPI | /contrib/spack-stack-rocky9/ |
EPIC |
| NOAA | Parallel Works Azure | GCC, oneAPI | /contrib/spack-stack-rocky9/ |
EPIC |
| NOAA | Parallel Works Gcloud | GCC, oneAPI | not yet supported | EPIC |
| U.S. Navy (HPCMP) | HPCMP Parallel Works | not yet supported | NRL |
The following subsections describe the necessary commands to use spack-stack-2.1.0 environments on the respective platforms.
The following is required for using spack to build and run software with any of the compilers below.
GCC
module purge
module use /discover/swdev/gmao_SIteam/modulefiles-SLES15
module use /discover/swdev/jcsda/spack-stack/scu17/modulefiles
module use /gpfsm/dswdev/jcsda/spack-stack/scu17/spack-stack-2.1.0/envs/ue-gcc-13.4.0/modules/Core
module load stack-gcc/13.4.0
module load stack-openmpi/4.1.6
Intel oneAPI
module purge
module use /discover/swdev/gmao_SIteam/modulefiles-SLES15
module use /discover/swdev/jcsda/spack-stack/scu17/modulefiles
module use /gpfsm/dswdev/jcsda/spack-stack/scu17/spack-stack-2.1.0/envs/ue-oneapi-2024.2.0/modules/Core
module load stack-intel-oneapi-compilers/2024.2.0
module load stack-intel-oneapi-mpi/2021.13
The instructions below are for the NASA NAS facility for use on the Electra and Aitken machines. NOTE: These modules will NOT work on the new TOSS5-based Athena platform (aka the AMD Turin nodes) due to the different operating system and compiler environment.
GCC
module purge
module use /nobackup/gmao_SIteam/modulefiles
module use /nobackup/gmao_SIteam/spack-stack/spack-stack-2.1.0/envs/ue-gcc-13.4.0/modules/Core
module load stack-gcc/13.4.0
module load stack-openmpi/4.1.8
Intel oneAPI (ifort)
module purge
module use /nobackup/gmao_SIteam/modulefiles
module use /nobackup/gmao_SIteam/spack-stack/spack-stack-2.1.0/envs/ue-oneapi-2024.2.0/modules/Core
module load stack-intel-oneapi-compilers/2024.2.0
module load stack-mpt/2.30
Intel oneAPI (ifx)
module purge
module use /nobackup/gmao_SIteam/modulefiles
module use /nobackup/gmao_SIteam/spack-stack/spack-stack-2.1.0/envs/ue-oneapi-2025.3.0/modules/Core
module load stack-intel-oneapi-compilers/2025.3.0
module load stack-intel-oneapi-mpi/2021.17
The instructions below are for the NASA NAS facility for use on the Athena machines. NOTE: These modules will NOT work on the TOSS4-based platforms due to the different operating system and compiler environment.
GCC
module purge
module use /nobackup/gmao_SIteam/modulefiles-TOSS5
module use /nobackup/gmao_SIteam/spack-stack/spack-stack-2.1.0-TOSS5/envs/ue-gcc-14.2.1/modules/Core
module load PrgEnv-gnu/8.6.0
module load stack-gcc/14.2.1
module load stack-cray-mpich/8.1.33
Intel oneAPI (ifort)
module purge
module use /nobackup/gmao_SIteam/modulefiles-TOSS5
module use /nobackupp28/gmao_SIteam/spack-stack/spack-stack-2.1.0-TOSS5/envs/ue-oneapi-2024.2.0/modules/Core
module load comp-gcc/12.5.0
module load PrgEnv-intel/8.6.0
module load cray-mpich/8.1.33
module load stack-intel-oneapi-compilers/2024.2.0
module load stack-cray-mpich/8.1.33
Intel oneAPI (ifx)
module purge
module use /nobackup/gmao_SIteam/modulefiles-TOSS5
module use /nobackupp28/gmao_SIteam/spack-stack/spack-stack-2.1.0-TOSS5/envs/ue-oneapi-2025.3.0/modules/Core
module load comp-gcc/12.5.0
module load PrgEnv-intel/8.6.0
module load cray-mpich/8.1.33
module load stack-intel-oneapi-compilers/2025.3.0
module load stack-cray-mpich/8.1.33
The instructions below load the NEPTUNE/JEDI environment instead of the unified environment. For all compilers except LLVM, the unified environment can be loaded with the same instructions by replacing ne-<compiler>-<version> with ue-<compiler>-<version>.
GCC
module purge
module load slurm
module use /gpfs/neptune/spack-stack/gcc-13.4.0/modulefiles
module use /gpfs/neptune/spack-stack/openmpi-4.1.8/gcc-13.4.0/modulefiles
module use /gpfs/neptune/spack-stack/spack-stack-2.1.0/envs/ne-gcc-13.4.0/modules/Core
module load stack-gcc/13.4.0
module load stack-openmpi/4.1.8
Intel oneAPI
module purge
module load slurm
module load gcc/11.2.0
module use /gpfs/neptune/spack-stack/oneapi-2025.3.0/modulefiles
module use /gpfs/neptune/spack-stack/spack-stack-2.1.0/envs/ne-oneapi-2025.3.0/modules/Core
module load stack-intel-oneapi-compilers/2025.3.0
module load stack-intel-oneapi-mpi/2021.17
LLVM
module purge
module load slurm
module use /gpfs/neptune/spack-stack/llvm-21.1.0/modulefiles
module use /gpfs/neptune/spack-stack/openmpi-4.1.8/llvm-21.1.0/modulefiles
module use /gpfs/neptune/spack-stack/spack-stack-2.1.0/envs/ne-clang-21.1.0/modules/Core
module load stack-llvm/21.1.0
module load stack-openmpi/4.1.8
The Cylc environment ce-gcc-13.4.0 is available on this platform. See below for using it.
The instructions below load the NEPTUNE/JEDI environment instead of the unified environment. For all compilers, the unified environment can be loaded with the same instructions by replacing ne-<compiler>-<version> with ue-<compiler>-<version>.
GCC
module unload PrgEnv-cray
module load PrgEnv-gnu/8.6.0
module unload gcc-native
module load gcc-native/13.2
module unload craype-network-ofi
module load craype-network-ofi
module unload cray-mpich
module load cray-mpich/8.1.32
module load libfabric/1.22.0
module unload cray-libsci
module unload cray-pals
module unload cray-libpals
module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-2.1.0/envs/ne-gcc-13.3.0/modules/Core
module load stack-gcc/13.3.0
module load stack-cray-mpich/8.1.32
Intel oneAPI
module unload PrgEnv-cray
module load PrgEnv-intel/8.6.0
module unload intel
module load intel-oneapi/2025.0
module unload craype-network-ofi
module load craype-network-ofi
module unload cray-mpich
module load cray-mpich/8.1.32
module load libfabric/1.22.0
module unload cray-libsci
module unload cray-pals
module unload cray-libpals
module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-2.1.0/envs/ne-oneapi-2025.0.4/modules/Core
module load stack-intel-oneapi-compilers/2025.0.4
module load stack-cray-mpich/8.1.32
The Cylc environment ce-gcc-13.3.0 is available on this platform. See below for using it.
The instructions below load the NEPTUNE/JEDI environment instead of the unified environment. For all compilers, the unified environment can be loaded with the same instructions by replacing ne-<compiler>-<version> with ue-<compiler>-<version>.
GCC
module unload PrgEnv-cray
module load PrgEnv-gnu/8.5.0
module unload gcc
module load gcc-native/13.2
module unload craype-network-ofi
module load craype-network-ucx
module unload cray-mpich
module load cray-mpich-ucx/8.1.30
module load libfabric/1.22.0
module unload cray-libsci
module unload cray-pals
module unload cray-libpals
module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-2.1.0/envs/ne-gcc-13.3.0/modules/Core
module load stack-gcc/13.3.0
module load stack-cray-mpich/8.1.30
Intel oneAPI
module unload PrgEnv-cray
module load PrgEnv-intel/8.5.0
module unload intel
module load intel-oneapi/2024.2
module unload craype-network-ofi
module load craype-network-ucx
module unload cray-mpich
module load cray-mpich-ucx/8.1.30
module load libfabric/1.22.0
module unload cray-libsci
module unload cray-pals
module unload cray-libpals
module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-2.1.0/envs/ne-oneapi-2024.2.0/modules/Core
module load stack-intel-oneapi-compilers/2024.2.0
module load stack-cray-mpich/8.1.30
The Cylc environment ce-gcc-12.2.0 is available on this platform. See below for using it.
The instructions below load the NEPTUNE/JEDI environment instead of the unified environment. For all compilers, the unified environment can be loaded with the same instructions by replacing ne-<compiler>-<version> with ue-<compiler>-<version>.
GCC
module unload penguin/openmpi/4.1.6/aocc-4.0.0
module unload penguin/mpi-vars/aocc
module unload amd/aocl/aocc/4.0
module unload amd/aocc/4.0.0
module load slurm
module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-2.1.0/envs/ne-gcc-13.3.1/modules/Core
module load stack-gcc/13.3.1
module load stack-openmpi/5.0.8
Intel oneAPI
module unload penguin/openmpi/4.1.6/aocc-4.0.0
module unload penguin/mpi-vars/aocc
module unload amd/aocl/aocc/4.0
module unload amd/aocc/4.0.0
module load slurm
module use /p/app/projects/NEPTUNE/spack-stack/oneapi-2025.3.0/modulefiles
module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-2.1.0/envs/ne-oneapi-2025.3.0/modules/Core
module load stack-intel-oneapi-compilers/2025.3.0
module load stack-intel-oneapi-mpi/2021.17
The Cylc environment ce-gcc-13.3.1 is available on this platform. See below for using it.
The instructions below load the unified environment. Note that for Intel oneAPI, the oneAPI version is reported as 2025.3.1, but the internal compiler versions are 2025.3.2 by build tools like Cmake.
Intel oneAPI
module --force purge
module use /opt/cray/pe/modulefiles
module load crayenv/25.03
module use /glade/work/epicufsrt/contrib/spack-stack/derecho/installs/oneapi-2025.3.1/modulefiles
module use /glade/work/epicufsrt/contrib/spack-stack/derecho/spack-stack-2.1.0/envs/ue-oneapi-2025.3.1/modules/Core
module load stack-intel-oneapi-compilers/2025.3.1
module load stack-cray-mpich/8.1.32
module unload cray-libsci
GCC
module --force purge
module use /opt/cray/pe/modulefiles
module load crayenv/25.03
module use /glade/work/epicufsrt/contrib/spack-stack/derecho/spack-stack-2.1.0/envs/ue-gcc-13.3.1/modules/Core
module load stack-gcc/13.3.1
module load stack-cray-mpich/8.1.32
module unload cray-libsci
The instructions below load the unified environment.
GCC
module purge
module use /ncrc/proj/epic/spack-stack/c6/spack-stack-2.1.0/envs/ue-gcc-13.3.1/modules/Core
module load stack-gcc/13.3.1
module load stack-cray-mpich/8.1.32
Intel oneAPI
module purge
module use /ncrc/proj/epic/spack-stack/c6/spack-stack-2.1.0/envs/ue-oneapi-2025.2.1/modules/Core
module load stack-intel-oneapi-compilers/2025.2.1
module load stack-cray-mpich/8.1.32
The instructions below load the unified environment.
Intel oneAPI
module purge
module use /apps/contrib/spack-stack/modulefiles
module use /apps/contrib/spack-stack/spack-stack-2.1.0/envs/ue-oneapi-2025.3.1/modules/Core
module load stack-intel-oneapi-compilers/2025.3.1
module load stack-intel-oneapi-mpi/2021.17
The instructions below load the unified environment.
GCC
module purge
module use /apps/contrib/spack-stack/spack-stack-2.1.0/envs/ue-gcc-12.2.0/modules/Core
module load stack-gcc/12.2.0
module load stack-openmpi/4.1.4
Intel oneAPI
module purge
module use /apps/contrib/spack-stack/modulefiles
module use /apps/contrib/spack-stack/spack-stack-2.1.0/envs/ue-oneapi-2025.3.1/modules/Core
module load stack-intel-oneapi-compilers/2025.3.1
module load stack-intel-oneapi-mpi/2021.17
The instructions below load the unified environment.
GCC
module purge
module use /contrib/spack-stack/spack-stack-2.1.0/envs/ue-gcc-12.4.0/modules/Core
module load stack-gcc/12.4.0
module load stack-openmpi/4.1.6
Intel oneAPI / oneAPI MPI
module purge
module use /contrib/spack-stack/spack-stack-2.1.0/envs/ue-oneapi-2025.3.1/modules/Core
module load stack-intel-oneapi-compilers/2025.3.1
module load stack-intel-oneapi-mpi/2021.17
Intel oneAPI / HPC-X MPI
module purge
module use /contrib/spack-stack/spack-stack-2.1.0/envs/ue-oneapi-2025.3.1-hpcx/modules/Core
module load stack-intel-oneapi-compilers/2025.3.1
module load stack-hpcx-mpi/2.18.1
The instructions below are for loading the spack-stack unified environment and building software using Rocky9 ParallelWorks cluster, which was the Marketplace default at the moment of release of spack-stack-2.1.0. A filesystem storage nagapenonecaepiccontrib needs to be attached and mounted on /contrib.
Intel oneAPI (ifx)/ oneAPI MPI
module purge
export MODULES_AUTO_HANDLING=1
module use /pw/apps/modules/intel/2025.3.0
module use /contrib/spack-stack-rocky9/spack-stack-2.1/envs/ue-oneapi-2025.3.0/modules/Core
module load stack-intel-oneapi-compilers/2025.3.0
module load stack-intel-oneapi-mpi/2021.17
GCC
module purge
module use /contrib/spack-stack-rocky9/spack-stack-2.1/envs/ue-gcc-12.4.0/modules/Core
module load stack-gcc/12.4.0
module load stack-openmpi/4.1.6
The instructions below are for loading the spack-stack unified environment and building software using Rocky9 ParallelWorks cluster, which was the Marketplace default at the moment of release of spack-stack-2.1.0. A filesystem storage nfsazclusternoaav2use1 needs to be attached and mounted on /contrib.
Intel oneAPI (ifx)/ oneAPI MPI
module purge
export MODULES_AUTO_HANDLING=1
module use /pw/apps/modules/intel/2025.3.0
module use /contrib/spack-stack-rocky9/spack-stack-2.1/envs/ue-oneapi-2025.3.0/modules/Core
module load stack-intel-oneapi-compilers/2025.3.0
module load stack-intel-oneapi-mpi/2021.17
GCC
module purge
module use /contrib/spack-stack-rocky9/spack-stack-2.1/envs/ue-gcc-12.4.0/modules/Core
module load stack-gcc/12.4.0
module load stack-openmpi/4.1.6
spack-stack-2.1.0 is not yet supported on this platform.
# Intel 19.1.3.304:
module use /lfs/h1/emc/nceplibs/noscrub/spack-stack/spack-stack-2.1.0/envs/ue-intel-19.1.3.304/modules/Core
module load stack-intel-oneapi-compilers-classic/19.1.3.304
module load stack-cray-mpich/8.1.9
# Intel 19.1.3.304, without metamodules (flat module directory):
module use /lfs/h1/emc/nceplibs/noscrub/spack-stack/spack-stack-2.1.0/envs/ue-intel-19.1.3.304/modules_flat/Core
# oneAPI 2024.2.1:
module use /lfs/h1/emc/nceplibs/noscrub/spack-stack/spack-stack-2.1.0/envs/ue-oneapi-2024.2.1/modules/Core
module load stack-intel-oneapi-compilers/2024.2.1
module load stack-cray-mpich/8.1.29
# oneAPI 2024.2.1, without metamodules (flat module directory):
module use /lfs/h1/emc/nceplibs/noscrub/spack-stack/spack-stack-2.1.0/envs/ue-oneapi-2024.2.1/modules_flat/CoreNone yet.
Instructions for special environments are provided here.
The use of the Cylc environment is described here.
| Package name | Version |
|---|---|
| awscli-v2 | 2.24.24 |
| bacio | 2.6.0 |
| bison | 3.8.2 |
| boost | 1.84.0 |
| bufr | 12.1.0 |
| bufr-query | 0.0.5 |
| cdo | 2.5.2 |
| cloc | 2.00 |
| cmake | 3.31.8 |
| codee | 2025.4.7 |
| cprnc | 1.0.8 |
| crtm | v2.4.1-jedi.2 |
| crtm | 3.1.3 |
| curl | 8.11.1 |
| ecbuild | 3.12.0 |
| eccodes | 2.33.0 |
| ecflow | 5.11.4 |
| eckit | 1.32.3 |
| ecmwf-atlas | 0.44.1 |
| ectrans | 1.7.0 |
| eigen | 3.4.0 |
| esmf | 8.6.1 |
| esmf | 8.8.0 |
| esmf | 8.9.1 |
| fargparse | 1.10.0 |
| fckit | 0.14.1 |
| fiat | 1.6.1 |
| flex | 2.6.4 |
| fms geos-constants | 2025.03 |
| fms gfs-constants | 2025.03 |
| g2 | 3.5.1 |
| g2tmpl | 1.17.0 |
| gfsio | 1.4.2 |
| gftl-shared | 1.11.0 |
| gh | 2.74.2 |
| git | 2.35.3 |
| git-lfs | 3.3.0 |
| grib-util | 1.4.0 |
| gsi-ncdiag | 1.1.2 |
| gsibec | 1.4.2 |
| gsl-lite | 0.41.0 |
| hdf | 4.2.15 |
| hdf5 | 1.14.5 |
| intel-oneapi-mkl | 2025.0 |
| ip | 5.4.0 |
| jasper | 4.2.4 |
| jedi-cmake | 1.4.0 |
| landsfcutil | 2.4.2 |
| libpng | 1.6.37 |
| libyaml | 0.2.5 |
| mapl | 2.53.0 |
| mapl | 2.53.4 |
| mct | 2.11.0 |
| mepo | 2.4.0 |
| met | 12.1.1 |
| metis | 5.1.0 |
| metplus | 6.1.0 |
| nccmp | 1.9.0.1 |
| ncio | 1.1.2 |
| nco | 5.3.3 |
| ncview | 2.1.9 |
| nemsio | 2.5.5 |
| nemsiogfs | 2.5.4 |
| netcdf-c | 4.9.2 |
| netcdf-cxx4 | 4.3.1 |
| netcdf-fortran | 4.6.1 |
| nlohmann-json | 3.11.3 |
| nlohmann-json-schema-validator | 2.3.0 |
| numactl | 2.0.18 |
| odc | 1.6.1 |
| p4est | 2.8.7 |
| parallel-netcdf | 1.12.3 |
| parallelio | 2.6.2 |
| perl | 5.26.1 |
| pflogger | 1.17.0 |
| pfunit | 4.15.0 |
| prod-util | 2.1.2 |
| py-arch | 7.0.0 |
| py-boto3 | 1.34.162 |
| py-cartopy | 0.24.1 |
| py-cfgrib | 0.9.14.1 |
| py-cftime | 1.6.4 |
| py-click | 8.1.8 |
| py-contourpy | 1.3.0 |
| py-cython | 0.29.36 |
| py-cython | 3.0.12 |
| py-dask | 2022.10.2 |
| py-eccodes | 1.5.0 |
| py-f90nml | 1.4.3 |
| py-fortranformat | 2.0.0 |
| py-gitpython | 3.1.43 |
| py-globus-cli | 3.16.0 |
| py-h5py | 3.10.0 |
| py-jinja2 | 3.1.4 |
| py-matplotlib | 3.7.4 |
| py-netcdf4 | 1.7.2 |
| py-numpy | 1.26.4 |
| py-pandas | 2.3.1 |
| py-pip | 25.1.1 |
| py-pkgconfig | 1.4.0 |
| py-pybind11 | 2.13.6 |
| py-pycodestyle | 2.11.0 |
| py-pyhdf | 0.11.4 |
| py-pytest | 8.2.1 |
| py-python-dateutil | 2.8.2 |
| py-pyyaml | 6.0.2 |
| py-regionmask | 0.12.1 |
| py-requests | 2.32.3 |
| py-ruamel-yaml | 0.17.16 |
| py-ruamel-yaml-clib | 0.2.12 |
| py-scipy | 1.16.0 |
| py-setuptools | 69.2.0 |
| py-setuptools-scm | 8.2.1 |
| py-urllib3 | 1.26.20 |
| py-wheel | 0.45.1 |
| py-wxflow | 0.2.0 |
| py-xarray | 2024.7.0 |
| python | 3.11.11 |
| rank-run | 1.0.0 |
| scotch | 7.0.10 |
| sfcio | 1.4.2 |
| sigio | 2.3.3 |
| udunits | 2.2.28 |
| uwtools | 2.7.2 |
| w3emc | 2.13.0 |
| w3nco | 2.4.1 |
| wget | 1.20.3 |
| wgrib2 | 3.8.0 |
| wrf-io | 1.3.0 |
| zlib | 1.2.13 |
Versions taken from blueback:/p/work1/projects/NEPTUNE/spack-stack/spack-stack-2.1.0/envs/ue-oneapi-2025.0.4
Issues specific to this release of spack-stack are summarized below. Please also consult the Known Issues in the developer and advanced user docs.