Skip to content

Conversation

@ax3l
Copy link
Member

@ax3l ax3l commented Oct 15, 2025

Add CPU-only instructions for Tuolumne at LLNL.
This is mostly for development, because this is not using the GPU-part of the APU.

For both GPU and CPU builds: Add support for a self-built HDF5 (system module went missing), self-built PETSC, and document signal handling.

Preview.

  • draft
  • install: tested
  • runtime: tested
  • fix many-thread issue with TLS
  • add HDF5
  • add PETSC
  • document signal usage flux run --signal=SIGUSR1@120s --exclusive ... (only works if in flux run ... command, not the script comments)

@ax3l ax3l added component: documentation Docs, readme and manual machine / system Machine or system-specific issue labels Oct 15, 2025
Add CPU-only instructions for Tuolumne at LLNL.
This is mostly for development, because this is not using the GPU-part
of the APU.
@ax3l ax3l changed the title [WIP] Tuolumne (LLNL): CPU-Only Tuolumne (LLNL): CPU-Only Oct 15, 2025
@ax3l ax3l marked this pull request as ready for review October 15, 2025 19:11
@ax3l ax3l requested a review from EZoni October 15, 2025 19:12
Copy link
Contributor

@JustinRayAngus JustinRayAngus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

ax3l added 5 commits October 17, 2025 14:13
Try to delay the on-set of the error:
```
./warpx.3d: error while loading shared libraries:
    /opt/cray/pe/lib64/libsci_cray_mp.so.6:
        cannot allocate memory in static TLS block
```
Bring Your Own HDF5
@ax3l ax3l changed the title Tuolumne (LLNL): CPU-Only Tuolumne (LLNL): CPU-Only, HDF5, PETSC, Signal Handlijng Oct 18, 2025
@ax3l ax3l changed the title Tuolumne (LLNL): CPU-Only, HDF5, PETSC, Signal Handlijng Tuolumne (LLNL): CPU-Only, HDF5, PETSC, Signal Handling Oct 18, 2025
@ax3l ax3l requested review from JustinRayAngus and debog October 18, 2025 06:44
@ax3l
Copy link
Member Author

ax3l commented Oct 19, 2025

@debog @WeiqunZhang for next week, let's try if this works well to integrate PETSC solvers im AMReX/WarpX. Happy to help add it to PM (NERSC), too.

@ax3l ax3l requested a review from WeiqunZhang October 19, 2025 18:40
@ax3l ax3l merged commit edbc4da into BLAST-WarpX:development Oct 20, 2025
46 checks passed
@ax3l ax3l deleted the topic-tuo-cpu branch October 20, 2025 18:35
@ax3l ax3l mentioned this pull request Oct 20, 2025
ax3l pushed a commit that referenced this pull request Nov 24, 2025
Use the absolute path to 'petsc' directory in tuolumne install scripts.
The relative path to 'petsc' fails when the current working directory is
not SRC_DIR.

Follow-up to #6270
else
git clone -b v3.24.0 https://gitlab.com/petsc/petsc.git ${SRC_DIR}/petsc
fi
cd petsc
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Forgot the

Suggested change
cd petsc
cd ${SRC_DIR}/petsc

Fixed via #6410

else
git clone -b v3.24.0 https://gitlab.com/petsc/petsc.git ${SRC_DIR}/petsc
fi
cd petsc
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Forgot the

Suggested change
cd petsc
cd ${SRC_DIR}/petsc

Fixed via #6410

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

component: documentation Docs, readme and manual machine / system Machine or system-specific issue

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants