Repository navigation
Fugaku mpich-sr workflow, updated CWL conformance tests - #35
Merged
Merged
Conversation
Closed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #34
This PR updates the PJM CWL v1.0 Conformance Tests, and adds the MPICH-sr workflow logs for Fugaku. All with cwltool only.
Re-ran the CWL v1.0 conformance tests using an interactive PJM allocation.
MPICH-sr workflow from the thesis was executed successfully on Fugaku without containers.
With Singularity,
cwltoolissuessingularity pull --forcefor the image in the PJM node, which seems to havesetuidor some other command/access restricted. Maybe building/converting Docker containers on PJM is not allowed (quite common in HPCs).There may still have a way to instruct cwltool to use a pre-downloaded image and the workflow to succeed that way, or to run without pulling images, but I did not have time to try that (the last job finished near 2AM last night 😪 ).
The results are looking really good, and so far there are no real technical barriers for using cwltool on Fugaku, IMHO.
I will update the CWL Conformance Test README in another pull request, where I will try to add a Changelog too, to keep track of changes since the thesis publication.