ci: add nightly job to sync source mirror with pkgs in builtin - #6069
Open
alecbcs wants to merge 1 commit into
Open
ci: add nightly job to sync source mirror with pkgs in builtin#6069alecbcs wants to merge 1 commit into
alecbcs wants to merge 1 commit into
Conversation
Signed-off-by: Alec Scott <alec@llnl.gov>
alecbcs
requested review from
alalazo,
haampie and
kwryankrattiger
as code owners
August 12, 2026 22:22
scheibelp
requested changes
Aug 13, 2026
scheibelp
left a comment
Member
There was a problem hiding this comment.
Other points (not requests for this PR):
- (request for later) If a patch/resource is dropped, this doesn't catch that: if we already placed the "main" version tarball in a mirror, and a resource was missed, then this job will also miss that (I see though that patches/resources generally are included, just not in this rare case). I think this can be addressed later.
- (not a request) What about wrong checksums (i.e. if someone specifies the wrong checksum for a version)? I think the behavior would be OK: this script will collect every wrong checksum, download the version (which should fail, but
spack mirrorgenerally proceeds on in this case). We'd want to clean those up though.
|
|
||
| # output specs one per line for use by `spack mirror create` | ||
| for spec in specs_to_output: | ||
| print(spec) |
Member
There was a problem hiding this comment.
Request: limit this to something like 100-500 and print a warning if we go over that (tty.warn? something that prints to stderr)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add a minimal nightly GitHub Actions CI/CD job that compares the state of the package repository to the mirrored source cache and mirrors any artifacts that are missing from the cache. (As of the time of posting there are 439 missing package versions that would be uploaded by this workflow.)
Will need to work with @kwryankrattiger and @jjnesbitt before merging to update the OIDC rules in AWS to allow this new workflow.