Skip to content

Update test resources - #24

Merged
dorien-er merged 13 commits into
mainfrom
update-test-resources
Jul 7, 2026
Merged

Update test resources#24
dorien-er merged 13 commits into
mainfrom
update-test-resources

Conversation

@dorien-er

Copy link
Copy Markdown
Contributor

No description provided.

dorien-er and others added 11 commits July 2, 2026 15:48
The build reusable-workflow call passed
`github.event_name == 'schedule' || inputs.push_containers` to a
boolean input. On a push event `inputs` is empty, so the expression
resolved to null and failed workflow-call validation at startup,
which is why the build job never ran and integration_test was skipped.
Treat push like schedule so the value is always a real boolean.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Phase 2 built the docker image with tag 'main_build' whenever the
top-level event was a push, but the push step tags it with the
version input ('integration_build'), so the build/push tags diverged
and the push failed. github.event_name reflects the top-level event,
which is 'push' when integration-test triggers main-build from a
branch push. Guard the 'main_build' tag with !is_workflow_call so a
called build uses the provided target_tag, keeping direct pushes to
main unchanged.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@dorien-er
dorien-er requested a review from jakubmajercik July 7, 2026 10:53
Comment on lines 67 to +69
aws s3 sync \
"$OUT" \
s3://openpipelines-bio/openpipeline_incubator/resources_test/"$ID" \
--exclude "*.yaml" \
resources_test/reference_gencodev41_chr1 \
s3://openpipelines-bio/openpipeline_composed/resources_test/reference_gencodev41_chr1 \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would it make sense to keep only one copy of a reference or is the idea to keep as much separation as possible? openpipeline_qc also generates it and stores to s3://openpipelines-bio/openpipeline_qc/resources_test/cellranger/ref_gencodev41_chr1

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is indeed to keep it as separate as possible, and have each package refer to their own test data bucket. To avoid futures in the issues, if changes are made to a test resources in one package, it becomes nearly impossible to check in a structured way what the impact is in other packages.

Comment thread CHANGELOG.md Outdated
Comment thread resources_test_scripts/reference_gencodev41.sh Outdated
dorien-er and others added 2 commits July 7, 2026 13:48
Co-authored-by: Jakub Majercik <57993790+jakubmajercik@users.noreply.github.com>
Co-authored-by: Jakub Majercik <57993790+jakubmajercik@users.noreply.github.com>
@dorien-er
dorien-er requested a review from jakubmajercik July 7, 2026 11:48
@dorien-er
dorien-er merged commit 7f84a73 into main Jul 7, 2026
2 checks passed
@dorien-er
dorien-er deleted the update-test-resources branch July 7, 2026 13:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants