Skip to content

Snakemake pipeline fixes and downstream data updates from PR #166#197

Draft
elewis2 wants to merge 1 commit into
developfrom
feat/ucalgary-snakemake-fixes
Draft

Snakemake pipeline fixes and downstream data updates from PR #166#197
elewis2 wants to merge 1 commit into
developfrom
feat/ucalgary-snakemake-fixes

Conversation

@elewis2

@elewis2 elewis2 commented Jun 4, 2026

Copy link
Copy Markdown
Collaborator
  • Replace dedent/cd/wget pattern with curl --create-dirs throughout Snakefile to fix silent failures where shell sections would exit without running commands
  • Update Ensembl download to use may2025.archive.ensembl.org (main site broken) and move query string to download_ensembl_curl_config.txt
  • Update CGI biomarkers download URL (changed upstream, no longer zipped)
  • Add Dockerfile.snakemake: multi-stage build with npm rebuild to fix Node version compilation issues with native deps (node-expat/xml-stream)
  • Add downloadCosmic.sh helper script for COSMIC download auth flow
  • Fix fdaSrs/index.js: UNII file header renamed 'PT' -> 'Display Name' upstream, causing all 168k records to be skipped silently

- Replace dedent/cd/wget pattern with curl --create-dirs throughout Snakefile
  to fix silent failures where shell sections would exit without running commands
- Update Ensembl download to use may2025.archive.ensembl.org (main site broken)
  and move query string to download_ensembl_curl_config.txt
- Update CGI biomarkers download URL (changed upstream, no longer zipped)
- Add Dockerfile.snakemake: multi-stage build with npm rebuild to fix Node
  version compilation issues with native deps (node-expat/xml-stream)
- Add downloadCosmic.sh helper script for COSMIC download auth flow
- Fix fdaSrs/index.js: UNII file header renamed 'PT' -> 'Display Name' upstream,
  causing all 168k records to be skipped silently
- Update data/signatures.json: add sourceIdVersion '3' to all COSMIC signatures
  (DBS/ID/SBS series) and add name field for proper versioned record lookup

Co-authored-by: Matthew Stuart-Edwards <m.stuartedwards@uleth.ca>
@elewis2 elewis2 force-pushed the feat/ucalgary-snakemake-fixes branch from 7a30031 to 1f01e75 Compare June 4, 2026 18:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant