Commit ad2c9cc
trees_gene_groups STEP_2: embed RUN_TAG in SLURM JobName for tier distinguishability
Both gene_groups-COPYME and gene_groups_hgnc-COPYME STEP_2 RUN-workflow.sh
hardcoded the SLURM JobName as
s2_${tier}_blk_NN (slurm-burst)
s2_${tier}_${gg} (slurm-standard)
where ${tier} is the internal small-vs-large split WITHIN one PARENT_RUN_NAME.
When a user runs the same STEP_2 workflow as multiple sibling RUN dirs
(e.g. workflow-RUN_1-tier_small_le1000 / workflow-RUN_2-tier_medium_le5000
/ workflow-RUN_3-tier_large_le10000, each pinned to large_threshold above
all entries so everything bins to "small"), all three dispatches produced
identical-looking JobNames (`s2_small_blk_NN`) — squeue couldn't visually
distinguish which RUN dir launched which job.
Manifested 2026-05-26: 57 + 97 + 41 = 195 hugo_hgnc STEP_2 jobs all queued
as `s2_small_blk_NN`, requiring scontrol show job + WorkDir inspection to
attribute each back to its source RUN. The 195 in-queue jobs were
renamed in-place via `scontrol update JobName=...` to confirm the new
scheme works visually (57 s2_RUN_1_small_blk_NN, 97 s2_RUN_2_small_blk_NN,
41 s2_RUN_3_small_blk_NN).
Fix: derive RUN_TAG from PARENT_RUN_NAME via
RUN_TAG=$( echo "${PARENT_RUN_NAME}" \
| sed -n 's|^workflow-\(RUN_[0-9]\+\).*|\1|p' )
RUN_TAG="${RUN_TAG:-RUN}"
and embed it: `s2_${RUN_TAG}_${tier}_blk_NN`. Falls back to literal "RUN"
if the parent dir doesn't match the canonical workflow-RUN_<N>-* pattern
(no behavioral regression for non-standard names). Applied uniformly to
both slurm-burst (block_name) and slurm-standard (std_name + --output)
codepaths.
Same fix also propagated into the three in-flight hugo_hgnc RUN dirs
(gitignored research instance) so any re-dispatch picks up the corrected
naming without needing to re-cp from COPYME.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>1 parent dbe8d89 commit ad2c9cc
16 files changed
Lines changed: 22 additions & 6 deletions
File tree
- gigantic_project-COPYME/subprojects
- annotations_hmms
- BLOCK_build_annotation_database
- workflow-COPYME-build_annotation_database/ai
- BLOCK_deeploc
- workflow-COPYME-run_deeploc/ai
- BLOCK_interproscan
- workflow-COPYME-run_interproscan/ai
- BLOCK_metapredict
- workflow-COPYME-run_metapredict/ai
- BLOCK_signalp
- workflow-COPYME-run_signalp/ai
- BLOCK_tmbed
- workflow-COPYME-run_tmbed/ai
- research_notebook
- trees_gene_groups
- gene_groups-COPYME/STEP_2-phylogenetic_analysis/workflow-COPYME-phylogenetic_analysis
- gene_groups_hgnc-COPYME/STEP_2-phylogenetic_analysis/workflow-COPYME-phylogenetic_analysis
0 commit comments