Skip to content

Commit fc42f62

Browse files
committed
Disable automatic workdir cleanup
This should make it easier to run two-step pipelines and troubleshoot.
1 parent ba7c3aa commit fc42f62

File tree

2 files changed

+3
-3
lines changed

2 files changed

+3
-3
lines changed

conf/vsc_calcua.config

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -20,8 +20,8 @@ params.vsc_calcua_scratchdir = System.getenv("VSC_SCRATCH") ?: "/tmp"
2020
// Specify the work directory. Can be overwritten via the cli flag `-work-dir`.
2121
workDir = "${params.vsc_calcua_scratchdir}/work"
2222

23-
// Perform work directory cleanup when the run has succesfully completed.
24-
cleanup = true
23+
// Do not perform work directory cleanup when the run has succesfully completed - makes it easier to run two-step pipelines
24+
cleanup = false
2525

2626
// Check if environment variables for singularity/apptainer/nextflow cache and tmp dirs are set:
2727
// - APPTAINER_TMPDIR/SINGULARITY_TMPDIR (warn if missing, apptainer defaults to $TMPDIR or /tmp)

docs/vsc_calcua.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -146,7 +146,7 @@ nextflow run nf-core/rnaseq \
146146
147147
By default, Nextflow stores all of the intermediate files required to run the pipeline in the `work` directory. The default work directory is set to `$VSC_SCRATCH/work` in this config.
148148
149-
It is generally recommended to delete this directory after the pipeline has finished successfully, because it can grow quite large, and all of the main output files will be saved in the `results/` directory anyway. That's why this config contains a `cleanup` command that removes the `work` directory automatically once the pipeline has completed successfully.
149+
It is generally recommended to delete this directory after the pipeline has finished successfully, because it can grow quite large, and all of the main output files will be saved in the `results/` directory anyway. However, note that this config does no longer include the `cleanup=true` command since this can also intervene in two-step pipelines or make it more difficult to troubleshoot. You can create a custom config file and add it to your runs to re-enable this behaviour.
150150
151151
If the run does not complete successfully, then the `work` directory is not deleted and pipelines can be re-submitted using the `-resume` flag to re-use any cached files. If runs are abandoned, the directory should be cleaned manually to save storage space.
152152

0 commit comments

Comments
 (0)