Skip to content

Understanding Toil temporary directories

Ian edited this page Dec 11, 2019 · 4 revisions

Here are all of the current arguments related to input / output / temporary directories used by Toil and cwltool:


cwltool:

--outdir - Final outputs directory

--tmpdir-prefix - This is a prefix for folders that do not yet exist, but will be used as intermediate working directories

--tmp-outdir-prefix - This is a prefix for folders that do not yet exist, but will be used as intermediate output directories


toil-cwl-runner:

--workDir - This is the folder that will be set as the working directory for all tools running in the workflow (defaults to TMPDIR if not set)

(I assume this overrides the cwltool --tmpdir-prefix and --tmp-outdir-prefix, but I'm not sure)

--outDir - This is the folder that the final outputs of the workflow will be copied to once it is completed

(I assume this overrides the cwltool --outdir)

--jobstore - This is the folder where all state tracking information for the jobs in the workflow is kept, including stats records

Why are these options for toil-cwl-runner?

--tmp-outdir-prefix - ??

--tmpdir-prefix - ??

Clone this wiki locally