Flow chart of Pipeline Functionality #149
Description
Describe the science task
We would like to make a flow chart of how data moves through and is transformed by the pipeline. This makes keeping track of the logic easier, and also makes catching mistakes or places for improvement easier.
Proposed Direction
I think narrowing the flow chart down to keeping track of what we are doing programmatically to the data, and what we are adding on. Another option is to keep track of logical steps taken in order to transform data. These could be in the same chart but starting on one makes things easier.
Desired Results
A good understanding of the pipeline, and where we can make improvements. This is also a good visualization for presentations and papers
Resources
The current version of the pipeline.