Skip to content

Commit 5dcfd27

Browse files
data-pipelines: consolidate to four modules for a more substantial collapse
Subject moves into lab; Session references User directly; Scan and ScanInfo move into session. Twelve tables collapse to four nodes, with two boundaries (lab→session, session→imaging) each bundling two foreign keys into one heavier edge.
1 parent f6551a9 commit 5dcfd27

3 files changed

Lines changed: 144 additions & 196 deletions

File tree

src/explanation/data-pipelines.md

Lines changed: 6 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -30,16 +30,18 @@ pipeline can be viewed at either one.
3030
**Module level — the collapsed view.** Each node is a Python module, which corresponds to a
3131
database schema. Each edge represents a bundle of dependencies: the foreign key references
3232
between tables of the two schemas, together with the Python import dependency between their
33-
modules. A heavier edge carries a larger bundle — below, the `scan → imaging` edge bundles
34-
two separate foreign keys, and `reference` supplies both `scan` and `imaging`.
33+
modules. A heavier edge carries a larger bundle — below, the `lab → session` and
34+
`session → imaging` edges each bundle two separate foreign keys, and `reference` supplies
35+
both `session` and `imaging`. Twelve tables collapse to four nodes.
3536

3637
![Pipeline DAG at the module level](../images/pipeline-modules-collapsed.svg)
3738

3839
**Table level — the expanded view.** Each node is a table; the dashed clusters group the
3940
tables of each module. Each edge is an individual foreign key constraint — the two foreign
40-
keys that cross the `scan → imaging` boundary (`Scan → ScanQuality` and
41+
keys that cross the `session → imaging` boundary (`Scan → ScanQuality` and
4142
`ScanInfo → MotionCorrection`) appear separately here, having collapsed into the single
42-
bundled edge above.
43+
bundled edge above; likewise `Subject → Session` and `Session → User` across
44+
`lab → session`.
4345

4446
![Pipeline DAG at the table level](../images/pipeline-modules.svg)
4547

src/images/pipeline-modules-collapsed.svg

Lines changed: 49 additions & 93 deletions
Loading

0 commit comments

Comments
 (0)