Skip to content

Commit 6fbc46d

Browse files
docs: give OpenLineage its due as a widely-adopted lineage standard
OpenLineage is the broadly-adopted open standard for lineage interchange across the data-tooling ecosystem. Frame it accordingly in the landscape, and cite it (alongside W3C PROV) as an export target in the interoperability section. Vendor-neutral — no commercial products named.
1 parent c0a252c commit 6fbc46d

1 file changed

Lines changed: 7 additions & 5 deletions

File tree

src/explanation/comparison-to-provenance-systems.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -8,9 +8,10 @@ and they interoperate rather than compete.
88

99
## The landscape
1010

11-
Dedicated provenance systems — the W3C **PROV** standard, OpenLineage, and the
12-
lineage features built into data catalogs and governance tools — record
13-
provenance as **metadata *about* data**. Derivation is captured during or after
11+
Dedicated provenance systems — the W3C **PROV** model, **OpenLineage** (a widely
12+
adopted open standard for lineage interchange across the data-tooling
13+
ecosystem), and the lineage features built into data catalogs and governance
14+
tools — record provenance as **metadata *about* data**. Derivation is captured during or after
1415
execution and stored alongside the data as logs, tags, or sidecar records;
1516
questions about where a result came from are answered by reading that recorded
1617
metadata.
@@ -64,8 +65,9 @@ provenance system.
6465

6566
The two approaches are complementary. DataJoint's lineage is internal to the
6667
pipeline and expressed in its own schema; for interchange with external
67-
governance, audit, and cataloging systems that speak industry provenance
68-
standards such as W3C PROV, that lineage can be exported. Compliance with
68+
governance, audit, and cataloging systems that speak industry lineage and
69+
provenance standards such as OpenLineage or W3C PROV, that lineage can be
70+
exported. Compliance with
6971
industry provenance standards is ensured by the DataJoint Platform.
7072

7173
## See also

0 commit comments

Comments
 (0)