Skip to content

Commit 8df3277

Browse files
committed
MAG L1C yaml: drop the superseded date_range placeholder
The previous day's file is delivered by custom_behavior/mag.py (and is the previous day's L1C, not norm L1B), so the inert date_range entries and their do-not-merge notes are gone; each L1C job now carries a comment pointing at the custom behavior and why the input is not declared here.
1 parent 933d2ff commit 8df3277

1 file changed

Lines changed: 8 additions & 26 deletions

File tree

sds_data_manager/orchestration/dependencies/imap_mag_dependencies.yaml

Lines changed: 8 additions & 26 deletions
Original file line numberDiff line numberDiff line change
@@ -134,26 +134,17 @@
134134
descriptor: norm-mago
135135
major_version: 1
136136

137+
# custom_behavior/mag.py also delivers the previous day's L1C to this job
138+
# (MAG SDC Data Validation 4.3.3 time inheritance; imap_processing issue
139+
# 2925). It is not declared as an input here because that would put a
140+
# self-cycle in the Dagster asset graph.
137141
(l1c, norm-magi):
138142
partition: daily
139143
inputs:
140144
- source: mag
141145
data_type: l1b
142146
descriptor: norm-magi
143147
required: false
144-
# Also pull the previous day's normal-mode L1B so L1C can continue the
145-
# previous day's timeline across the day boundary when the current day
146-
# opens with a gap (MAG SDC Data Validation 4.3.3 time inheritance;
147-
# imap_processing issue 2925). [past, future] days (past is negative);
148-
# the next day is not needed.
149-
# NOTE: do not merge yet - the orchestration does not currently apply
150-
# date_range when selecting input files (needs custom_behavior support,
151-
# like hi.py), and the trigger sensor's range parser does not handle
152-
# negative values like "-1d". ALSO superseded: per MAG review the
153-
# delivered input must be the previous day's L1C, not norm L1B
154-
# (imap_processing PR 3323); this entry is a placeholder until the
155-
# orchestration design lands.
156-
date_range: ["-1d", "0d"]
157148
- source: mag
158149
data_type: l1b
159150
descriptor: burst-magi
@@ -172,26 +163,17 @@
172163
descriptor: norm-magi
173164
major_version: 1
174165

166+
# custom_behavior/mag.py also delivers the previous day's L1C to this job
167+
# (MAG SDC Data Validation 4.3.3 time inheritance; imap_processing issue
168+
# 2925). It is not declared as an input here because that would put a
169+
# self-cycle in the Dagster asset graph.
175170
(l1c, norm-mago):
176171
partition: daily
177172
inputs:
178173
- source: mag
179174
data_type: l1b
180175
descriptor: norm-mago
181176
required: false
182-
# Also pull the previous day's normal-mode L1B so L1C can continue the
183-
# previous day's timeline across the day boundary when the current day
184-
# opens with a gap (MAG SDC Data Validation 4.3.3 time inheritance;
185-
# imap_processing issue 2925). [past, future] days (past is negative);
186-
# the next day is not needed.
187-
# NOTE: do not merge yet - the orchestration does not currently apply
188-
# date_range when selecting input files (needs custom_behavior support,
189-
# like hi.py), and the trigger sensor's range parser does not handle
190-
# negative values like "-1d". ALSO superseded: per MAG review the
191-
# delivered input must be the previous day's L1C, not norm L1B
192-
# (imap_processing PR 3323); this entry is a placeholder until the
193-
# orchestration design lands.
194-
date_range: ["-1d", "0d"]
195177
- source: mag
196178
data_type: l1b
197179
descriptor: burst-mago

0 commit comments

Comments
 (0)