|
134 | 134 | descriptor: norm-mago |
135 | 135 | major_version: 1 |
136 | 136 |
|
| 137 | +# custom_behavior/mag.py also delivers the previous day's L1C to this job |
| 138 | +# (MAG SDC Data Validation 4.3.3 time inheritance; imap_processing issue |
| 139 | +# 2925). It is not declared as an input here because that would put a |
| 140 | +# self-cycle in the Dagster asset graph. |
137 | 141 | (l1c, norm-magi): |
138 | 142 | partition: daily |
139 | 143 | inputs: |
140 | 144 | - source: mag |
141 | 145 | data_type: l1b |
142 | 146 | descriptor: norm-magi |
143 | 147 | required: false |
144 | | - # Also pull the previous day's normal-mode L1B so L1C can continue the |
145 | | - # previous day's timeline across the day boundary when the current day |
146 | | - # opens with a gap (MAG SDC Data Validation 4.3.3 time inheritance; |
147 | | - # imap_processing issue 2925). [past, future] days (past is negative); |
148 | | - # the next day is not needed. |
149 | | - # NOTE: do not merge yet - the orchestration does not currently apply |
150 | | - # date_range when selecting input files (needs custom_behavior support, |
151 | | - # like hi.py), and the trigger sensor's range parser does not handle |
152 | | - # negative values like "-1d". ALSO superseded: per MAG review the |
153 | | - # delivered input must be the previous day's L1C, not norm L1B |
154 | | - # (imap_processing PR 3323); this entry is a placeholder until the |
155 | | - # orchestration design lands. |
156 | | - date_range: ["-1d", "0d"] |
157 | 148 | - source: mag |
158 | 149 | data_type: l1b |
159 | 150 | descriptor: burst-magi |
|
172 | 163 | descriptor: norm-magi |
173 | 164 | major_version: 1 |
174 | 165 |
|
| 166 | +# custom_behavior/mag.py also delivers the previous day's L1C to this job |
| 167 | +# (MAG SDC Data Validation 4.3.3 time inheritance; imap_processing issue |
| 168 | +# 2925). It is not declared as an input here because that would put a |
| 169 | +# self-cycle in the Dagster asset graph. |
175 | 170 | (l1c, norm-mago): |
176 | 171 | partition: daily |
177 | 172 | inputs: |
178 | 173 | - source: mag |
179 | 174 | data_type: l1b |
180 | 175 | descriptor: norm-mago |
181 | 176 | required: false |
182 | | - # Also pull the previous day's normal-mode L1B so L1C can continue the |
183 | | - # previous day's timeline across the day boundary when the current day |
184 | | - # opens with a gap (MAG SDC Data Validation 4.3.3 time inheritance; |
185 | | - # imap_processing issue 2925). [past, future] days (past is negative); |
186 | | - # the next day is not needed. |
187 | | - # NOTE: do not merge yet - the orchestration does not currently apply |
188 | | - # date_range when selecting input files (needs custom_behavior support, |
189 | | - # like hi.py), and the trigger sensor's range parser does not handle |
190 | | - # negative values like "-1d". ALSO superseded: per MAG review the |
191 | | - # delivered input must be the previous day's L1C, not norm L1B |
192 | | - # (imap_processing PR 3323); this entry is a placeholder until the |
193 | | - # orchestration design lands. |
194 | | - date_range: ["-1d", "0d"] |
195 | 177 | - source: mag |
196 | 178 | data_type: l1b |
197 | 179 | descriptor: burst-mago |
|
0 commit comments