Menlo sent an email noting two map issues:
We have seen a few issues with maps in production:
Files which have been superseded by newer files but still show up in the version=latest query because they have a different start date or duration.
Files with start dates in 2025 which have not been reprocessed using the latest metadata.
Case 1
An example of the first case is:
imap_ultra_l2_u45-ena-h-hf-nsp-full-hae-6deg-3mo_20260117_v001.0002.cdf
imap_ultra_l2_u45-ena-h-hf-nsp-full-hae-6deg-3mo_20260118_v001.0001.cdf
When these are viewed in CAVA, there is one row for each file, both labeled as 2026-01. The data in these two files is nearly identical, and Joanie has no indication of which file to prefer.
Do we expect these superseded maps to be cleaned up in the future? If not, should CAVA filter out the superseded maps?
Case 2
The files that start in 2025 use "KeV" for units instead of "keV" because they have not been reprocessed since the L2 metadata changed. CAVA can plot a gridmap using files with both capitalizations, but it displays "KeV" because it encounters those units first.
Will the files that start in 2025 be reprocessed to update their metadata? Is it as simple as issuing a normal reprocess command?
Additionally, the files marked with a start date of 2025-04-19 actually start around 2025-10-17 and are very similar to the 2025-10-18 files; these 2025-04-19 files may be an instance of Case 1.
@tmplummer thinks that since we set an official map start date (2026-01-17), the SDC should keep only maps with that start date, or any subsequent map cadence date (2026-01-17 +3mo, 6mo, 9mo, etc.) The suggestion is then to move any maps in the production SDC that start before 2026-01-17 and the Ultra maps that have a start date of 2026-01-18 to the deprecated bucket and remove them from the database.
Menlo sent an email noting two map issues:
@tmplummer thinks that since we set an official map start date (2026-01-17), the SDC should keep only maps with that start date, or any subsequent map cadence date (2026-01-17 +3mo, 6mo, 9mo, etc.) The suggestion is then to move any maps in the production SDC that start before 2026-01-17 and the Ultra maps that have a start date of 2026-01-18 to the deprecated bucket and remove them from the database.