Skip to content

Update index page and eval sets based on CDC season eval#31

Merged
lshandross merged 3 commits intomainfrom
ls/update-index-page-and-eval-sets-based-on-cdc-season-eval
Aug 8, 2025
Merged

Update index page and eval sets based on CDC season eval#31
lshandross merged 3 commits intomainfrom
ls/update-index-page-and-eval-sets-based-on-cdc-season-eval

Conversation

@lshandross
Copy link
Copy Markdown
Contributor

Note the scoring omissions in an end of season short evaluation for FluSight 2024/2025:

  1. Reference date 2025-01-25: This date was omitted due to the communications pause, when we let teams know that week would not be scored.
  2. Puerto Rico: All forecasts for Puerto Rico were omitted due to data instability and backfill issues in that location
  3. Washington State: Reference dates from 2025-05-17 through 2025-05-31.
  4. Arizona: Reference date 2025-01-18.

We make similar omissions for evaluations for (1) and (2) (the former was already implemented), but do not deal with (3) and (4) which would be difficult to make with the current dashboard tools. However, a note is added on the index page about all 4 bullet points.

@lshandross lshandross merged commit ebfe67f into main Aug 8, 2025
7 checks passed
@lshandross lshandross deleted the ls/update-index-page-and-eval-sets-based-on-cdc-season-eval branch August 8, 2025 14:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants