Skip to content

Commit 48c3b69

Browse files
committed
doc: first day wrong lints
1 parent c2ef046 commit 48c3b69

File tree

1 file changed

+9
-5
lines changed

1 file changed

+9
-5
lines changed

scripts/reports/first_day_wrong.Rmd

+9-5
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: "Why are the scores so bad on the first day?"
2+
title: "Why are the COVID 2024-2025 season scores so bad on the first day?"
33
date: "compiled on `r format(Sys.time(), '%d %B %Y')`"
44
output:
55
html_document:
@@ -36,9 +36,13 @@ knitr::opts_template$set(figure1 = list(fig.height = 4, fig.width=4))
3636
source(here::here("R/load_all.R"))
3737
```
3838

39-
The scores on the first day are all unusually bad, bad enough we initially thought it was a bug.
39+
The scores on the first forecast day for COVID are all unusually bad, bad enough we initially thought it was a bug.
4040
This notebook is a demonstration that these forecasts are somewhat reasonable given the context, and separated out because it would otherwise be distracting.
4141
The primary reason is that it has an unusual amount of revision.
42+
In comparison, the flu season delayed their initial forecast by a day, which allowed a new data revision to be used, which explains why flu doesn't have this problem.
43+
44+
# Revision Behavior
45+
4246
First, getting the necessary archive, forecasts, and scores, and plotting the versions around the first forecast day `2024-11-20` (the week of `2024-11-23`):
4347

4448
```{r, fig.height = 15, fig.width = 15}
@@ -49,16 +53,16 @@ text_size <- 6
4953
covid_archive$DT %>%
5054
filter(time_value < as.Date("2024-11-23") + 4*7, time_value > "2024-09-01") %>%
5155
as_epi_archive() %>%
52-
autoplot(.versions = c(as.Date("2024-11-20"), covid_archive$versions_end)) +
56+
autoplot(.versions = c(as.Date("2024-11-20"), covid_archive$versions_end)) +
5357
geom_vline(aes(xintercept = as.Date("2024-11-23")))
5458
```
5559

5660
Most locations have a significantly different version on `2024-11-20`, some by as much as 4 times the final version.
5761

58-
Building a function to plot the different forecasters
5962
```{r}
63+
# Building a function to plot the different forecasters
6064
plot_problem_day <- function(forecaster, text_size = 6) {
61-
covid_scores %>% filter(forecast_date == "2024-11-23") %>% arrange(wis)
65+
covid_scores %>% filter(forecast_date == "2024-11-23") %>% arrange(wis)
6266
covid_forecasts %>% filter(forecaster =="climate_base") %>% filter(forecast_date == "2024-11-23")
6367
cmu_timeseries_fc <- covid_forecasts %>% filter(forecaster ==.env$forecaster) %>% filter(forecast_date == "2024-11-23")
6468
cmu_timeseries_wide <- cmu_timeseries_fc %>%

0 commit comments

Comments
 (0)