GitHub has an API to list all webhook deliveries in the last three days, retrieve the body of the events, and re-submit the webhooks. It would be nice to update the GitHub server to automatically scrape that API for missing deliveries, without having to manually do that when recovering from outages.
Note that we'll want to filter which webhooks we retrieve the payload for: during the last production outage we had ~7000 missed deliveries, but only 270 of them were for events we actually cared about.
GitHub has an API to list all webhook deliveries in the last three days, retrieve the body of the events, and re-submit the webhooks. It would be nice to update the GitHub server to automatically scrape that API for missing deliveries, without having to manually do that when recovering from outages.
Note that we'll want to filter which webhooks we retrieve the payload for: during the last production outage we had ~7000 missed deliveries, but only 270 of them were for events we actually cared about.