Oncall alerting when nightly job fails

[ezyang]

The pt2_stack_for_oss oncall is responsible for monitoring benchmark results. If a nightly benchmark run fails to run, the oncall should be immediately notified (e.g., ideally by work chat)