Checks to migrate to Icinga2

[TimStallard]

This is very much not an exhaustive list, will add things as we discover them. Only focusing on server checks for now; node bits will be migrated later.

High priority / major

• External monitoring
  • Set up external-monitor as icinga2 agent
  • External ping checks
  • External HTTP checks

General

• DNS checks
• Whois checks
• HTTP(S) checks
• Disk checks (can we roll this into a single careful one per host?)
• Host SSH checks
• Email alerts
  • "Nagios snapshot" style emails?

Other

• Website frontend for check status
• IRC bot integration
  (both of these can use the nice icinga2 HTTP API; we should break the code client out from sown/monitoring into a separate python module to reuse)

[TimStallard]

deleted lots of checks from icinga1 where we'd already put them in icinga2, and have started moving HTTP checks over

[drn05r]

Have added a DISKS check in ansible and monitoring. This has been deployed on the two gateway servers but nowhere else yet.