LinuxCzar: My Philosophy On Alerting
Fantastic post. Alerting is such a delicate balance. You start to involuntarily develop Opinions about it once you've been paged in the night a few times due to some bullshit like Googlebot indexing the site and tipping CPU usage just above the alerting threshold. Or for downtime on an unimportant page that could realistically have stayed down until morning without consequence.
The personal website of Jack Neely
linuxczar.net/sysadmin/philosophy-on-alerting/