Grokking DevOps and SRE Interviews
0% completed
Designing Alerts That Matter
After the grocery company moved all 14 services to Kubernetes, each team added its own alerts. Within two months, the on-call engineer was receiving 140 pages a week, or 20 a day. A page is an alert that interrupts a person immediately, by phone call or push notification, at any hour.
Only 9 of those 140 pages needed anyone to act, which is 6.4 percent. Engineers began to silence their phones at night. Then, when checkout became slow at the busiest hour, no alert fired at all, because no alert measured latency.
.....
.....
.....
Like the course? Get enrolled and start learning!
Reading Progress
0%