Grokking Operating Systems and Networking for Backend Engineers
0% completed
Incident: Fast Median, Slow Tail
Checkout's order intake service reports a median of 0.03 ms per order and a 99th percentile of 40.4 ms. The median is excellent, and the 99th percentile is more than a thousand times larger. Almost every slow order takes about 40 ms, as if a timer were involved.
A second complaint arrives from the busiest hour of the day. During short bursts of new connections, a few customers wait more than a second for a reply, even though the service handles each order in about a millisecond.
This page reproduces both problems on a real Linux server, finds the kernel mechanism behind each, and fixes them
.....
.....
.....
Like the course? Get enrolled and start learning!
Reading Progress
0%