Grokking Operating Systems and Networking for Backend Engineers
Vote

0% completed

​

Incident: Fast Median, Slow Tail

Checkout's order intake service reports a median of 0.03 ms per order and a 99th percentile of 40.4 ms. The median is excellent, and the 99th percentile is more than a thousand times larger. Almost every slow order takes about 40 ms, as if a timer were involved.

A second complaint arrives from the busiest hour of the day. During short bursts of new connections, a few customers wait more than a second for a reply, even though the service handles each order in about a millisecond.

This page reproduces both problems on a real Linux server, finds the kernel mechanism behind each, and fixes them

.....

.....

.....

Like the course? Get enrolled and start learning!

Reading Progress

0%


Vote for new content