Grokking Operating Systems and Networking for Backend Engineers
0% completed
Incident: Too Many Open Files
Three days after a deployment, one of Checkout's servers starts to fail orders. Its log repeats one line, payment call failed: [Errno 24] Too many open files, and the share of failed orders grows every hour. The other servers, deployed at the same time, are still healthy. Someone restarts the failing server, the errors stop, and three days later the same thing happens again.
A problem that grows with the time since the last restart, and that a restart removes, usually means that something is being created and never released. In this incident, that something is a network connection.
.....
.....
.....
Like the course? Get enrolled and start learning!
Reading Progress
0%