Grokking Concurrency in Python
0% completed
Retries and Circuit Breakers
The test site went down for two seconds while ten Harvest workers were crawling 100 pages. Each worker retried every failed page up to three times. The site received 213 requests during the outage, all answered with 503, and Harvest gave up on 46 of its 100 pages.
The retries sent a failing site more than twice as many requests as Harvest had pages, and still lost the work. Retrying is necessary, because many failures last only a moment, but it needs limits.
.....
.....
.....
Like the course? Get enrolled and start learning!
Reading Progress
0%