Grokking Concurrency in Python
Vote

0% completed

​

Supervising Workers

pool broken: A process in the process pool was terminated abruptly while the future was running or pending.

Harvest's indexer printed that line when one of its four worker processes was killed halfway through a batch of eight pages. The kill was a test, but in production the same message appears when a C extension crashes a worker, or when the kernel's out-of-memory killer, which ends processes when the machine runs out of memory, chooses one. After that message, the pool accepts no more work, and every unfinished page is reported as failed.

Workers fail in several ways

.....

.....

.....

Like the course? Get enrolled and start learning!

Reading Progress

0%


Vote for new content