System Design Patterns: From Fundamentals to Real Systems
Vote

0% completed

​

MapReduce

1. The Incident

After ten years of business, the store's finance team asks for "total revenue by product category, all time." The source data is 5 billion order rows, about 2 TB in total. The rows are kept in object storage, a cloud service for storing very large files.

An analyst writes a simple script. It reads every row and keeps a running total for each category. Now apply the arithmetic: one machine reads about 100 MB/s, so 2 TB / 100 MB/s = 20,000 seconds

.....

.....

.....

Like the course? Get enrolled and start learning!

Reading Progress

0%


Vote for new content