System Design Patterns: From Fundamentals to Real Systems
0% completed
MapReduce
1. The Incident
After ten years of business, the store's finance team asks for "total revenue by product category, all time." The source data is 5 billion order rows, about 2 TB in total. The rows are kept in object storage, a cloud service for storing very large files.
An analyst writes a simple script. It reads every row and keeps a running total for each category. Now apply the arithmetic: one machine reads about 100 MB/s, so 2 TB / 100 MB/s = 20,000 seconds
.....
.....
.....
Like the course? Get enrolled and start learning!
Reading Progress
0%