Grokking the System Design Interview, Volume II
Vote

0% completed

​

High-level Architecture

This lesson gives a brief overview of HDFS’s architecture.

HDFS architecture

All files stored in HDFS are broken into multiple fixed-size blocks, where each block is 128 megabytes in size by default (configurable on a per-file basis). Each file stored in HDFS consists of two parts: the actual file data and the metadata, i.e., how many block parts the file has, their locations and the total file size, etc. HDFS cluster primarily consists of a NameNode that manages the file system metadata and DataNodes that store the actual data.

  • All blocks of a file are of the same size exc

.....

.....

.....

Like the course? Get enrolled and start learning!
A

Amey Naik

· 5 years ago

"while querying, we cannot add any column in the where clause other than the primary key."

Show 2 replies
A

Amey Naik

· 5 years ago

Overview Diagram Image

A

Amey Naik

· 5 years ago

"This means that within each node, the data is stored in sorted order according to the employee_id column."

Show 6 replies