Grokking the System Design Interview
Vote

0% completed

​

Data Compression vs Data Deduplication

Data compression and data deduplication are two techniques used to optimize data storage, but they function in different ways and are suited for different scenarios.

Data Compression

  • Definition: Data compression involves encoding information using fewer bits than the original representation. It reduces the size of data by removing redundancies and is often used to save storage space or decrease transmission times.
  • Types:
    • Lossless Compression: Reduces file size without losing any data (e.g., ZIP files). You can restore data to its original state.

.....

.....

.....

Like the course? Get enrolled and start learning!
S

saihemanthmathi

· 2 years ago

Like, since now we store reduce the no of copies of the data, and reference it. The reduction in redundancy can can also increase the risk of loosing the data, If the file gets deleted, and all the references will be pointed to void.

So we are also increasing the risk of loosing the file

Jeremiah Stones

Jeremiah Stones

· 10 hours ago

So “one copy” in deduplication does not answer how many physical copies exist, how failures are handled, or how deletion works. The article really needed to separate storage efficiency, logical references, and durability.