Grokking the System Design Interview, Volume II
Vote

0% completed

​

Kafka Delivery Semantics

A record moves from a producer, through Kafka, to a consumer. Along that path, a broker can crash, a network call can time out, or a consumer can restart mid-batch. Kafka does not force one answer to what happens then. On both the producer side and the consumer side, it offers a choice between speed and safety.

Producer delivery semantics

A producer writes only to the leader broker for a partition. The followers copy the data afterward, without the producer waiting on them by default

.....

.....

.....

Like the course? Get enrolled and start learning!
G

Gokul S

· 4 years ago

Under the Consumer Delivery Semantics of Kafka, the At-least-once and Exactly once seem to do the same thing.

  1. At-least-once scenario is that a consumer reads and waits until processing is over before committing. 2,Exactly-once says that the consumer puts the message processing and the offset increment in one transaction. What is the difference?
A

Amey Naik

· 5 years ago

Kafka Delivery Semantics: [At-least-once] "Thus, duplicate message delivery could happen in such a scenario."

how is the duplicate message delivery happening? If the consumer crashes, I just need to just send the same message to the consumer again. Correct?

Can you please throw some light on how this is different from "Exactly-once"?

Show 2 replies

Reading Progress

0%

Vote for new content