0% completed
Hi Team,From the chapter"Processing Queue: Each uploaded video will be pushed to...
Pramod Kumar
Oct 22, 2021
Hi Team,
From the chapter "Processing Queue: Each uploaded video will be pushed to a processing queue to be de-queued later for encoding, thumbnail generation, and storage."
This processing queue is SPOF right, so how can we handle this.
1
0
Comments
Design Gurus4 years ago
The processing queue will have its own redundancy and durability policies. If we intend to use any off the shelf solution like Rabbit MQ or even Kafka, they guarantee that once a message is pushed to the queue, it is never lost and every message is replicated for redund...
Pramod Kumar4 years ago
One thought " Instead of pushing uploaded video to the queue, If we store uploaded video in any DFS , Then add task of encoding, thumbnail generation and storage to the queue and de-queue when done. Also we will delete the uploaded video from the DFS when de-queuing the...
Design Gurus4 years ago
Right, thats what we mean too. We will push a task to the queue (not the video) to handle the encoding, thumbnail generation, etc.
shathesh 3 years ago
In this case, if only the task is pushed to the queue, where will the video be persisted until the tasks are done. Also will the encode box does one of the task, the encoding task