Batch Processing vs. Stream Processing

There are two ways to process data: collect it for a while and process the whole pile at once (batch processing), or process each record the moment it arrives (stream processing).

Both approaches are in use in almost every large system, usually side by side. The question is never which one is better. It is which one fits the job in front of you.

Batch Processing

Batch processing collects data over a period of time and processes it as one finite unit, called a batch. The batch has a clear start and a clear end, so the job knows when it is finished.