Load Balancing

One server can only handle a limited number of requests. When you need to serve more users, you add more servers. But now something has to decide which server answers the next request.

That is the job of a load balancer.

A load balancer sits between the users and your servers. Every request arrives at the load balancer first. The load balancer picks one server and sends the request there.

The users do not know that many servers exist. They only know one address, the address of the load balancer.

What a Load Balancer Does

A load balancer has three jobs.

**It spreads the requests