Skip to main content

Posts

Showing posts from December, 2017

Common HTTP Load Balancing Methods

Estimating utilization of the application servers may not be always possible. In many companies, while average cpu utilization of any server is changing between %20 and %30, they may become hardly respond to incoming requests at peak times. When an unexpected over-utilization occurs, the first method that comes to mind is provisioning new instances (of course your company is using a virtualization or cloud architecture) to the application server pool.
Sometimes it may not be the solution for over-utilization. As the number of app servers increases it becomes important that the requests are distributed equally across these servers. Becoming some of the servers unresponsive may have a devastating effect on the environment.

Traditionally, load balancers are used to distribute incoming traffic across multiple app instances. Load balancing provides some benefits like scaling the application farm, supporting heavy network traffic, detecting unhealthy app instances and automatically removin…