Current-day data centers and high-volume cloud services employ a broad set of heterogeneous servers. In such settings, client requests typically arrive at multiple entry points, and dispatching them to servers is an urgent distributed systems problem. This paper presents an efficient solution to the load balancing problem in such systems that improves on and overcomes problems of previous solutions. The load balancing problem is formulated as a stochastic optimization problem, and an efficient algorithmic solution is obtained based on a subtle mathematical analysis of the problem. Finally, extensive evaluation of the solution on simulated data shows that it outperforms previous solutions. Moreover, the resulting dispatching policy can be computed very efficiently, making the solution practically viable.

当今的数据中心和大容量云服务使用大量异构服务器。在这样的设置中，客户端请求通常会到达多个入口点，将它们分派到服务器是一个紧迫的分布式系统问题。本文针对此类系统中的负载平衡问题提出了一种有效的解决方案，该解决方案改进并克服了先前解决方案的问题。负载均衡问题被表述为一个随机优化问题，并基于对问题的细微数学分析得到一个有效的算法解决方案。最后，对模拟数据解决方案的广泛评估表明，它优于以前的解决方案。此外，可以非常有效地计算得到的调度策略，使解决方案切实可行。