The Performance of Distributed Applications: A Traffic Shaping Perspective

ACM/SPEC International Conference on Performance Engineering (ICPE), pp. 207–220

Abstract

Widely used in datacenters and clouds, network traffic shaping is a performance influencing factor that is often overlooked when benchmarking or simply deploying distributed applications. While in theory traffic shaping should allow for a fairer sharing of network resources, in practice it also introduces new problems: performance (measurement) inconsistency and long tails. In this paper we investigate the effects of traffic shaping mechanisms on common distributed applications. We characterize the performance of a distributed key-value store, big data workloads, and high-performance computing under state-of-the-art benchmarks, while the underlying network's traffic is shaped using state-of-the-art mechanisms such as token-buckets or priority queues. Our results show that the impact of traffic shaping needs to be taken into account when benchmarking or deploying distributed applications. To help researchers, practitioners, and application developers we uncover several practical implications and make recommendations on how certain applications are to be deployed so that performance is least impacted by the shaping protocols.

Authors 3

1. Jasper A. Hasenoot Aachen

   Leiden University

   Affiliation as printed

   Leiden University, OLeiden, Netherlands

2. Jan S. Rellermeyer

   Leibniz University Hannover

   Affiliation as printed

   Leibniz Universität Hannover, Hannover, Germany

3. Alexandru Uta Aachen

   Leiden University

   Affiliation as printed

   Leiden University, Leiden, Netherlands