Theophilus Benson
Abstract
As data centers become more and more central in Internet communications, both research and operations communities have begun to explore how to better design and manage them. In this paper, we present a preliminary empirical study of end-to-end traffic patterns in data center networks that can inform and help evaluate research and operational approaches. We analyze SNMP logs collected at 19 data centers to examine temporal and spatial variations in link loads and losses. We find that while links in the core are heavily utilized the ones closer to the edge observe a greater degree of loss. We then study packet traces collected at a small number of switches in one data center and find evidence of ON-OFF traffic behavior. Finally, we develop a framework that derives ON-OFF traffic parameters for data center traffic sources that best explain the SNMP data collected for the data center. We show that the framework can be used to evaluate data center traffic engineering approaches. We are also applying the framework to design network-level traffic generators for data centers.
- The network simulator -- ns-2. http://www.isi.edu/nsnam/ns/. http://www.isi.edu/nsnam/ns/.Google Scholar
- M. Al-Fares, A. Loukissas, and A. Vahdat. A scalable, commodity data center network architecture. In SIGCOMM, pages 63--74, 2008. Google ScholarDigital Library
- N. Feamster, J. Borkenhagen, and J. Rexford. Guidelines for interdomain traffic engineering. SIGCOMM Comput. Commun. Rev., 33(5), 2003. Google ScholarDigital Library
- A. Greenberg, P. Lahiri, D.A. Maltz, P. Patel, and S. Sengupta. Towards a next generation data center architecture: scalability and commoditization. In PRESTO '08: Proceedings of the ACM workshop on Programmable routers for extensible services of tomorrow, pages 57--62, New York, NY, USA, 2008. ACM. Google ScholarDigital Library
- W.E. Leland, M.S. Taqqu, W. Willinger, and D.V. Wilson. On the self-similar nature of ethernet traffic (extended version). IEEE/ACM Trans. Netw., 2(1), 1994. Google ScholarDigital Library
- T. Oetiker. Round robin database tool. http://oss.oetiker.ch/rrdtool/.Google Scholar
- V. Paxson and S. Floyd. Wide area traffic: the failure of poisson modeling. IEEE/ACM Trans. Netw., 3(3):226--244, 1995. Google ScholarDigital Library
- C.S. version 2 MIBs. http://www.cisco.com/public/mibs/.Google Scholar
- F. Wilcoxon. Biometrics bulletin. 1:80--83, 1945.Google Scholar
Index Terms
- Understanding data center traffic characteristics
Recommendations
Understanding data center traffic characteristics
WREN '09: Proceedings of the 1st ACM workshop on Research on enterprise networkingAs data centers become more and more central in Internet communications, both research and operations communities have begun to explore how to better design and manage them. In this paper, we present a preliminary empirical study of end-to-end traffic ...
Network traffic characteristics of data centers in the wild
IMC '10: Proceedings of the 10th ACM SIGCOMM conference on Internet measurementAlthough there is tremendous interest in designing improved networks for data centers, very little is known about the network-level traffic characteristics of data centers today. In this paper, we conduct an empirical study of the network traffic in 10 ...
Lightweight and Informative Traffic Metrics for Data Center Monitoring
In recent years, thousands of commodity servers have been deployed in Internet data centers to run large scale Internet applications or cloud computing services. Given the sheer volume of data communications between servers and millions of end users, it ...
Comments