research-article

Fast Network Simulation Through Approximation or: How Blind Men Can Describe Elephants

Authors:

Charles W. Kazer,

Kelvin K.W. Ng,

Lyle H. UngarAuthors Info & Claims

HotNets '18: Proceedings of the 17th ACM Workshop on Hot Topics in Networks

Pages 141 - 147

https://doi.org/10.1145/3286062.3286083

Published: 15 November 2018 Publication History

Abstract

Network researchers today are unable to test their new ideas at scale before deployment due to the prohibitive costs of custom testbeds and the slow speed of large-scale network simulators. Data center simulation is particularly slow because of the massive amount of bandwidth and high degree of redundant computation incurred in simulating the network stacks of thousands of commodity machines. By using approximation to replace redundant portions of the simulation, we improve computation time while retaining high accuracy.

Supplementary Material

MP4 File (p141-ng.mp4)

Download
378.27 MB

References

[1]

Mohammad Al-Fares, Rishi Kapoor, George Porter, Sambit Das, Hakim Weatherspoon, Balaji Prabhakar, and Amin Vahdat. 2012. NetBump: User-extensible Active Queue Management with Bumps on the Wire. In Proceedings of the Eighth ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS '12). ACM, New York, NY, USA, 61--72.

Digital Library

[2]

Mohammad Al-Fares, Alexander Loukissas, and Amin Vahdat. 2008. A Scalable, Commodity Data Center Network Architecture. In Proceedings of the ACM SIGCOMM 2008 Conference on Data Communication (SIGCOMM '08). ACM, New York, NY, USA, 63--74.

Digital Library

[3]

Mohammad Alizadeh, Albert Greenberg, David A. Maltz, Jitendra Padhye, Parveen Patel, Balaji Prabhakar, Sudipta Sengupta, and Murari Sridharan. 2010. Data Center TCP (DCTCP). In Proceedings of the ACM SIGCOMM 2010 Conference (SIGCOMM '10). ACM, New York, NY, USA, 63--74.

Digital Library

[4]

Mohammad Alizadeh, Abdul Kabbani, Tom Edsall, Balaji Prabhakar, Amin Vahdat, and Masato Yasuda. 2012. Less Is More: Trading a Little Bandwidth for Ultra-Low Latency in the Data Center. In Presented as part of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 12). USENIX, San Jose, CA, 253--266.

Digital Library

[5]

Neal Cardwell, Yuchung Cheng, C. Stephen Gunn, Soheil Hassas Yeganeh, and Van Jacobson. 2016. BBR: Congestion-Based Congestion Control. Queue 14, 5, Article 50 (Oct. 2016), 34 pages.

Digital Library

[6]

Junyoung Chung, Sungjin Ahn, and Yoshua Bengio. 2016. Hierarchical Multiscale Recurrent Neural Networks. CoRR abs/1609.01704 (2016). arXiv:1609.01704 http://arxiv.org/abs/1609.01704

[7]

Jeffrey Dean, Greg S. Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Quoc V. Le, Mark Z. Mao, Marc'Aurelio Ranzato, Andrew Senior, Paul Tucker, Ke Yang, and Andrew Y. Ng. 2012. Large Scale Distributed Deep Networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1 (NIPS'12). Curran Associates Inc., USA, 1223--1231.

Digital Library

[8]

Jeffrey Dean and Sanjay Ghemawat. 2004. MapReduce: Simplified Data Processing on Large Clusters. In Proceedings of the 6th Conference on Symposium on Opearting Systems Design & Implementation (OSDI'04). USENIX Association, Berkeley, CA, USA, 10--10.

Digital Library

[9]

Mo Dong, Tong Meng, Doron Zarchy, Engin Arslan, Yossi Gilad, Brighten Godfrey, and Michael Schapira. 2018. PCC Vivace: Online-Learning Congestion Control. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18). USENIX Association, Renton, WA, 343--356.

[10]

Richard M. Fujimoto. 1990. Parallel Discrete Event Simulation. Commun. ACM 33, 10 (Oct. 1990), 30--53.

Digital Library

[11]

Chuanxiong Guo, Haitao Wu, Zhong Deng, Gaurav Soni, Jianxi Ye, Jitu Padhye, and Marina Lipshteyn. 2016. RDMA over Commodity Ethernet at Scale. In Proceedings of the 2016 ACM SIGCOMM Conference (SIGCOMM '16). ACM, New York, NY, USA, 202--215.

Digital Library

[12]

J. B. Heaton, Nicholas G. Polson, and J. H. Witte. 2016. Deep Learning in Finance. CoRR abs/1602.06561 (2016), 20. arXiv:1602.06561 http://arxiv.org/abs/1602.06561

[13]

Thomas R. Henderson, Mathieu Lacage, and George F. Riley. 2008. Network simulations with the ns-3 simulator.

[14]

Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735--1780.

Digital Library

[15]

Nan Rosemary Ke, Konrad Zolna, Alessandro Sordoni, Zhouhan Lin, Adam Trischler, Yoshua Bengio, Joelle Pineau, Laurent Charlin, and Christopher Joseph Pal. 2018. Focused Hierarchical RNNs for Conditional Sequence Processing. CoRR abs/1806.04342 (2018).

[16]

Bob Lantz, Brandon Heller, and Nick McKeown. 2010. A Network in a Laptop: Rapid Prototyping for Software-defined Networks. In Proceedings of the 9th ACM SIGCOMM Workshop on Hot Topics in Networks (Hotnets-IX). ACM, New York, NY, USA, Article 19, 6 pages.

Digital Library

[17]

LBNL. {n. d.}. network simulator man page. https://ee.lbl.gov/ns/man.html.

[18]

OpenSim Ltd. 2018. OMNeT++. http://omnetpp.org.

[19]

David Meisner, Junjie Wu, and Thomas F. Wenisch. 2012. BigHouse: A Simulation Infrastructure for Data Center Systems. In Proceedings of the 2012 IEEE International Symposium on Performance Analysis of Systems & Software (ISPASS '12). IEEE Computer Society, Washington, DC, USA, 35--45.

Digital Library

[20]

Vishal Misra, Wei-Bo Gong, and Don Towsley. 2000. Fluid-based Analysis of a Network of AQM Routers Supporting TCP Flows with an Application to RED. In Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM '00). ACM, New York, NY, USA, 151--160.

Digital Library

[21]

Radhika Mittal, Vinh The Lam, Nandita Dukkipati, Emily Blem, Hassan Wassel, Monia Ghobadi, Amin Vahdat, Yaogong Wang, David Wetherall, and David Zats. 2015. TIMELY: RTT-based Congestion Control for the Datacenter. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication (SIGCOMM '15). ACM, New York, NY, USA, 537--550.

Digital Library

[22]

nsnam. 2017. ns-3. http://www.nsnam.org.

[23]

Cristopher Olah. 2015. Understanding LSTM Networks. http://colah.github.io/posts/2015-08-Understanding-LSTMs.

[24]

Amy Ousterhout, Jonathan Perry, Hari Balakrishnan, and Petr Lapukhov. 2017. Flexplane: An Experimentation Platform for Resource Management in Datacenters. In Proceedings of the 14th USENIX Conference on Networked Systems Design and Implementation (NSDI'17). USENIX Association, Berkeley, CA, USA, 437--451.

Digital Library

[25]

Costin Raiciu, Sebastien Barre, Christopher Pluntke, Adam Greenhalgh, Damon Wischik, and Mark Handley. 2011. Improving Datacenter Performance and Robustness with Multipath TCP. In Proceedings of the ACM SIGCOMM 2011 Conference (SIGCOMM '11). ACM, New York, NY, USA, 266--277.

Digital Library

[26]

Luigi Rizzo. 1997. Dummynet: A Simple Approach to the Evaluation of Network Protocols. SIGCOMM Comput. Commun. Rev. 27, 1 (Jan. 1997), 31--41.

Digital Library

[27]

Anton Maximilian Schäfer and Hans Georg Zimmermann. 2006. Recurrent Neural Networks Are Universal Approximators. In Proceedings of the 16th International Conference on Artificial Neural Networks - Volume Part I (ICANN'06). Springer-Verlag, Berlin, Heidelberg, 632--640.

Digital Library

[28]

Arjun Singh, Joon Ong, Amit Agarwal, Glen Anderson, Ashby Armistead, Roy Bannon, Seb Boving, Gaurav Desai, Bob Felderman, Paulie Germano, Anand Kanagala, Jeff Provost, Jason Simmons, Eiichi Tanda, Jim Wanderer, Urs Hölzle, Stephen Stuart, and Amin Vahdat. 2015. Jupiter Rising: A Decade of Clos Topologies and Centralized Control in Google's Datacenter Network. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication (SIGCOMM '15). ACM, New York, NY, USA, 183--197.

Digital Library

[29]

Zhangxi Tan, Zhenghao Qian, Xi Chen, Krste Asanovic, and David Patterson. 2015. DIABLO: A Warehouse-Scale Computer Network Simulator Using FPGAs. In Proceedings of the 20th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS '15). ACM, New York, NY, USA, 207--221.

Digital Library

[30]

Amin Vahdat, Ken Yocum, Kevin Walsh, Priya Mahadevan, Dejan Kostić, Jeff Chase, and David Becker. 2002. Scalability and Accuracy in a Large-scale Network Emulator. SIGOPS Oper. Syst. Rev. 36, SI (Dec. 2002), 271--284.

Digital Library

[31]

András Varga. 2009. Parallel Simulation Made Easy With OMNeT++.

[32]

Keith Winstein and Hari Balakrishnan. 2013. TCP Ex Machina: Computer-generated Congestion Control. In Proceedings of the ACM SIGCOMM 2013 Conference on SIGCOMM (SIGCOMM '13). ACM, New York, NY, USA, 123--134.

Digital Library

[33]

Qin Zhang, Hui Wang, Junyu Dong, Guoqiang Zhong, and Xin Sun. 2017. Prediction of sea surface temperature using long short-term memory. IEEE Geoscience and Remote Sensing Letters 14, 10 (2017), 1745--1749.

Cited By

Wu XKolar AChung JJin DSuchara MKettimuthu R(2024)Parallel Simulation of Quantum Networks with Distributed Quantum State ManagementACM Transactions on Modeling and Computer Simulation10.1145/363470134:2(1-28)Online publication date: 31-Jan-2024
https://dl.acm.org/doi/10.1145/3634701
Ng KDemoulin HLiu VDruschel PKaufmann AMace JFlinn JSeltzer M(2023)Paella: Low-latency Model Serving with Software-defined GPU SchedulingProceedings of the 29th Symposium on Operating Systems Principles10.1145/3600006.3613163(595-610)Online publication date: 23-Oct-2023
https://dl.acm.org/doi/10.1145/3600006.3613163
Baert MDe Poorter EHoebeke JChatzimisios PCoutinho RNotare M(2021)A Digital Communication Twin for Performance Prediction and Management of Bluetooth Mesh NetworksProceedings of the 17th ACM Symposium on QoS and Security for Wireless and Mobile Networks10.1145/3479242.3487327(1-10)Online publication date: 22-Nov-2021
https://dl.acm.org/doi/10.1145/3479242.3487327
Show More Cited By

Recommendations

Speed and accuracy of network simulation in the SimGrid framework
ValueTools '07: Proceedings of the 2nd international conference on Performance evaluation methodologies and tools

The experimental study of distributed systems and algorithms for large-scale internet platforms typically requires simulation of compute and network resources. This paper focuses on network simulation issues. While many packet-level network simulators ...
Fast Accurate Simulation of Large Shared Memory Multiprocessors
Fast Approximation to Discrete-Event Simulation of Markovian Queueing Networks
WSC '23: Proceedings of the Winter Simulation Conference

Simulation of queueing networks is generally carried out by discrete-event simulation (DES), in which the simulation time is driven by the occurrence of the next event. However, for large-scale queueing networks, especially when the network is very busy, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HotNets '18: Proceedings of the 17th ACM Workshop on Hot Topics in Networks

November 2018

191 pages

ISBN:9781450361200

DOI:10.1145/3286062

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 November 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Conference

HotNets '18

Sponsor:

SIGCOMM

HotNets '18: The 17th ACM workshop on Hot Topics in Networks

November 15 - 16, 2018

WA, Redmond, USA

Acceptance Rates

Overall Acceptance Rate 110 of 460 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
320
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wu XKolar AChung JJin DSuchara MKettimuthu R(2024)Parallel Simulation of Quantum Networks with Distributed Quantum State ManagementACM Transactions on Modeling and Computer Simulation10.1145/363470134:2(1-28)Online publication date: 31-Jan-2024
https://dl.acm.org/doi/10.1145/3634701
Ng KDemoulin HLiu VDruschel PKaufmann AMace JFlinn JSeltzer M(2023)Paella: Low-latency Model Serving with Software-defined GPU SchedulingProceedings of the 29th Symposium on Operating Systems Principles10.1145/3600006.3613163(595-610)Online publication date: 23-Oct-2023
https://dl.acm.org/doi/10.1145/3600006.3613163
Baert MDe Poorter EHoebeke JChatzimisios PCoutinho RNotare M(2021)A Digital Communication Twin for Performance Prediction and Management of Bluetooth Mesh NetworksProceedings of the 17th ACM Symposium on QoS and Security for Wireless and Mobile Networks10.1145/3479242.3487327(1-10)Online publication date: 22-Nov-2021
https://dl.acm.org/doi/10.1145/3479242.3487327
Zhang QNg KKazer CYan SSedoc JLiu VKuipers FCaesar M(2021)MimicNetProceedings of the 2021 ACM SIGCOMM 2021 Conference10.1145/3452296.3472926(287-304)Online publication date: 9-Aug-2021
https://dl.acm.org/doi/10.1145/3452296.3472926
He JSuau MOliehoek FLarochelle HRanzato MHadsell RBalcan MLin H(2020)Influence-augmented online planning for complex environmentsProceedings of the 34th International Conference on Neural Information Processing Systems10.5555/3495724.3496093(4392-4402)Online publication date: 6-Dec-2020
https://dl.acm.org/doi/10.5555/3495724.3496093
Ashok SDuvvuri SNatarajan NPadmanabhan VSellamanickam SGehrke JZhao BZheng HMadhyastha HPadmanabhan V(2020)iBoxProceedings of the 19th ACM Workshop on Hot Topics in Networks10.1145/3422604.3425935(23-29)Online publication date: 4-Nov-2020
https://dl.acm.org/doi/10.1145/3422604.3425935

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten