skip to main content
10.1145/2756509.2756525acmotherconferencesArticle/Chapter ViewAbstractPublication Pageswns3Conference Proceedingsconference-collections
research-article

Pushing the envelope in distributed ns-3 simulations: one billion nodes

Published: 13 May 2015 Publication History

Abstract

In this paper, we describe the results of simulation of very large (up to 109 nodes), planetary-scale networks using ns-3 simulator. The modeled networks consist of the small-world core graph of network routers and an equal number of the leaf nodes (one leaf node per router). Each bidirectional link in the simulation carries on-off traffic. Using LLNL's high-performance computing (HPC) clusters, we conducted strong and weak scaling studies, and investigated on-node scalability for MPI nodes. The scaling relations for both runtime and memory are derived. In addition we examine the packet transmission rate in the simulation and its scalability. Performance of the default ns-3 parallel scheduler is compared to the custom-designed NULL-message scheduler.

References

[1]
ns-3 Collaboration. The ns-3 network simulator. 2011
[2]
E. Weingärtner, H. vom Lehn, and K. Wehrle. A performance comparison of recent network simulators. In Proc. of the IEEE International Conference on Communications (ICC'09), pp. 1287--1291, Dresden, Germany, 2009
[3]
J. Pelkey and G. Riley. Distributed simulation with MPI in ns-3. In Proc. of the 4th International Conference on Simulation Tools and Techniques (SIMUTools'11), pp. 410--414, ICST, Brussels, Belgium, 2011
[4]
P. D. Barnes, Jr., J. M. Brase, T. W. Canales, et al. A benchmark model for parallel ns3. In Proc. of the 5th International Conference on Simulation Tools and Techniques (SIMUTools'12), pp. 375--377, ICST, Brussels, Belgium, 2012
[5]
S. Nikolaev, P. D. Barnes, Jr., J. M. Brase, et al. Performance of distributed ns-3 network simulator. In Proc. of the 6th International Conference on Simulation Tools and Techniques (SIMUTools'13), pp. 17--23, ICST, Brussels, Belgium, 2013
[6]
P. D. Barnes, Jr., J. M. Brase, T. W. Canales, et al. Livermore computer network simulation program. In Proc. of the 5th International Conference on Simulation Tools and Techniques (SIMUTools'12), pp. 223--225, ICST, Brussels, Belgium, 2012
[7]
K. Renard, C. Peri, and J. Clarke. A performance and scalability evaluation of the ns-3 distributed scheduler. In Proc. of the 5th International Conference on Simulation Tools and Techniques (SIMUTools'12), pp. 378--382, ICST, Brussels, Belgium, 2012
[8]
S. Smith, P. D. Barnes, Jr., D. R. Jefferson, S. Nikolaev. Improving per processor memory use of ns-3 to enable large scale simulations, WNS3, accepted. 2015
[9]
D. Gregor and A. Lumsdaine. The parallel BGL: a generic library for distributed graph computations. In Parallel Object-Oriented Scientific Computing (POOSC), July 2005
[10]
D. M. Nicol, C. C. Michael, and P. Inouye. Efficient aggregation of multiple LPs in distributed memory parallel simulations. In Proc. of 21st Winter Simulation Conference (WSC'89), pp. 680--685, ACM, New York, USA, 1989
[11]
P. D. Barnes, Jr. XML format for ns-3 network topology. In Workshop on ns-3 (WNS3 2013), pp. 1--3, ICST, Brussels, Belgium, 2013
[12]
D. J. Watts and S. H. Strogatz. Collective dynamics of small-world networks. Nature 393 (6684), pp. 440--442, 1998
[13]
K. M. Chandy and J. Misra. Distributed simulation: a case study in design and verification of distributed programs. IEEE Trans. Soft. Eng., 5, pp. 440--452, 1979
[14]
G. Karypis and V. Kumar. Metis -- unstructured graph partitioning and sparse matrix ordering system, version 2.0. Technical report. 1995

Cited By

View all
  • (2024)Parallel Simulation of Quantum Networks with Distributed Quantum State ManagementACM Transactions on Modeling and Computer Simulation10.1145/363470134:2(1-28)Online publication date: 31-Jan-2024
  • (2024)Distributed Simulation for Digital Twins of Large-Scale Real-World DiffServ-Based NetworksEuro-Par 2024: Parallel Processing10.1007/978-3-031-69583-4_18(255-269)Online publication date: 26-Aug-2024
  • (2022)Performance Analysis of IEEE 802.15.4 Bootstrap ProcessElectronics10.3390/electronics1124409011:24(4090)Online publication date: 8-Dec-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
WNS3 '15: Proceedings of the 2015 Workshop on ns-3
May 2015
136 pages
ISBN:9781450333757
DOI:10.1145/2756509
  • Conference Chairs:
  • Eric Gamess,
  • Peter D. Barnes,
  • Hajime Tazaki,
  • General Chair:
  • Nicola Baldo
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. MPI
  2. high-performance computing
  3. network simulation
  4. ns-3
  5. parallel architecture
  6. performance

Qualifiers

  • Research-article

Conference

WNS3 2015
WNS3 2015: Workshop on ns-3
May 13 - 14, 2015
Barcelona, Spain

Acceptance Rates

WNS3 '15 Paper Acceptance Rate 17 of 27 submissions, 63%;
Overall Acceptance Rate 54 of 82 submissions, 66%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)23
  • Downloads (Last 6 weeks)3
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Parallel Simulation of Quantum Networks with Distributed Quantum State ManagementACM Transactions on Modeling and Computer Simulation10.1145/363470134:2(1-28)Online publication date: 31-Jan-2024
  • (2024)Distributed Simulation for Digital Twins of Large-Scale Real-World DiffServ-Based NetworksEuro-Par 2024: Parallel Processing10.1007/978-3-031-69583-4_18(255-269)Online publication date: 26-Aug-2024
  • (2022)Performance Analysis of IEEE 802.15.4 Bootstrap ProcessElectronics10.3390/electronics1124409011:24(4090)Online publication date: 8-Dec-2022
  • (2020)Simulating Reliability of IoT Networks with RelIoT2020 50th Annual IEEE-IFIP International Conference on Dependable Systems and Networks-Supplemental Volume (DSN-S)10.1109/DSN-S50200.2020.00019(25-28)Online publication date: Jun-2020
  • (2020)RelIoT: Reliability Simulator for IoT NetworksInternet of Things - ICIOT 202010.1007/978-3-030-59615-6_5(63-81)Online publication date: 18-Sep-2020
  • (2019)S3Proceedings of the 2019 Workshop on Next-Generation Wireless with ns-310.1145/3337941.3337945(34-37)Online publication date: 21-Jun-2019
  • (2019)A Co-Simulation Framework for Power Systems and Communication Networks2019 IEEE Milan PowerTech10.1109/PTC.2019.8810936(1-6)Online publication date: Jun-2019
  • (2018)Emulation of Large-Scale LTE Networks in NS-3 and CORE: A Distributed ApproachMILCOM 2018 - 2018 IEEE Military Communications Conference (MILCOM)10.1109/MILCOM.2018.8599762(1-6)Online publication date: Oct-2018
  • (2017)Simulating large-scale networks for public safety: Parallel and distributed solutions in NS-32017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC)10.1109/PIMRC.2017.8292761(1-7)Online publication date: 8-Oct-2017
  • (2016)Validation of network simulation model and scalability tests using example malwareMILCOM 2016 - 2016 IEEE Military Communications Conference10.1109/MILCOM.2016.7795375(491-496)Online publication date: Nov-2016

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media