Abstract
The amount of research done in the field of mobile ad hoc networks is extraordinarily large. Evaluation of protocols designed for ad hoc networks is challenging as the cost of node deployment in terms of resources required is high, hence, most of the researchers use simulations for performance evaluation. In this paper we address the pitfalls of simulation studies in ad hoc routing protocols published in recent years. We have conducted a survey to evaluate the current state of simulation studies published in top conference/journals of the communication domain. In majority of the published papers (the way simulation results are reported) we have found design flaws, unrealistic assumptions, are non-reproducible, and statistically invalid results. We also propose a standardizing architecture for automating the reporting and replication process for network simulators. This platform independent architecture alleviates the challenge of simulation parameter reporting and facilitates in designing better network simulation experiments.
The work of F. Li was supported by the National Natural Science Foundation of China (NSFC) under Grant 61772077, Grant 61370192, and Grant 61432015.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Jensen, J.D.: Scientific uncertainty in news coverage of cancer research: effects of hedging on scientists and journalists credibility. Hum. Commun. Res. 34(3), 347–369 (2008)
Patton, M.Q.: Enhancing the quality and credibility of qualitative analysis. Health Serv. Res. 34(5 Pt 2), 1189 (1999)
Metzger, M.J.: Making sense of credibility on the web: models for evaluating online information and recommendations for future research. J. Assoc. Inf. Sci. Technol. 58(13), 2078–2091 (2007)
Riege, A.M.: Validity and reliability tests in case study research: a literature review with hands-on applications for each research phase. Qual. Mark. Res. Int. J. 6(2), 75–86 (2003)
Kurkowski, S., Camp, T., Colagrosso, M.: MANET simulation studies: the incredibles. In: ACM SIGMOBILE Mobile Computing and Communications Review, vol. 9, no. 4, pp. 50–61 (2005)
Gunes, M., Wenig, M.: On the way to a more realistic simulation environment for mobile ad-hoc networks. In: International Workshop on Mobile Services and Personalized Environments, GI LNI (2006)
Andel, T.R., Yasinsac, A.: On the credibility of MANET simulations. Computer 39(7), 48–54 (2006)
Peng, L., Bo, Z., Zhongyong, Z.: Simulation of VANET in a more realistic scenario. In: IEEE, ISSN, pp. 978–1000 (2011)
Feeley, M., Hutchinson, N., Ray, S.: Realistic mobility for mobile ad hoc network simulation. In: Nikolaidis, I., Barbeau, M., Kranakis, E. (eds.) ADHOC-NOW 2004. LNCS, vol. 3158, pp. 324–329. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-28634-9_28
Divecha, B., Abraham, A., Grosan, C., Sanyal, S.: Impact of node mobility on MANET routing protocols models. JDIM 5(1), 19–23 (2007)
Martinez, F.J., Toh, C.-K., Cano, J.-C., Calafate, C.T., Manzoni, P.: Realistic radio propagation models (RPMs) for VANET simulations. In: Wireless Communications and Networking Conference, WCNC 2009, pp. 1–6. IEEE (2009)
Sandve, G.K., Nekrutenko, A., Taylor, J., Hovig, E.: Ten simple rules for reproducible computational research. PLoS Comput. Biol. 9(10), e1003285 (2013)
Prabhakaran, P., Sankar, R.: Impact of realistic mobility models on wireless networks performance. In: IEEE International Conference on Wireless and Mobile Computing, Networking and Communications : WiMob 2006, pp. 329–334. IEEE (2006)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Latif, Z., Sharif, K., Alvi, M.K., Li, F. (2018). Simulation Standardization: Current State and Cross-Platform System for Network Simulators. In: Zhu, L., Zhong, S. (eds) Mobile Ad-hoc and Sensor Networks. MSN 2017. Communications in Computer and Information Science, vol 747. Springer, Singapore. https://doi.org/10.1007/978-981-10-8890-2_38
Download citation
DOI: https://doi.org/10.1007/978-981-10-8890-2_38
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-8889-6
Online ISBN: 978-981-10-8890-2
eBook Packages: Computer ScienceComputer Science (R0)