Performance of wireless network simulators: a case study

Designing protocols for wireless networks is a challenging task. Combined with the fact that such networks are often deployed for critical missions like forest fire detection in the WSN scenario or have to function properly and efficiently for an extended period of time, it is desirable to thoroughly test, analyze and evaluate newly developed communication protocols before deployment. In order to do this, simulations are a good compromise between cost/complexity and accuracy of the results. Since there are many simulators for wireless networks, it is often difficult to decide which one to choose. Therefore, we present a case study in which four common wireless network simulators were used to evaluate a well-known topology control protocol (SPAN). Within the case study, we describe the strengths and weaknesses of the examined network simulators: First, we evaluate the usability of the simulators in terms of different parts of the protocol developer's work process. Moreover, we also focus on the simulator's support for reusability and maintainability of simulation models by measuring particular model properties. For this purpose, we have proposed a model of quality for network simulators. The model of quality defines which properties of models to measure and how to interpret them. As opposed to other simulator comparisons, we do not focus on the correlation of the individual simulation results. Through this paper, we aim at providing a basis for finding an adequate simulator for a particular task.