Abstract
Traditionally, wireless protocol proposals have been often tested and validated using only analytical and simulation models. However, as the wireless environment is very complex to model accurately, and since the cost of wireless cards has decreased in an exponential way, today more and more research papers include evaluation of new proposals using experimentation on real devices. Indeed, experimentation is a mandatory step before possible deployment of new network protocols with real users. However, wireless experimentation is much more complex to set up and run than simulation, and it is important to avoid many pitfalls that can occur during experimentation. The objectives of this paper are twofold. First, we describe typical problems currently encountered in wireless-based experimentation, and we present simple guidelines to avoid them. Second, we propose an experimental methodology where the detection of anomalies, calibration of the measurement setup, and clear definition of the scenario (among others) make easier the repeatability of results. Finally, we showcase an implementation of the proposed methodology with an experimentation scenario whose objective is to analyze the stability of the wireless channel.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Reddy, D., Riley, G.: Measurement based physical layer modeling for wireless network simulations. In: Proceedings of the 2007 15th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, pp. 46–53. IEEE Computer Society (2007)
Heidemann, J., Bulusu, N., Elson, J., Intanagonwiwat, C., Chan Lan, K., Xu, Y., Ye, W., Estrin, D., Govindan, R.: Effects of detail in wireless network simulation. In: Proceedings of the SCS Multiconference on Distributed Simulation, pp. 3–11 (2001)
Kotz, D., Newport, C., Gray, R.S., Liu, J., Yuan, Y., Elliott, C.: Experimental evaluation of wireless simulation assumptions. In: MSWiM 2004: Proceedings of the 7th ACM International Symposium on Modeling, Analysis and Simulation of Wireless and Mobile Systems, pp. 78–82. ACM, New York (2004)
Nordstrom, E., Gunningberg, P., Lundgren, H.: A testbed and methodology for experimental evaluation of wireless mobile ad hoc networks. In: First International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, Tridentcom 2005, pp. 100–109 (2005)
Lenders, V., Martonosi, M.: Repeatable and realistic experimentation in mobile wireless networks. IEEE Transactions on Mobile Computing 8, 1718–1728 (2009)
White, B., Lepreau, J., Guruprasad, S.: Lowering the barrier to wireless and mobile experimentation. SIGCOMM Comput. Commun. Rev. 33(1), 47–52 (2003)
Network simulator (January 2, 2010), http://nsnam.isi.edu/nsnam
Global Mobile Information System Simulation Library (January 2010), http://pcl.cs.ucla.edu/projects/glomosim/
Objective Modular Network Testbed in C++ (January 2010), http://www.omnetpp.org/
Bianchi, G., Giustiniano, D., Scalia, L., Tinnirello, I.: Vendor-Affected” WLAN experimental results: A pandora’s box¿. In: International Conference on Telecommunications 2008, ICT (2008)
Berger-Sabbatel, G., Duda, A., Gaudoin, O., Heusse, M., Rousseau, F.: Fairness and its impact on delay in 802.11 networks. In: IEEE Global Telecommunications Conference, GLOBECOM 2004, vol. 5, pp. 2967–2973 (2004)
Angrisani, L., Botta, A., Pescape, A., Vadursi, M.: Measuring wireless links capacity. In: 1st International Symposium on Wireless Pervasive Computing, p. 5 (2006)
Andersen, J., Rappaport, T., Yoshida, S.: Propagation measurements and models for wireless communications channels. IEEE Communications Magazine 33(1), 42–49 (1995)
Rappaport, T.: Wireless Communications: Principles and Practice. Prentice Hall PTR, Upper Saddle River (2001)
Formisano, F., Giustiniano, D.: 802.11b/g link level measurements for an outdoor wireless campus network. In: WOWMOM 2006, pp. 525–530. IEEE Computer Society (2006)
Babich, F., Comisso, M., D’Orlando, M., Dorni, A.: Quality of service in 802.11 networks: Modeling and experimental evaluation. In: IEEE International Conference on Communications, ICC 2009, pp. 1–5 (2009)
Ha, J., Lee, K., Kim, H., Kang, I.: A snooping rate adaptation algorithm for IEEE 802.11 WLANs. In: 3rd International Symposium on Wireless Pervasive Computing, ISWPC 2008, pp. 606–609 (2008)
Giustiniano, D., Bianchi, G., Scalia, L., Tinnirello, I.: An explanation for unexpected 802.11 outdoor link-level measurement results. In: The 27th Conference on Computer Communications, INFOCOM 2008, pp. 2432–2440 (2008)
Dujovne, D.R.: Ph.D. dissertation, Université de Nice Sophia Antipolis (May 2009), http://tel.archives-ouvertes.fr/tel-00408682/en/
Dujovne, D., Turletti, T., Dabbous, W.: Experimental Methodology For Wireless Networks. INRIA, Tech. Rep. RR-6667 (2008)
Giustiniano, D., Tinnirello, I., Scalia, L., Levanti, A.: Revealing transmit diversity mechanisms and their side-effects in commercial ieee 802.11 cards. In: 4th International on Telecommunication Networking Workshop on QoS in Multiservice IP Networks, IT-NEWS 2008, February 13-15, pp. 135–141 (2008)
Multiband Atheros Driver for WiFi (January 2010), http://madwifi-project.org/
Abdesslem, F., Iannone, L., de Amorim, M., Kabassanov, K., Fdida, S.: On the feasibility of power control in current IEEE 802.11 devices. In: Fourth Annual IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom, 5 pp.–473 (2006)
Iperf (January 2010), http://www.noc.ucf.edu/Tools/Iperf/
Iperftool (January 2010), http://kb.pert.geant.net/PERTKB/IperfTool
Butti, L., Tinnés, J.: Discovering and exploiting 802.11 wireless driver vulnerabilities. Journal in Computer Virology 4, 25–37 (2008), http://dx.doi.org/10.1007/s11416-007-0065-x , doi:10.1007/s11416-007-0065-x
Ahumada, L., Feick, R., Valenzuela, R., Morales, C.: Measurement and characterization of the temporal behavior of fixed wireless links 54(6), 1913–1922 (2005)
Abdi, A., Tepedelenlioglu, C., Member, S., Member, S., Kaveh, M., Giannakis, G.: On the estimation of the k parameter for the rice fading distribution. IEEE Commun. Letters 5, 92–94 (2001)
Wysocki, H.-J.T.: Characterisation of the indoor radio propagation channel at 2.4 ghz. Journal of Telecommunications and Information Technology 1(3-4), 84–90 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Tala, C., Ahumada, L., Dujovne, D., Rehman, SU., Turletti, T., Dabbous, W. (2012). Guidelines for the Accurate Design of Empirical Studies in Wireless Networks. In: Korakis, T., Li, H., Tran-Gia, P., Park, HS. (eds) Testbeds and Research Infrastructure. Development of Networks and Communities. TridentCom 2011. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 90. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29273-6_17
Download citation
DOI: https://doi.org/10.1007/978-3-642-29273-6_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29272-9
Online ISBN: 978-3-642-29273-6
eBook Packages: Computer ScienceComputer Science (R0)