Skip to main content

Experimentation Made Easy

  • Conference paper

Abstract

Scientifically sound network studies require the execution of large series of experiments. Researchers usually have to execute experiments manually, a labor-intensive and error-prone task, since there is no automation of the overall experimentation process. This task becomes especially hard on a distributed testbed and the researcher has to deal with additional challenges.

In this paper we introduce the Distributed Embedded Systems Testbed Management System (DES-TBMS) for the automation of experimentation in wireless mesh networks and wireless sensor networks. DES-TBMS consists of several components including a domain specific language to describe and define experiments, a scheduler to manage and control experiments, a distributed monitoring system to gather system data, a visualization tool, and an evaluation tool to compute performance metrics from collected experiment data. Thus, DES-TBMS supports the researcher during the design, execution, and evaluation of experiments.

This work has been partially sponsored and supported by the European Union OPNEX project.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Zimmermann, A., Günes, M., Wenig, M., Meis, U., Ritzerfeld, J.: How to study wireless mesh networks: A hybrid testbed approach. In: Proceedings 21st International Conference on Advanced Information Networking and Applications, pp. 853–860 (2007)

    Google Scholar 

  2. Cavin, D., Sasson, Y., Schiper, A.: On the accuracy of MANET simulators. In: Proceedings of the ACM international workshop of Principles of mobile computing, New York, USA, pp. 38–43 (2002)

    Google Scholar 

  3. Kurkowski, S., Camp, T., Colagrosso, M.: MANET simulation studies: the incredibles. SIGMOBILE Mob. Comput. Commun. Rev. 9(4), 50–61 (2005)

    Article  Google Scholar 

  4. Baar, M., Will, H., Blywis, B., Liers, A., Wittenburg, G., Schiller, J.: The ScatterWeb MSB-A2 Platform for Wireless Sensor Networks. Freie Universität Berlin, Technical Report (2008)

    Google Scholar 

  5. Güneş, M., Blywis, B., Juraschek, F.: Concept and design of the hybrid distributed embedded systems testbed. Freie Universität Berlin, Technical Report TR-B-08-10 (2008)

    Google Scholar 

  6. Güneş, M., Blywis, B., Juraschek, F., Schmidt, P.: Practical issues of implementing a hybrid multi-nic wireless mesh-network. Freie Universität Berlin, Technical Report TR-B-08-11 (2008)

    Google Scholar 

  7. SNMP4j.org: The SNMP API for Java, http://www.snmp4j.org/

  8. JavaView: JavaView - Interactive 3D geometry and visualization, http://www.javaview.de/

  9. Lundgren, H., Lundberg, D., Nielsen, J., Nordström, E., Tschudin, C.: A large-scale testbed for reproducible ad hoc protocol evaluations. Technical Report (2001)

    Google Scholar 

  10. Nordström, E., Gunningberg, P., Lundgren, H.: A testbed and methodology for experimental evaluation of wireless mobile ad hoc networks. In: Proceedings 1st International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, pp. 100–109 (2005)

    Google Scholar 

  11. Raychaudhuri, D., Seskar, I., Ott, M., Ganu, S., Ramachandran, K., Kremo, H., Siracusa, R., Liu, H., Singh, M.: Overview of the orbit radio grid testbed for evaluation of next-generation wireless network protocols. In: Proceedings IEEE Wireless Communications and Networking Conference, vol. 3, pp. 1664–1669 (2005)

    Google Scholar 

  12. Sachin Ganu, R.H., Kremo, H., Seskar, I.: Addressing repeatability in wireless experiments using orbit testbed. In: Proceedings of IEEE Tridentcom (2005)

    Google Scholar 

  13. Shrestha, S.L., Lee, J., Lee, A., Lee, K., Lee, J., Chong, S.: An open wireless mesh testbed architecture with data collection and software distribution platform. In: Proceedings 3rd International Conference on Testbeds and Research Infrastructure for the Development of Networks and Communities TridentCom, pp. 1–10 (2007)

    Google Scholar 

  14. Peterson, L., Bavier, A., Fiuczynski, M.E., Muir, S.: Experiences building PlanetLab. In: Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation, OSDI (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Güneş, M., Blywis, B., Juraschek, F., Watteroth, O. (2010). Experimentation Made Easy. In: Zheng, J., Mao, S., Midkiff, S.F., Zhu, H. (eds) Ad Hoc Networks. ADHOCNETS 2009. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 28. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-11723-7_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-11723-7_33

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-11722-0

  • Online ISBN: 978-3-642-11723-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics