skip to main content
10.1145/3267204.3267213acmconferencesArticle/Chapter ViewAbstractPublication PagesmobicomConference Proceedingsconference-collections
research-article

nepi-ng: An Efficient Experiment Control Tool in R2lab

Published: 01 October 2018 Publication History

Abstract

Experimentation is an essential step for realistic evaluation of wireless network protocols. The evaluation methodology entails controllable environment conditions and a rigorous and efficient experiment control and orchestration for a variety of scenarios. Existing experiment control tools such as OMF often lack in efficiency in terms of resource management and rely on abstractions that hide the details about the wireless set-up. In this paper, we propose nepi-ng, an efficient experiment control tool that leverages job oriented programming model and efficient single-thread execution of parallel programs using asyncio. nepi-ng provides an efficient and modular fine grain synchronization mechanism for networking experiments with light software dependency footprint. We present and discuss our design choices and compare to the state of the art tools, mainly OMF.

References

[1]
Young-Hwan Kim, Alina Quereilhac, et al. Enabling iterative development and reproducible evaluation of network protocols. Computer Networks, 63:238--250, 2014.
[2]
Mohamed Naoufal Mahfoudi, Thierry Turletti, et al. Lessons Learned while Trying to Reproduce the OpenRF Experiment. In ACM SIGCOMM Reproducibility Workshop, volume 41, pages 21 -- 23, LA, USA, August 2017.
[3]
Cristian Tala, Luciano Ahumada, et al. Guidelines for the accurate design of empirical studies in wireless networks. In IEEE TridentCom, pages 208--222, 2011.
[4]
Thierry Rakotoarivelo, Maximilian Ott, et al. OMF: a control and management framework for networking testbeds. ACM OSR, 43(4):54--59, January 2010.
[5]
Open-Access Research Testbed for Next-Generation Wireless Networks (ORBIT). https://orbit-lab.org.
[6]
R2lab Testbed Management Framework. https://github.com/parmentelat/rhubarbe.
[7]
D3: Data-driven documents. https://d3js.org/.
[8]
Mohamed Naoufal Mahfoudi, Thierry Turletti, et al. ORION: Orientation Estimation Using Commodity Wi-Fi. In IEEE Workshop on ANLN, pages 1033--1038, Paris, France, May 2017.
[9]
Why use asyncio? http://asyncio.readthedocs.io/en/latest/why_asyncio.html.
[10]
Curio, a Python library for concurrent I/O and systems programming. https://curio.readthedocs.io/.
[11]
Trio: async programming for humans and snake people. http://trio.readthedocs.io/.
[12]
asynciojobs: add time dependencies between coroutines. https://asynciojobs.readthedocs.io/.
[13]
apssh: asynchronous parallel ssh. https://apssh.readthedocs.io/.
[14]
Dipankar Raychaudhuri, Ivan Seskar, et al. Overview of the orbit radio grid testbed for evaluation of next-generation wireless network protocols. In IEEE WCNC, volume 3, pages 1664--1669, 2005.
[15]
Mark Berman, Jeffrey S Chase, et al. Geni: A federated testbed for innovative network experiments. Computer Networks, 61:5--23, 2014.
[16]
Katerina Pechlivanidou, Kostas Katsalis, et al. Nitos testbed: A cloud based wireless experimentation facility. In ITC 2014, pages 1--6. IEEE, 2014.
[17]
Stefan Bouckaert, Wim Vandenberghe, et al. The w-ilab. t testbed. In International Conference on Testbeds and Research Infrastructures, pages 145--154. Springer, 2010.
[18]
Brian White, Jay Lepreau, et al. An integrated experimental environment for distributed systems and networks. ACM OSR, 36(SI):255--270, 2002.
[19]
Platforms for Advanced Wireless Research (PAWR). https://www.advancedwireless.org/.
[20]
Cloud Enhanced Open Software Defined Mobile Wireless Testbed for City-Scale Deployment (COSMOS). http://cosmos-lab.org/.
[21]
Powder (the Platform for Open Wireless Data-driven Experimental Research). https://powderwireless.net/.
[22]
PlanetLab, an open platform for developing, deploying and accessing planetary-scale services. https://planet-lab.eu.

Cited By

View all
  • (2023)NFV-empowered digital twin cyber platform: Architecture, prototype, and a use caseComputer Communications10.1016/j.comcom.2023.07.030210(163-173)Online publication date: Oct-2023
  • (2019)Experimental Estimation of LTE-A Performance2019 15th International Conference on Network and Service Management (CNSM)10.23919/CNSM46954.2019.9012663(1-9)Online publication date: Oct-2019
  • (2019)Walker: DevOps Inspired Workflow for ExperimentationIEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)10.1109/INFCOMW.2019.8845199(277-282)Online publication date: Apr-2019
  • Show More Cited By

Index Terms

  1. nepi-ng: An Efficient Experiment Control Tool in R2lab

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    WiNTECH '18: Proceedings of the 12th International Workshop on Wireless Network Testbeds, Experimental Evaluation & Characterization
    October 2018
    106 pages
    ISBN:9781450359306
    DOI:10.1145/3267204
    Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 01 October 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. asynchronous programming
    2. asyncio
    3. experimentation
    4. orchestration
    5. python
    6. reproducibility

    Qualifiers

    • Research-article

    Conference

    MobiCom '18
    Sponsor:

    Acceptance Rates

    WiNTECH '18 Paper Acceptance Rate 10 of 16 submissions, 63%;
    Overall Acceptance Rate 63 of 100 submissions, 63%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 27 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)NFV-empowered digital twin cyber platform: Architecture, prototype, and a use caseComputer Communications10.1016/j.comcom.2023.07.030210(163-173)Online publication date: Oct-2023
    • (2019)Experimental Estimation of LTE-A Performance2019 15th International Conference on Network and Service Management (CNSM)10.23919/CNSM46954.2019.9012663(1-9)Online publication date: Oct-2019
    • (2019)Walker: DevOps Inspired Workflow for ExperimentationIEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)10.1109/INFCOMW.2019.8845199(277-282)Online publication date: Apr-2019
    • (2018)Experience Building a Prototype 5G TestbedProceedings of the Workshop on Experimentation and Measurements in 5G10.1145/3286680.3286683(13-18)Online publication date: 4-Dec-2018
    • (2018)DemoProceedings of the 12th International Workshop on Wireless Network Testbeds, Experimental Evaluation & Characterization10.1145/3267204.3268071(66-67)Online publication date: 1-Oct-2018

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media