skip to main content
10.1145/2994551.2996692acmconferencesArticle/Chapter ViewAbstractPublication PagessensysConference Proceedingsconference-collections
poster

A Benchmark for Low-power Wireless Networking: Poster Abstract

Published: 14 November 2016 Publication History

Abstract

Experimental research in low-power wireless networking lacks a reference benchmark. While other communities such as databases or machine learning have standardized benchmarks, our community still uses ad-hoc setups for its experiments and struggles to provide a fair comparison between communication protocols. Reasons for this include the diversity of network scenarios and the stochastic nature of wireless experiments. Leveraging on the excellent testbeds and tools that have been built to support experimental validation, we make the case for a reference benchmark to promote a fair comparison and reproducibility of results. This abstract describes early design elements and a benchmarking methodology with the goal to gather feedback from the community rather than propose a definite solution.

References

[1]
C. Adjih, E. Baccelli, E. Fleury, G. Harter, N. Mitton, T. Noel, R. Pissard-Gibollet, F. Saint-Marcel, G. Schreiner, J. Vandaele, and T. Watteyne. FIT IoT-LAB: A large scale open experimental IoT testbed. In IEEE WF-IoT, 2015.
[2]
C. A. Boano, T. Voigt, C. Noda, K. Roemer, and M. Zuniga. JamLab: Augmenting sensornet testbeds with realistic and controlled interference generation. In ACM/IEEE IPSN, 2011.
[3]
M. Doddavenkatappa, M. Chan, and A. Ananda. Indriya: A low-cost, 3D wireless sensor network testbed. In ICST TridentCom, 2011.
[4]
R. Lim, F. Ferrari, M. Zimmerling, C. Walser, P. Sommer, and J. Beutel. Flocklab: A testbed for distributed, synchronized tracing and profiling of wireless embedded systems. In ACM/IEEE IPSN, 2013.

Cited By

View all
  • (2021)VIADUCT: Bridging the Gap between Testbeds and Real-World Cyber-Physical SystemsProceedings of the 2021 International Conference on Embedded Wireless Systems and Networks10.5555/3451271.3451281(103-114)Online publication date: 20-Feb-2021
  • (2019)OpenBenchmark: Repeatable and Reproducible Internet of Things Experimentation on TestbedsIEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)10.1109/INFCOMW.2019.8845160(289-294)Online publication date: Apr-2019
  • (2019)Dependable Wireless Industrial IoT Networks: Recent Advances and Open Challenges2019 IEEE European Test Symposium (ETS)10.1109/ETS.2019.8791551(1-10)Online publication date: May-2019
  • Show More Cited By
  1. A Benchmark for Low-power Wireless Networking: Poster Abstract

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SenSys '16: Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems CD-ROM
    November 2016
    398 pages
    ISBN:9781450342636
    DOI:10.1145/2994551
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 November 2016

    Check for updates

    Qualifiers

    • Poster
    • Research
    • Refereed limited

    Conference

    Acceptance Rates

    Overall Acceptance Rate 198 of 990 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)3
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2021)VIADUCT: Bridging the Gap between Testbeds and Real-World Cyber-Physical SystemsProceedings of the 2021 International Conference on Embedded Wireless Systems and Networks10.5555/3451271.3451281(103-114)Online publication date: 20-Feb-2021
    • (2019)OpenBenchmark: Repeatable and Reproducible Internet of Things Experimentation on TestbedsIEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)10.1109/INFCOMW.2019.8845160(289-294)Online publication date: Apr-2019
    • (2019)Dependable Wireless Industrial IoT Networks: Recent Advances and Open Challenges2019 IEEE European Test Symposium (ETS)10.1109/ETS.2019.8791551(1-10)Online publication date: May-2019
    • (2019)Raspberry Pi as Visual Sensor Nodes in Precision Agriculture: A StudyIEEE Access10.1109/ACCESS.2019.29088467(45110-45122)Online publication date: 2019
    • (2018)Network Dynamics Analysis and Benchmarking on an Outdoor Heterogeneous Wireless Sensor NetworkProceedings of the 15th ACM International Symposium on Performance Evaluation of Wireless Ad Hoc, Sensor, & Ubiquitous Networks10.1145/3243046.3243060(92-99)Online publication date: 25-Oct-2018
    • (2018)SODA: 6TiSCH Open Data Action2018 IEEE Workshop on Benchmarking Cyber-Physical Networks and Systems (CPSBench)10.1109/CPSBench.2018.00014(42-46)Online publication date: Apr-2018
    • (2018)Moving Beyond Competitions: Extending D-Cube to Seamlessly Benchmark Low-Power Wireless Systems2018 IEEE Workshop on Benchmarking Cyber-Physical Networks and Systems (CPSBench)10.1109/CPSBench.2018.00012(30-35)Online publication date: Apr-2018
    • (2017)Demo: Large-scale Sensing, Mobility, and Monitoring with the FIT IoT-LAB TestbedProceedings of the 2017 International Conference on Embedded Wireless Systems and Networks10.5555/3108009.3108070(260-261)Online publication date: 20-Feb-2017
    • (2017)A Competition to Push the Dependability of Low-Power Wireless Protocols to the EdgeProceedings of the 2017 International Conference on Embedded Wireless Systems and Networks10.5555/3108009.3108018(54-65)Online publication date: 20-Feb-2017
    • (2017)Challenging the IPv6 Routing Protocol for Low-Power and Lossy Networks (RPL): A SurveyIEEE Communications Surveys & Tutorials10.1109/COMST.2017.275161719:4(2502-2525)Online publication date: Dec-2018

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media