Elsevier

Ad Hoc Networks

Volume 9, Issue 7, September 2011, Pages 1165-1185
Ad Hoc Networks

RadiaLE: A framework for designing and assessing link quality estimators in wireless sensor networks

https://doi.org/10.1016/j.adhoc.2011.01.006Get rights and content

Abstract

Stringent cost and energy constraints impose the use of low-cost and low-power radio transceivers in large-scale wireless sensor networks (WSNs). This fact, together with the harsh characteristics of the physical environment, requires a rigorous WSN design. Mechanisms for WSN deployment and topology control, MAC and routing, resource and mobility management, greatly depend on reliable link quality estimators (LQEs). This paper describes the RadiaLE framework, which enables the experimental assessment, design and optimization of LQEs. RadiaLE comprises (i) the hardware components of the WSN testbed and (ii) a software tool for setting-up and controlling the experiments, automating link measurements gathering through packets-statistics collection, and analyzing the collected data, allowing for LQEs evaluation. We also propose a methodology that allows (i) to properly set different types of links and different types of traffic, (ii) to collect rich link measurements, and (iii) to validate LQEs using a holistic and unified approach. To demonstrate the validity and usefulness of RadiaLE, we present two case studies: the characterization of low-power links and a comparison between six representative LQEs. We also extend the second study for evaluating the accuracy of the TOSSIM 2 channel model.

Introduction

Wireless sensor networks (WSNs) typically have severe constraints on energy consumption since nodes have to survive on a limited battery energy for extended periods of time, up to several years. This fact brings network protocols designers to provide energy-efficient solutions, namely in what concerns medium-access control (MAC), routing, mobility management, and topology control protocols. One of the most important requirements to achieve this goal is to avoid excessive retransmissions over low quality links. Therefore, link quality estimation emerges as a fundamental building block for network protocols to maximize the lifetime, the reliability, and the throughput of WSNs.

Several link quality estimators (LQEs) have been reported in the literature (e.g. [1], [2], [3], [4], [5]). They can be classified as either hardware-based or software-based. Hardware-based LQEs, such as Link Quality Indicator (LQI), Received Signal Strength Indicator (RSSI) and Signal to Noise Ratio (SNR) are directly read from the radio transceiver (e.g. the CC2420) upon packet reception. Most software-based LQEs enable to either count or approximate the packet reception ratio or the average number of packet transmissions/retransmissions.

The accuracy of link quality estimation greatly impacts the efficiency of network protocols. For instance, many routing protocols, e.g. [2], [6], [7], rely on link quality estimation to select high quality routes for communication. The more accurate the link quality estimation is, the more correct the decision made by routing protocols in selecting such routes. This is just one example on how important it is to assess the performance of the LQE before integrating it into a particular network protocol.

The experimental performance evaluation of LQEs requires performing link measurements through packet-statistics collection. Several testbeds have been designed for the experimentation (test, validation, performance evaluation, etc.) of WSNs [8], [9], [10], [11], [12], but only [13], [14] targeted link measurements. However, these were exploited for analyzing low-power link characteristics rather than for the performance evaluation of LQEs. Namely, they do not provide sufficient data to compute most LQEs, especially sender-side ones (refer to Section 3.2 for further intuition on sender-side and receiver-side LQEs).

Despite its importance, the experimental performance evaluation of LQEs remains an open problem. One of the reasons is the impossibility, or at least the difficulty, to provide a quantitative evaluation of the accuracy of LQEs. In fact, there is no objective link quality metric to which the link quality estimate can be compared. Furthermore, there are LQEs that are based on the packet reception ratio (PRR), some others are based on packet retransmission count (i.e. RNP) and some others are hybrid and more complex. Thus, comparing their performance becomes challenging as they have different natures. These facts motivated us to build a framework – RadiaLE, aiming at the experimental evaluation, design and optimization of LQEs.

The RadiaLE framework [15] comprises (i) hardware components of the WSN testbed and (ii) a software tool for setting-up and controlling the experiments and also for analyzing the collected data, allowing for LQEs evaluation. In fact, RadiaLE is much more than an experimental testbed. It stands for a methodology that allows researchers (i) to properly set different types of links and different types of traffics, (ii) to collect a rich database of link measurements, and (iii) to validate their solutions using a holistic and unified approach. Furthermore, RadiaLE can be used to validate the accuracy of the channel model of network simulators by replaying the performed experiments using the simulator under consideration and comparing the simulation results against the experimental results.

This paper makes the following three main contributions:

  • First, we propose RadiaLE, a new experimental testbed dedicated to perform the empirical evaluation of link quality estimators (Sections 3 Methodology, 4 RadiaLE implementation).

  • Second, we present an empirical study demonstrating the capabilities of RadiaLE for the characterization of low-power links and the performance evaluation of LQEs (Section 5).

  • Third, we examine the accuracy of the wireless channel model of TOSSIM 2 by comparing simulation results with empirical results obtained with RadiaLE (Section 6).

Section snippets

Related work

Several testbeds have been designed for the experimentation of WSNs. They can be classified into general-purpose testbeds and special-purpose testbeds. Most of existing testbeds, including MoteLab [8], Mirage [9], Twist [10], Kansei [11], and Emulab [12] are general-purpose testbeds. They have been designed and operated to be remotely used by several users with different research objectives. On the other hand, dedicated testbeds, such as Scale [13] and Swat [14] are designed for a specific

Methodology

RadiaLE allows researchers to evaluate the performance of LQEs by analyzing their statistical properties, independently of any external factor, such as collisions (each node transmits its data in an exclusive time slot) and routing (a single-hop network). These statistical properties impact the performance of LQEs, in terms of:

  • Reliability: It refers to the ability of the LQE to correctly characterize the link state. RadiaLE provides a qualitative evaluation of the LQE reliability by analyzing

RadiaLE implementation

This section describes the hardware and software architectures of RadiaLE, shown in Fig. 2a and b, respectively.

Experimental studies using RadiaLE

In this section, we illustrate the usefulness of RadiaLE through two case studies: the characterization of low-power links and the performance evaluation of LQEs.

TOSSIM 2 channel model

TOSSIM 2 is an event-driven simulator for WSNs (simulates MICAz motes), developed under TinyOS 2.x [34] environment. It has been argued that TOSSIM 2 provides an accurate wireless channel model [35], [36]. Several previous studies validate their solutions using TOSSIM 2 simulations. Particularly, in [37], the authors conducted a comparative study of a set of LQEs using TOSSIM 2 and simulation results have been claimed as valid based on the assumption that TOSSIM 2 features a realistic channel

Conclusion

This paper presented RadiaLE, a framework that automates the experimental evaluation, design and optimization of LQEs. It is available as open-source at [15]. The idea is that everyone can use it in its own location just by downloading and running RadiaLE software tool. To the best of our knowledge, RadiaLE is the first testbed dedicated to such objective. It presents several advantages compared to existing testbeds such as providing abstractions to the implementation details and the

Acknowledgement

This work was funded by the ReDCAD research unit (05-UR-1403), by the Portuguese Science Foundation under the CISTER Research Unit (FCT UI 608), by the CONET European Network of Excellence and by the EMMON European project.

Nouha Baccour was born in 1981. Currently, she is a research assistant at computer science department, National Engineering School of Sfax (Tunisia). She is also a Ph.D. student at the National Engineering School of Sfax since January 2007. Her research activity is conducted within ReDCAD research unit, in colaboration with CISTER research unit. In addition, she is involved in the CONET European Network of Excellence as an external collaborator, in particular with the research cluster

References (39)

  • R. Fonseca, O. Gnawali, K. Jamieson, P. Levis, Four bit wireless link estimation, in: Proceedings of the Sixth Workshop...
  • D.S.J. De Couto et al.

    A High-Throughput Path Metric for Multi-Hop Wireless Routing

    (2003)
  • A. Woo, D. Culler, Evaluation of efficient link reliability estimators for low-power wireless networks, EECS...
  • A. Cerpa et al.

    Temporal Properties of Low Power Wireless Links, Modeling and Implications on Multi-Hop Routing

    (2005)
  • N. Baccour et al.

    F-lqe: a fuzzy link quality estimator for wireless sensor networks

  • G. Omprakash et al.

    Collection tree protocol

  • J. Chen et al.

    Lqer: a link quality estimation based routing for wireless sensor networks

    Sensors

    (2008)
  • G. Werner-Allen, P. Swieskowski, M. Welsh, Motelab: a wireless sensor network testbed, in: Proceedings of the Fourth...
  • B. Chun et al.

    Mirage: A Microeconomic Resource Allocation System for Sensornet Testbeds

    (2005)
  • V. Handziski, A. Köpke, A. Willig, A. Wolisz, Twist: a scalable and reconfigurable testbed for wireless indoor...
  • A. Arora et al.

    Kansei: a high-fidelity sensing testbed

    IEEE Internet Computing

    (2006)
  • D. Johnson et al.

    Emulab’s Wireless Sensor Net Testbed, True Mobility, Location Precision, and Remote Access

    (2005)
  • A. Cerpa, N. Busek, D. Estrin, Scale: a tool for simple connectivity assessment in lossy environments, Tech. rep.,...
  • K. Srinivasan et al.

    Swat, Enabling Wireless Network Measurements

    (2008)
  • Radiale benchmarking tool, 2010,...
  • J. Elson, S. Bien, N. Busek, V. Bychkovskiy, A. Cerpa, D. Ganesan, L. Girod, B. Greenstein, T. Schoellhammer, T....
  • D. Johnson et al.

    Mobile emulab: a robotic wireless and sensor network testbed

  • J. Beutel, M. Dyer, L. Meier, M. Ringwald, L. Thiele, Next-generation deployment support for sensor networks, in: 207....
  • K. Srinivasan, P. Levis, Rssi is under appreciated, in: Proceedings of the Third Workshop on Embedded Networked Sensors...
  • Cited by (49)

    • Adaptive Application Behaviour for Robot Swarms using Mixed-Criticality

      2023, Electronic Proceedings in Theoretical Computer Science, EPTCS
    View all citing articles on Scopus

    Nouha Baccour was born in 1981. Currently, she is a research assistant at computer science department, National Engineering School of Sfax (Tunisia). She is also a Ph.D. student at the National Engineering School of Sfax since January 2007. Her research activity is conducted within ReDCAD research unit, in colaboration with CISTER research unit. In addition, she is involved in the CONET European Network of Excellence as an external collaborator, in particular with the research cluster COTS-based architecture for QoS in large-scale distributed embedded systems. She has received the Engineering degree in computer science, from the National Engineering School of Sfax in 2005 and the Master degree in Automatic and Industrial Computer Science, from the National Engineering School of Sfax, in 2006. Her current research interests are in the field of Wireless Sensor Networks (WSN). They are focused on the characterization, quality estimation, and modeling of low-power links in WSNs. Recently, Nouha Baccour and the rest of RadiaLE team have released a new website for open-source link quality estimators benchmarking (http://www.open-lqe.net/). She has several publications in reputed conferences (e.g. MASCOTS, EWSN).

    Anis Koubaa was born in 1977. He received the Engineering degree in telecommunications from the Higher School of Telecommunications, Tunis, Tunisia, in 2000, and the M.Sc. and Ph.D. degrees in computer science from the National Polytechnic Institute of Lorraine (INPL), Nancy, France, in 2001 and 2004, respectively. He is currently an Assistant Professor at the College of Computer Science and Information Systems, Al-Imam Muhammad Ibn Saud University, Riyadh, Saudi Arabia, and a Research Associate at the CISTER/IPP-HURRAY Research Group, Porto, Portugal. He is actively working on the design of large-scale wireless sensor netwoks and cyber-physical systems, while maintaining QoS, security, mobility and reliability. He is particularly interested in the assessment and improvement of the IEEE 802.15.4/ZigBee standard protocol stack for large-scale wireless sensor networks. He has driven the research efforts in the context of the ART-WiSe and open-ZB research frameworks that have contributed to the release of an open-source toolset of the IEEE 802.15.4/ZigBee protocol stack. He is the Chair of the TinyOS ZigBee Working Group, whose purpose is achieving a standard-compliant open-source implementation of ZigBee over TinyOS. In addition, he is involved in the CONET European Network of Excellence, in particular with the research cluster COTS-based architecture for QoS in large-scale distributed embedded systems. He is also actively participating as a reviewer or a program committee member in some reputed international journals, conferences and workshops dealing with real-time networks, quality-of-service, wireless communications, and related issues.

    Maissa Ben Jamaa is a Master Student at the Faculty of Economics and Management of Sfax and subscribed to RedCad research unit at the National School of Engineering of Sfax (Research Unit on Development and Control of Distributed Applications). In 2008 and in the context of Nouha Baccour phd Thesis, Maissa completed her engineer degree in Computer Science with a final study project interesting in a comparative simulation study of link quality estimators in wireless sensor networks. The results of this collaborated work have been published to MASCOTS2009 conference. Still working in the context of Nouha Baccour phd Thesis, Maissa is currently preparing her Master thesis dealing with link quality estimation in wireless sensor networks which has lead to numerous contributions published at EWSN10 conference and SensorNets09 school. You can visit Maissa homepage at this link: http://www.redcad.org/members/maissa.benjamaa/.

    Denis Lima do Rosário was born in 1986 in Castanhal, Brasil. He received a degree in computer engineering at Instituto de Estudos Superiores da Amazônia in Brasil, in 2007. Currently he doing Master in Automation and Systems Engineering at Universidade Federal de Santa Catarina in Brasil. His research interests is in sensor networks and Link Quality Estimation.

    Habib Youssef received a Diplôme d’Ingénieur en Informatique from the Faculté des Sciences de Tunis, University of El-Manar, Tunisia in June 1982 and a Ph.D. in computer science from the University of Minnesota, USA, in January 1990. From September 1990 to January 2001 he was a Faculty member of the computer engineering department of King Fahd University of Petroleum & Minerals (KFUPM), Saudi Arabia (Assistant Professor from 1990 to 1995 and Associate Professor from September 1995 to January 2001). From February 2001 to June 2002, he was a Maitre de Conférences en informatique at the Faculté des Sciences de Monastir (FSM), University of Monastir, Tunisia. From July 2002 to August 2005, he served as the Director of the Institut Supérieur d’Informatique et Mathematiques of the University of Monastir. He is currently serving as a Professor of computer science and Director of the Institut Supérieur d’Informatique et des Technologies de Communication, Hammam Sousse, University of Sousse, Tunisia. Dr. Habib Youssef has over 130 publications to his credit in the form of books, book chapters, and journal and conference papers. He is the author with S. Sait of two books, (1) ”VLSI Physical Design Automation: Theory and Practice”, McGraw-Hill 1995, (also co-published by IEEE Press 1995), and reprinted with corrections by World Scientific in 1999, and (2) ”Iterative Computer Algorithms with Applications in Engineering”, IEEE CS Press 1999, and since 2003 published by John Wiley & Sons, which has also been translated into Japanese. His current research interests are computer networks, performance evaluation of computer systems, and algorithms for combinatorial optimization.

    Mário Alves was born in 1968 and has a degree (1991), a M.Sc. (1995) and a Ph.D. (2003) in Electrical and Computer Engineering at the University of Porto, Portugal. He is a Professor in Electrical and Computer Engineering at the Polytechnic Institute of Porto (ISEP/IPP) and a Research Associate of the CISTER/IPP-HURRAY Research Unit, focusing on real-time, distributed and embedded computing systems. He participated in several international projects related to industrial communication systems (e.g. CCE-CNMA, RFieldbus). He has been serving as a reviewer and publishing in top conferences (e.g. RTSS, ECRTS, ICDCS, OPODIS, MASS) and journals (e.g. IEEE TII, Elsevier ComNet, Springer RTSJ) in his expertise areas, got best paper awards (e.g. ECRTS’07) and supervised the EWSN’09 best M.Sc. Thesis award. He actively participated in the organization of several international conferences and workshops, e.g. IEEE WFCS’00 and ECRTS’03. His current research interests are mainly devoted to improving quality-of-service (QoS) in wireless sensor networks by using standard and commercial-off-the-shelf (COTS) technology (http/www.hurray.isep.ipp.pt/ART-WiSe,http://www.open-ZB.net). He is involved in international projects on networked embedded systems (ArtistDesign), cooperating objects (CONET), large-scale embedded monitoring using wireless sensor networks (EMMON) and cyber-physical systems for monitoring critical physical infrastructures (under the PT-CMU program).

    Leandro Buss Becker was born in Alegrete, Brazil, in 1976. He has a bachelor degree in Computer Science (1997) from Federal University of Santa Maria and Master (1999) and Ph.D. (2003) from the Federal University of Rio Grande do Sul. His thesis was about a Real-Time Systems Design Methodology. In 2001 he had a research stay in the Real-time Systems and Communication Group (EuK) from the University of Magdeburg, Germany. Since 2004 he is an Associated Professor at the Department of Automation and Systems Engineering of the Federal University of Santa Catarina (UFSC), Brazil. His research interests include Software Engineering for Real-time and Embedded Critical Systems, Real-Time CPU/Message Scheduling, Wireless Communication in Mobile Systems, and Wireless Sensor Networks. He has coordinated a number of R&D projects on embedded and real-time systems, including real-time control systems, wireless communication, and design of embedded critical systems. Such projects where sponsored by the Brazilian Scientific Agency (CNPq) and local industries.

    View full text