Authors:
Liana M. Carvalho
;
Valéria Lelli
and
Rossana M. C. Andrade
Affiliation:
Group of Computer Network, Software Engineering and Systems - Federal University of Ceará - Fortaleza, Brazil
Keyword(s):
Internet of Things, Software Testing, Performance Testing, Guidelines.
Abstract:
Internet of Things (IoT) applications are characterized by the use of smart objects that are connected to the Internet to provide different types of services. These objects usually generate data that need to be stored and analyzed to contribute to decision making (whether or not they are immediate). In this context, such applications may require high performance, low cost and good scalability. These requirements bring new testing challenges and the need for specific approaches, for example, the detection of performance failures among heterogeneous IoT devices, which process a large amount of data and, under uncertain conditions, must have their resources optimized. Thus, our goal is to propose a performance testing guide for the evaluation of IoT applications. To build the guide, we performed a literature review to identify the IoT standards and analyzed IoT bug repositories. In this paper, we present the Performance Testing Guide for IoT applications. To validate the proposed guide,
we conducted two evaluations: (i) an evaluation with the experts; and (ii) a controlled experiment. The results showed that the guide provides a systematization of testing activities, helping the evaluation of IoT aspects intrinsic to performance.
(More)