Abstract
As the Internet of Things (IoT) becomes a reality, the need of ensuring the security and reliability of massively interconnected devices becomes a pressing necessity. A means of satisfying this need would be automated testing of IoT devices; however, this presents many difficulties, such as the lack of standards, multitude of manufacturers, restricted capabilities (such as power), etc.
In this work we present the first results on using TESTAR tool for automating IoT testing of smart home devices. TESTAR is a tool for automated testing at the Graphical User Interface (GUI) level of an application. The tool uses the Accessibility API the obtain information about the GUI and derive actions that can be executed in test sequences. Many IoT systems use the REST API to access the resources that compose the system. Consequently, this paper looks into IoT system testing as a natural field for extending the TESTAR philosophy from GUI (Accesibility) to IoT (REST) APIs.
The results show the potential of TESTAR in this new environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Bauersfeld, S., de Rojas, A., Vos, T.E.J.: Evaluating rogue user testing in industry: an experience report. In: IEEE Eighth International Conference on Research Challenges in Information Science (RCIS), pp. 1–10, May 2014
Bauersfeld, S., Vos, T.: A reinforcement learning approach to automated GUI robustness testing. In: Fast Abstracts of the 4th Symposium on Search-Based Software Engineering (SSBSE 2012), pp. 7–12. IEEE (2012)
Bauersfeld, S., Vos, T.E.J., Condori-Fernández, N., Bagnato, A., Brosse, E.: Evaluating the TESTAR tool in an industrial case study. In: ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2014, Torino, Italy, 18–19 September 2014, p. 4 (2014)
Business. The Internet of Things: where the smart is. Economist 419(8993), 52–53 (2016)
Cetina, C., Giner, P., Fons, J., Pelechano, V.: Using feature models for developing self-configuring smart homes. In: Fifth International Conference on Autonomic and Autonomous Systems, pp. 179–188 (2009)
Frizell, S.: The smarter home. Special report. Time Mag. 184(1) (2014)
Grnbk, I.: Architecture for the internet of things (IoT): API and interconnect. In: Second International Conference on Sensor Technologies and Applications (SENSORCOMM 2008), pp. 802–807, August 2008
Hagar, J.: Experience report: a guide through the challenges and risks of testing the IoT. LogiGEAR Mag. VII(3) (2014)
Haller, S., Karnouskos, S., Schroth, C.: The Internet of Things in an enterprise context. In: Domingue, J., Fensel, D., Traverso, P. (eds.) FIS 2008. LNCS, vol. 5468, pp. 14–28. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-00985-3_2
Almenar, F., Esparcia-Alcázar, A.I., Martínez, M., Rueda, U.: Automated testing of web applications with TESTAR. In: Sarro, F., Deb, K. (eds.) SSBSE 2016. LNCS, vol. 9962, pp. 218–223. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-47106-8_15
Richardson, L., Ruby, S.: RESTful Web Services (2008)
Rueda, U., Vos, T.E.J., Almenar, F., Martínez, M.O., Esparcia-Alcázar, A.I.: TESTAR: from academic prototype towards an industry-ready tool for automated testing at the user interface level. In: Canos, J.H., Gonzalez Harbour, M. (eds.) Actas de las XX Jornadas de Ingeniería del Software y Bases de Datos (JISBD 2015), pp. 236–245 (2015)
Tnjes, R., Reetz, E.S., Moessner, K., Barnaghi, P.M.: A test-driven approach for life cycle management of internet of things enabled services. In: Future Network Mobile Summit (FutureNetw 2012), pp. 1–8 (2012)
van der Mersch, V.: Automated testing for the Internet of Things. Nordic APIs Blog, May 2016
van der Meulen, R.: Gartner says 6.4 billion connected “things” will be in use in 2016, up 30 percent from 2015. Press release, November 2015
Vos, T.E.J., Kruse, P.M., Condori-Fernández, N., Bauersfeld, S., Wegener, J.: TESTAR: tool support for test automation at the user interface level. IJISMD 6(3), 46–83 (2015)
Zhang, Z.K., Cho, M.C.Y., Wang, C.W., Hsu, C.W., Chen, C.K., Shieh, S.: IoT security: ongoing challenges and research opportunities. In: IEEE 7th International Conference on Service-Oriented Computing and Applications, pp. 230–234, November 2014
Acknowledgement
The authors would like to thank Vicente Pelechano, Urko Rueda and Francisco Almenar for their invaluable help that has made this work possible. This work was partly funded by the ITEA3 TESTOMAT project (16032).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Martínez, M., Esparcia-Alcázar, A.I., Vos, T.E.J., Aho, P., i Cors, J.F. (2018). Towards Automated Testing of the Internet of Things: Results Obtained with the TESTAR Tool. In: Margaria, T., Steffen, B. (eds) Leveraging Applications of Formal Methods, Verification and Validation. Distributed Systems. ISoLA 2018. Lecture Notes in Computer Science(), vol 11246. Springer, Cham. https://doi.org/10.1007/978-3-030-03424-5_25
Download citation
DOI: https://doi.org/10.1007/978-3-030-03424-5_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-03423-8
Online ISBN: 978-3-030-03424-5
eBook Packages: Computer ScienceComputer Science (R0)