Abstract
The Internet of Things (IoT) creates environments where devices and users interact. Service-oriented architectures (SOAs) encapsulate devices’ capabilities as IoT services which users can request. SOAs manage the scale of IoT services by placing services descriptions about appropriate services in distributed architectures (e.g., a network of IoT gateways). Such distribution increases the chances of responding to users in an efficient fashion as requests are attended locally. However, dynamic IoT environments can easily outdate the distribution of services descriptions, which in turn impacts SOAs efficiency when the required services descriptions are not in place. Current architectures use pre-defined knowledge to adapt the distribution of services descriptions reactively. However, such human intervention is not always available and may be error-prone in dynamic IoT environments. We propose a reinforcement learning model that IoT gateways use to automatically decide how to distribute services descriptions over time. We evaluate the model in a real IoT testbed and results show that its performance in different scenarios compares favourably against a reactive baseline.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Smart City SD GitLab - https://gitlab.scss.tcd.ie/groups/smartcitySD/subgroups.
References
Athanasopoulos, D.: Self-adaptive service organization for pragmatics-aware service discovery. In: 2017 IEEE International Conference on Services Computing (SCC), pp. 164–171. IEEE (2017)
Butt, T.A., Phillips, I., Guan, L., Oikonomou, G.: Adaptive and context-aware service discovery for the internet of things. In: Balandin, S., Andreev, S., Koucheryavy, Y. (eds.) NEW2AN/ruSMART -2013. LNCS, vol. 8121, pp. 36–47. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40316-3_4
Cabrera, C., Clarke, S.: A self-adaptive service discovery model for smart cities. IEEE Trans. Serv. Comput., 1 (2019). https://ieeexplore.ieee.org/document/8851303
Cabrera, C., Palade, A., Clarke, S.: An evaluation of service discovery protocols in the internet of things. In: Proceedings of the Symposium on Applied Computing, pp. 469–476. ACM (2017)
Cabrera, C., White, G., Palade, A., Clarke, S.: The right service at the right place: a service model for smart cities. In: Proceedings of Pervasive Computing Conference, pp. 469–476. IEEE (2018)
Fathy, Y., Barnaghi, P., Tafazolli, R.: Large-scale indexing, discovery, and ranking for the internet of things (IoT). ACM Comput. Surv. (CSUR) 51(2), 29 (2018)
Fredj, S.B., Boussard, M., Kofman, D., Noirie, L.: Efficient semantic-based IoT service discovery mechanism for dynamic environments. In: 2014 IEEE 25th Annual International Symposium on Personal, Indoor, and Mobile Radio Communication (PIMRC), pp. 2088–2092. IEEE (2014)
Kumar, V.V., Satyanarayana, N.: Self-adaptive semantic classification using domain knowledge and web usage log for web service discovery. Int. J. Appl. Eng. Res. 11(6), 4618–4622 (2016)
Sutton, R.S., Barto, A.G.: Reinforcement Learning, Second Edition: An Introduction. MIT Press (2018). https://books.google.co.uk/books?id=uWV0DwAAQBAJ
del Val, E., Rebollo, M., Botti, V.: Combination of self-organization mechanisms to enhance service discovery in open systems. Info. Sci. 279, 138–162 (2014)
Watkins, C.J., Dayan, P.: Q-learning. Mach. Learn. 8(3–4), 279–292 (1992)
Watkins, C.J.C.H.: Learning from delayed rewards. Ph.D. thesis, University of Cambridge (1989)
Acknowledgment
This work is supported by Science Foundation Ireland under grant 13/IA/1885. Computational resources have been provided by the TCHPC funded by eINIS.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Cabrera, C., Clarke, S. (2021). A Reinforcement Learning-Based Service Model for the Internet of Things. In: Hacid, H., Kao, O., Mecella, M., Moha, N., Paik, Hy. (eds) Service-Oriented Computing. ICSOC 2021. Lecture Notes in Computer Science(), vol 13121. Springer, Cham. https://doi.org/10.1007/978-3-030-91431-8_56
Download citation
DOI: https://doi.org/10.1007/978-3-030-91431-8_56
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-91430-1
Online ISBN: 978-3-030-91431-8
eBook Packages: Computer ScienceComputer Science (R0)