Abstract
The growing importance of technology in daily life has led to a focus on making robots think like humans to enhance the integration of humans and robots in Cyber-Physical Systems (CPS). Cognitive science and psychology offer important knowledge and tools for integrating human-like learning processes into robots. The challenge is to enhance robots with prior knowledge and information, rather than starting the learning process from scratch. The goal of this research is to enable efficient interaction and co-existence of humans, robots, and other agents in CPS. This paper presents a review of the current academic literature on identifying human intentions and feeding robots for their effectiveness when interacting with humans. As a new contribution, this paper also proposes a state-of-the-art solution for human intent recognition studies and focuses our research roadmap on emotion recognition using Vital Signs including electroencephalography (EEG) data (signals) to understand the intent of human action using deep learning techniques. The research also compares the prediction performance of recurrent neural networks (RNN) with other algorithms. Understanding humans’ intent using vital signs for effective co-existence of humans in the cyber physical system and how to identify the intent of the agent and ensure that it aligns with the context of the given task or goal based on immediate perceptible visual attributes and dynamic properties (the perception of movement, gaze, vocalization, and emotional state.)
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Pasandideh, S., Pereira, P., Gomes, L.: Cyber-physical-social systems: taxonomy, challenges, and opportunities. https://doi.org/10.1109/ACCESS.2022.3167441
Lake, B.M., Ullman, T.D., Tenenbaum, J.B., Gershman, S.J.: Building machines that learn and think like people (2017). https://doi.org/10.1017/S0140525X16001837
Brinck, I., Balkenius, C.: Recognition in human-robot interaction: the gateway to engagement; recognition in human-robot interaction: the gateway to engagement. In: 2019 Joint IEEE 9th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob) (2019). https://doi.org/10.1109/DEVLRN.2019.8850691
Sandini, G., et al.: Social cognition for human-robot symbiosis-challenges and building blocks (2018). https://doi.org/10.3389/fnbot.2018.00034
Bruyn, L., Lamoureux, T.: Literature review: cognitive effects of thermal strain
Wright, K.P., Hull, J.T., Czeisler, C.A.: Relationship between alertness, performance, and body temperature in humans. Am. J. Physiol.-Regul. Integrative Comp. Physiol. 283(6), R1370–R1377 (2002). https://doi.org/10.1152/ajpregu.00205.2002
Chung, S.C., Iwaki, S., Tack, G.R., Yi, J.H., You, J.H., Kwon, J.H.: Effect of 30% oxygen administration on verbal cognitive performance, blood oxygen saturation and heart rate. Appl. Psychophysiol. Biofeedback 31(4), 281–293 (2006). https://doi.org/10.1007/S10484-006-9023-5/FIGURES/5
Lyra, S., et al.: A deep learning-based camera approach for vital sign monitoring using thermography images for ICU patients (2021). https://doi.org/10.3390/s21041495
Li, Y., Yang, H., Li, J., Chen, D., Du, M.: EEG-based intention recognition with deep recurrent-convolution neural network: performance and channel selection by Grad-CAM. Neurocomputing 415, 225–233 (2020). https://doi.org/10.1016/J.NEUCOM.2020.07.072
Sun, M.-C., Hsu, S.-H., Yang, M.-C., Chien, J.-H.: Context-aware cascade attention-based RNN for video emotion recognition (2018). https://doi.org/10.1109/ACIIAsia.2018.8470372
“(2) (PDF) Mental emotional sentiment classification with an EEG-based brain-machine interface. https://www.researchgate.net/publication/329403546_Mental_Emotional_Sentiment_Classification_with_an_EEG-based_Brain-machine_Interface#fullTextFileContent. Accessed 06 Apr 2023
Roy, S., Kiral-Kornek, I., Harrer, S.: ChronoNet: a deep recurrent neural network for abnormal EEG identification, January 2018. http://arxiv.org/abs/1802.00308
PhysioBank ATM. https://archive.physionet.org/cgi-bin/atm/ATM#input. Accessed 17 Apr 2023
Human vital signs | Kaggle. https://www.kaggle.com/datasets/engrarri21/human-vital-signs. Accessed 16 Apr 2023
Abadi, M.: Tensorflow: a system for large-scale machine learning. In: OSDI, vol. 16, pp. 265–283 (2016)
Acknowledgement
The research has been funded by the Spanish Ministry of Economics and Industry, grant PID2020-112726RB-I00, by the Spanish Research Agency (AEI, Spain) under grant agreement RED2018–102312-T (IA-Biomed), and by the Ministry of Science and Innovation under CERVERA Excellence Network project CER-20211003 (IBERUS) and Missions Science and Innovation project MIG-20211008 (INMERBOT). Also, by Principado de Asturias, grant SV-PA-21-AYUD/2021/50994. By European Union’s Horizon 2020 research and innovation programme (project DIH4CPS) under the Grant Agreement no 872548. And by CDTI (Centro para el Desarrollo Tecnológico Industrial) under projects CER-20211003 and CER-20211022 and by ICE (Junta de Castilla y León) under project CCTT3/20/BU/0002.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Mihirette, S., Tan, Q., De la Cal Martin, E.A. (2023). Intent Recognition Using Recurrent Neural Networks on Vital Sign Data: A Machine Learning Approach. In: García Bringas, P., et al. Hybrid Artificial Intelligent Systems. HAIS 2023. Lecture Notes in Computer Science(), vol 14001. Springer, Cham. https://doi.org/10.1007/978-3-031-40725-3_65
Download citation
DOI: https://doi.org/10.1007/978-3-031-40725-3_65
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-40724-6
Online ISBN: 978-3-031-40725-3
eBook Packages: Computer ScienceComputer Science (R0)