Skip to main content

Intent Recognition Using Recurrent Neural Networks on Vital Sign Data: A Machine Learning Approach

  • Conference paper
  • First Online:
Hybrid Artificial Intelligent Systems (HAIS 2023)

Abstract

The growing importance of technology in daily life has led to a focus on making robots think like humans to enhance the integration of humans and robots in Cyber-Physical Systems (CPS). Cognitive science and psychology offer important knowledge and tools for integrating human-like learning processes into robots. The challenge is to enhance robots with prior knowledge and information, rather than starting the learning process from scratch. The goal of this research is to enable efficient interaction and co-existence of humans, robots, and other agents in CPS. This paper presents a review of the current academic literature on identifying human intentions and feeding robots for their effectiveness when interacting with humans. As a new contribution, this paper also proposes a state-of-the-art solution for human intent recognition studies and focuses our research roadmap on emotion recognition using Vital Signs including electroencephalography (EEG) data (signals) to understand the intent of human action using deep learning techniques. The research also compares the prediction performance of recurrent neural networks (RNN) with other algorithms. Understanding humans’ intent using vital signs for effective co-existence of humans in the cyber physical system and how to identify the intent of the agent and ensure that it aligns with the context of the given task or goal based on immediate perceptible visual attributes and dynamic properties (the perception of movement, gaze, vocalization, and emotional state.)

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Pasandideh, S., Pereira, P., Gomes, L.: Cyber-physical-social systems: taxonomy, challenges, and opportunities. https://doi.org/10.1109/ACCESS.2022.3167441

  2. Lake, B.M., Ullman, T.D., Tenenbaum, J.B., Gershman, S.J.: Building machines that learn and think like people (2017). https://doi.org/10.1017/S0140525X16001837

  3. Brinck, I., Balkenius, C.: Recognition in human-robot interaction: the gateway to engagement; recognition in human-robot interaction: the gateway to engagement. In: 2019 Joint IEEE 9th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob) (2019). https://doi.org/10.1109/DEVLRN.2019.8850691

  4. Sandini, G., et al.: Social cognition for human-robot symbiosis-challenges and building blocks (2018). https://doi.org/10.3389/fnbot.2018.00034

  5. Bruyn, L., Lamoureux, T.: Literature review: cognitive effects of thermal strain

    Google Scholar 

  6. Wright, K.P., Hull, J.T., Czeisler, C.A.: Relationship between alertness, performance, and body temperature in humans. Am. J. Physiol.-Regul. Integrative Comp. Physiol. 283(6), R1370–R1377 (2002). https://doi.org/10.1152/ajpregu.00205.2002

    Article  Google Scholar 

  7. Chung, S.C., Iwaki, S., Tack, G.R., Yi, J.H., You, J.H., Kwon, J.H.: Effect of 30% oxygen administration on verbal cognitive performance, blood oxygen saturation and heart rate. Appl. Psychophysiol. Biofeedback 31(4), 281–293 (2006). https://doi.org/10.1007/S10484-006-9023-5/FIGURES/5

    Article  Google Scholar 

  8. Lyra, S., et al.: A deep learning-based camera approach for vital sign monitoring using thermography images for ICU patients (2021). https://doi.org/10.3390/s21041495

  9. Li, Y., Yang, H., Li, J., Chen, D., Du, M.: EEG-based intention recognition with deep recurrent-convolution neural network: performance and channel selection by Grad-CAM. Neurocomputing 415, 225–233 (2020). https://doi.org/10.1016/J.NEUCOM.2020.07.072

    Article  Google Scholar 

  10. Sun, M.-C., Hsu, S.-H., Yang, M.-C., Chien, J.-H.: Context-aware cascade attention-based RNN for video emotion recognition (2018). https://doi.org/10.1109/ACIIAsia.2018.8470372

  11. “(2) (PDF) Mental emotional sentiment classification with an EEG-based brain-machine interface. https://www.researchgate.net/publication/329403546_Mental_Emotional_Sentiment_Classification_with_an_EEG-based_Brain-machine_Interface#fullTextFileContent. Accessed 06 Apr 2023

  12. Roy, S., Kiral-Kornek, I., Harrer, S.: ChronoNet: a deep recurrent neural network for abnormal EEG identification, January 2018. http://arxiv.org/abs/1802.00308

  13. https://www.kaggle.com/datasets/canaria/5-gamers

  14. PhysioBank ATM. https://archive.physionet.org/cgi-bin/atm/ATM#input. Accessed 17 Apr 2023

  15. Human vital signs | Kaggle. https://www.kaggle.com/datasets/engrarri21/human-vital-signs. Accessed 16 Apr 2023

  16. Abadi, M.: Tensorflow: a system for large-scale machine learning. In: OSDI, vol. 16, pp. 265–283 (2016)

    Google Scholar 

Download references

Acknowledgement

The research has been funded by the Spanish Ministry of Economics and Industry, grant PID2020-112726RB-I00, by the Spanish Research Agency (AEI, Spain) under grant agreement RED2018–102312-T (IA-Biomed), and by the Ministry of Science and Innovation under CERVERA Excellence Network project CER-20211003 (IBERUS) and Missions Science and Innovation project MIG-20211008 (INMERBOT). Also, by Principado de Asturias, grant SV-PA-21-AYUD/2021/50994. By European Union’s Horizon 2020 research and innovation programme (project DIH4CPS) under the Grant Agreement no 872548. And by CDTI (Centro para el Desarrollo Tecnológico Industrial) under projects CER-20211003 and CER-20211022 and by ICE (Junta de Castilla y León) under project CCTT3/20/BU/0002.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Samson Mihirette .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mihirette, S., Tan, Q., De la Cal Martin, E.A. (2023). Intent Recognition Using Recurrent Neural Networks on Vital Sign Data: A Machine Learning Approach. In: García Bringas, P., et al. Hybrid Artificial Intelligent Systems. HAIS 2023. Lecture Notes in Computer Science(), vol 14001. Springer, Cham. https://doi.org/10.1007/978-3-031-40725-3_65

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-40725-3_65

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-40724-6

  • Online ISBN: 978-3-031-40725-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics