Abstract
In a near future, robots will permeate our daily life; indeed, they have the potential to proactively support the senior citizen in tedious and different daily tasks (i.e. cleaning, gaming, walking activity, promote socialization). However, to efficiently cooperate with human-beings, robots should have enhanced human–robot interaction capabilities. This work addresses the challenge of designing a robotic model by simulating the modality human beings interact with each other. The first objective of this work concerns the identification of the social cues which correctly describe the user’s emotional and engagement state during the interaction. Based on selected descriptors, a perceptual system has been proposed to detect elderly’s behavior in a social context. The proposed architecture is inspired to the human brain structure as concern the functionalities modules and analogies in the modules’ location. The proposed perceptual system aims at transforming raw data coming from three kinds of sensors (camera, microphone, and laser) into behavioral patterns by mimicking the abstraction evolution which characterizes the consciousness process of the human brain.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
References
United Nations Department of Economic and Social Affairs Population Division: E02 World Population Prospects The 2017 Revision: Key Findings and Advance Tables. World Popul. Prospect. 2017 (2017) https://doi.org/10.1017/CBO9781107415324.004
Cortellessa G, Fracasso F, Sorrentino A, Orlandini A, Bernardi G, Coraci L, De Benedictis R, Cesta A (2017) Enhancing the interactive services of a telepresence robot for AAL: Developments and a psycho-physiological assessment. In: Lecture Notes in Electrical Engineering. https://doi.org/10.1007/978-3-319-54283-6_25
Tapus A, Mataric MJ, Scassellati B (2007) Socially assistive robotics [Grand challenges of robotics]. IEEE Robot Autom Mag 14:35–42. https://doi.org/10.1109/MRA.2007.339605
Kaiser FG, Glatte K, Lauckner M (2019) How to make nonhumanoid mobile robots more likable: employing kinesic courtesy cues to promote appreciation. Appl Ergon 78:70–75. https://doi.org/10.1016/j.apergo.2019.02.004
Vinciarelli A, Pantic M, Bourlard H (2009) Social signal processing: survey of an emerging domain. Image Vis Comput 27:1743–1759. https://doi.org/10.1016/j.imavis.2008.11.007
Frith U, Frith CD (2003) Development and neurophysiology of mentalizing.https://doi.org/10.1098/rstb.2002.1218
Fukuda T, Chen F, Shi Q (2018) Special feature on bio-inspired robotics.https://doi.org/10.3390/app8050817
Tononi G, Sporns O (2003) Measuring information integration. BMC Neurosci 4. https://doi.org/10.1186/1471-2202-4-31
Sporns O (2007) What neuro-robotic models can teach us about neural and cognitive development. Neuroconstructivism Perspect Prospect 2:179–204. https://doi.org/10.1093/acprof:oso/9780198529934.003.0008
Balkenius C, Morén J (2001) Emotional learning: a computational model of the amygdala. Cybern Syst 32:611–636
Raymundo CR, Johnson CG, Vargas PA (2015) An architecture for emotional and context-aware associative learning for robot companions.https://doi.org/10.1109/ROMAN.2015.7333699
Dağlarlı E, Dağlarlı SF, Günel GÖ, Köse H (2017) Improving human-robot interaction based on joint attention. Appl Intell 47:62–82. https://doi.org/10.1007/s10489-016-0876-x
Al-Qaderi MK, Rad AB (2018) A brain-inspired multi-modal perceptual system for social robots: an experimental realization. IEEE Access 6:35402–35424. https://doi.org/10.1109/ACCESS.2018.2851841
Premack D, Woodruff G (1978) Does the chimpanzee have a theory of mind? Behav Brain Sci 1:515–526. https://doi.org/10.1017/S0140525X00076512
Wiltshire TJ, Warta SF, Barber D, Fiore SM (2017) Enabling robotic social intelligence by engineering human social-cognitive mechanisms. Cogn Syst Res 43:190–207. https://doi.org/10.1016/j.cogsys.2016.09.005
Franchi AM, Mutti F, Gini G (2016) From learning to new goal generation in a bioinspired robotic setup. Adv Robot 30:795–805. https://doi.org/10.1080/01691864.2016.1172732
Jones EG (2012) The thalamus. Springer Science & Business Media, Berlin
Cacioppo JT, Tassinary LG, Berntson G (2007) Handbook of psychophysiology
Damasio AR (1989) The brain binds entities and events by multiregional activation from convergence zones. Neural Comput 1:123–132. https://doi.org/10.1162/neco.1989.1.1.123
Scheflen AE (1964) The significance of posture in communication systems. Psychiatry 27:316–331. https://doi.org/10.1080/00332747.1964.11023403
Darwin C, Prodger P (1998) The expression of the emotions in man and animals.https://doi.org/10.1017/CBO9780511694110
Costa M, Dinsbach W, Manstead ASR, Ricci Bitti PE (2001) Social presence, embarrassment, and nonverbal behavior. J Nonverbal Behav 25, 225–240. https://doi.org/10.1023/A:1012544204986
Ekman P (1993) Facial expression and emotion. Am Psychol. https://doi.org/10.1037/0003-066X.48.4.384
Emery NJ (2000) The eyes have it: the neuroethology, function and evolution of social gaze. Neurosci Biobehav Rev 24:581–604. https://doi.org/10.1016/S0149-7634(00)00025-7
Mason MF, Tatkow EP, Macrae CN (2005) The look of love: gaze shifts and person perception. Psychol Sci 16:236–239. https://doi.org/10.1111/j.0956-7976.2005.00809.x
Scherer KR (2003) Vocal communication of emotion: a review of research paradigms. Speech Commun 40:227–256. https://doi.org/10.1016/S0167-6393(02)00084-5
Scherer KR (1979) Personality markers in speech. In: Social markers in speech. Cambridge University Press
Glass CR, Merluzzi TV, Biever JL, Larsen KH (1982) Cognitive assessment of social anxiety: development and validation of a self-statement questionnaire. Cognit Ther Res 6:37–55. https://doi.org/10.1007/BF01185725
Cavallo F, Limosani R, Fiorini L, Esposito R, Furferi R, Governi L, Carfagni M (2018) Design impact of acceptability and dependability in assisted living robotic applications. Int J Interact Des Manuf 12. https://doi.org/10.1007/s12008-018-0467-7
D’Onofrio G, Fiorini L, de Mul M, Fabbricotti I, Okabe Y, Hoshino H, Limosani R, Vitanza A, Greco F, Giuliani F, Guiot D, Senges E, Kung A, Cavallo F, Sancarlo D, Greco A (2018) Agile Co-creation for robots and aging (ACCRA) project: new technological solutions for older people. Eur Geriatr Med 1–6. https://doi.org/10.1007/s41999-018-0106-7
Cao Z, Simon T, Wei SE, Sheikh Y (2017) Realtime multi-person 2D pose estimation using part affinity fields. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). pp 7291–7299. https://doi.org/10.1109/CVPR.2017.143
Viola P, Jones M (2001) Robust real-time object detection. Int J Comput Vis 4, 34–47
Admoni H, Scassellati B (2017) Social eye gaze in human-robot interaction: a review. J Human-Robot Interact 6:25–63. https://doi.org/10.5898/jhri.6.1.admoni
Vrigkas M, Nikou C, Kakadiaris IA (2015) A review of human activity recognition methods. Front Robot AI 2. https://doi.org/10.3389/frobt.2015.00028
Baltrušaitis T, Ahuja C, Morency LP (2019) Multimodal machine learning: a survey and taxonomy.https://doi.org/10.1109/TPAMI.2018.2798607
Srivastava N, Salakhutdinov RR (2012) Multimodal learning with deep boltzmann machines. Adv Neural Inf Process Syst 2222–2230. https://doi.org/10.1109/CVPR.2013.49
Lan T, Sigal L, Mori G (2012) Social roles in hierarchical models for human activity recognition. In: IEEE conference on computer vision and pattern recognition. pp 1354–1361. https://doi.org/10.1109/CVPR.2012.6247821
Acknowledgements
This work was supported by the ACCRA Project, founded by the European Commission—Horizon 2020 Founding Programme (H2020-SCI-PM14-2016) and National Institute of Information and Communications Technology (NICT) of Japan under grant agreement No. 738251.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sorrentino, A., Fiorini, L., Mancioppi, G., Nocentini, O., Cavallo, F. (2021). Preliminary Study of Brain-Inspired Model for Multimodal Human Behavior Detection in Social Context. In: Monteriù, A., Freddi, A., Longhi, S. (eds) Ambient Assisted Living. ForItAAL 2019. Lecture Notes in Electrical Engineering, vol 725. Springer, Cham. https://doi.org/10.1007/978-3-030-63107-9_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-63107-9_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63106-2
Online ISBN: 978-3-030-63107-9
eBook Packages: EngineeringEngineering (R0)