Skip to main content

Personalizing Multi-modal Human-Robot Interaction Using Adaptive Robot Behavior

  • Conference paper
  • First Online:
Social Robotics (ICSR 2023)

Abstract

Technology favors better life expectancy, changing the population distribution. This change is known as population aging and brings a lack of care professionals for older and impaired people. Social robotics has become a promising alternative to alleviate this problem in recent years, assisting society. Human-robot interaction is a research area related to social robotics that explores designing effective methods for appropriately understanding robots and users. This paper investigates the design of personalized Human-robot Interaction strategies to provide an adapted experience that facilitates vulnerable people’s use of the Mini social robot. The robot uses Random Forest classification to facilitate multi-modal interaction by predicting the most suitable parameters regarding the interaction time, font size, audio volume, answer time, exercise level, and answer channel. The classification problem is solved using a dataset from 240 participants who completed an online survey about their features and interaction modalities, completing activities about audio, visual, and motor skills. The results show the promising classification scores that Random Forest produced for this task and describe the application of the predicted information during the interaction of the Mini robot with an older adult.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aly, A., Tapus, A.: A model for synthesizing a combined verbal and nonverbal behavior based on personality traits in human-robot interaction. In: 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 325–332. IEEE (2013)

    Google Scholar 

  2. Baraka, K., Alves-Oliveira, P., Ribeiro, T.: An extended framework for characterizing social robots. Hum.-Robot Interact. Eval. Methods Stand. 21–64 (2020)

    Google Scholar 

  3. Benedictis, R.D., Umbrico, A., Fracasso, F., Cortellessa, G., Orlandini, A., Cesta, A.: A dichotomic approach to adaptive interaction for socially assistive robots. User Model. User-Adapt. Interact. 33(2), 293–331 (2023)

    Article  Google Scholar 

  4. Di Napoli, C., Ercolano, G., Rossi, S.: Personalized home-care support for the elderly: a field experience with a social robot at home. User Model. User-Adapt. Interact. 33(2), 405–440 (2023)

    Article  Google Scholar 

  5. Feurer, M., Klein, A., Eggensperger, K., Springenberg, J., Blum, M., Hutter, F.: Efficient and robust automated machine learning. Adv. Neural Inf. Process. Syst. 28 (2015)

    Google Scholar 

  6. Fischinger, D., et al.: Hobbit, a care robot supporting independent living at home: first prototype and lessons learned. Robot. Auton. Syst. 75, 60–78 (2016)

    Article  Google Scholar 

  7. Gao, Y., Chang, H.J., Demiris, Y.: User modelling for personalised dressing assistance by humanoid robots. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1840–1845. IEEE (2015)

    Google Scholar 

  8. Klee, S.D., Ferreira, B.Q., Silva, R., Costeira, J.P., Melo, F.S., Veloso, M.: Personalized assistance for dressing users. In: ICSR 2015. LNCS (LNAI), vol. 9388, pp. 359–369. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25554-5_36

    Chapter  Google Scholar 

  9. Kramer, O., Kramer, O.: Scikit-learn. Mach. Learn. Evol. Strateg. 45–53 (2016)

    Google Scholar 

  10. Louie, W.Y.G., Nejat, G.: A social robot learning to facilitate an assistive group-based activity from non-expert caregivers. Int. J. Soc. Robot. 12(5), 1159–1176 (2020)

    Article  Google Scholar 

  11. Maroto-Gómez, M., Alonso-Martín, F., Malfaz, M., Castro-González, Á., Castillo, J.C., Salichs, M.Á.: A systematic literature review of decision-making and control systems for autonomous and social robots. Int. J. Soc. Robot. 15(5), 745–789 (2023)

    Article  Google Scholar 

  12. Maroto-Gómez, M., Marqués-Villaroya, S., Castillo, J.C., Castro-González, Á., Malfaz, M.: Active learning based on computer vision and human-robot interaction for the user profiling and behavior personalization of an autonomous social robot. Eng. Appl. Artif. Intell. 117, 105631 (2023)

    Article  Google Scholar 

  13. Martins, G.S., Santos, L., Dias, J.: User-adaptive interaction in social robots: a survey focusing on non-physical interaction. Int. J. Soc. Robot. 11, 185–205 (2019)

    Article  Google Scholar 

  14. Mitsunaga, N., Smith, C., Kanda, T., Ishiguro, H., Hagita, N.: Adapting robot behavior for human-robot interaction. IEEE Trans. Robot. 24(4), 911–916 (2008)

    Article  Google Scholar 

  15. Rossi, S., Ferland, F., Tapus, A.: User profiling and behavioral adaptation for HRI: a survey. Pattern Recognit. Lett. 99, 3–12 (2017)

    Article  Google Scholar 

  16. Salichs, M.A., et al.: Mini: a new social robot for the elderly. Int. J. Soc. Robot. 12, 1231–1249 (2020)

    Article  Google Scholar 

  17. Steinfeld, A., et al.: Common metrics for human-robot interaction. In: Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction, pp. 33–40 (2006)

    Google Scholar 

Download references

Acknowledgements

The research leading to these results has received funding from the grants PID2021-123941OA-I00, funded by MCIN/AEI/ 10.13039/501100011033 and by “ERDF A way of making Europe”; TED2021-132079B-I00 funded by MCIN/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR; Mejora del nivel de madurez tecnologica del robot Mini (MeNiR) funded by MCIN/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marcos Maroto-Gómez .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Maroto-Gómez, M., Huisa-Rojas, A., Castro-González, Á., Malfaz, M., Salichs, M.Á. (2024). Personalizing Multi-modal Human-Robot Interaction Using Adaptive Robot Behavior. In: Ali, A.A., et al. Social Robotics. ICSR 2023. Lecture Notes in Computer Science(), vol 14454. Springer, Singapore. https://doi.org/10.1007/978-981-99-8718-4_33

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-8718-4_33

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-8717-7

  • Online ISBN: 978-981-99-8718-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics