Skip to main content

Interaction and Dialogue Design of a Humanoid Social Robot in an Analogue Neurorehabilitation Application

  • Conference paper
  • First Online:

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 244))

Abstract

Neurorehabilitation therapies for stroke patients require many hours with therapists. To ease the lack of therapists, a solution may be given by the usage of a humanoid social robots. To prove, that this alternative may be viable, the therapy success must be compared to the gold standard of a human therapist. To achieve this, this robot variant should imitate and approximate the interaction with a human therapist. Thereby we have a focus on motivating the patient throughout the whole therapy. In this paper we describe the therapies with human therapists, highlight important requirements and our current solution for an implementation with the humanoid robot Pepper. We discuss the architecture of our solution and provide a specification of the dialogue structure with the robot based on expert interviews with medical doctors and therapists.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   299.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Forbrig, P., Bundea, A., Pedersen, A., Platz, T.: Digitalization of training tasks and specification of the behaviour of a social humanoid robot as coach. In: Bernhaupt, R., Ardito, C., Sauer, S. (eds.) HCSE 2020. LNCS, vol. 12481, pp. 45–57. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-64266-2_3

    Chapter  Google Scholar 

  2. González, J.C., Pulido, J.C., Fernández, F.: A three-layer planning architecture for the autonomous control of rehabilitation therapies based on social robots. Cogn. Syst. Res. 43, 232–249 (2017)

    Article  Google Scholar 

  3. Görer, B., Salah, A.A., Akın, H.L.: An autonomous robotic exercise tutor for elderly people. Auton. Robot. 41(3), 657–678 (2016). https://doi.org/10.1007/s10514-016-9598-5

    Article  Google Scholar 

  4. Shao, M., Alves, S.F.D.R., Ismail, O., et al.: You are doing great! only one rep left: an affect-aware social robot for exercising. In: 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC). Bari, Italy, 6–9 October 2019. [IEEE], [Piscataway, New Jersey], pp 3811–3817 (2019)

    Google Scholar 

  5. Fernández-Rodicio, E., Castro-González, Á., Alonso-Martín, F., et al.: Modelling multimodal dialogues for social robots using communicative acts. Sensors 20, 3440 (2020)

    Article  Google Scholar 

  6. Hamido, F., Jun, H., Masaki, K.: Virtual medical doctor interaction based on transactional analysis. Front. Artif. Intell. Appl. 199, 503–517 (2009). https://doi.org/10.3233/978-1-60750-049-0-503

    Article  Google Scholar 

  7. Fujita, H., Hakura, J., Kurematsu, M.: Virtual Doctor System (VDS): medical decision reasoning based on physical and mental ontologies. In: García-Pedrajas, N., Herrera, F., Fyfe, C., Benítez, J.M., Ali, M. (eds.) IEA/AIE 2010. LNCS (LNAI), vol. 6098, pp. 419–428. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-13033-5_43

    Chapter  Google Scholar 

  8. Cristina, L.M., Matei, D., Ignat, B., et al.: Mirror therapy enhances upper extremity motor recovery in stroke patients. Acta. Neurol. Belg. 115, 597–603 (2015). https://doi.org/10.1007/s13760-015-0465-5

    Article  Google Scholar 

  9. Platz, T.: Impairment-oriented training - official. http://www.iotraining.eu/aft.html. Accessed 24 Nov 2020

  10. Robotics, S.: Meet pepper: the robot built for people | SoftBank Robotics America. https://us.softbankrobotics.com/pepper. Accessed 25 Nov 2020.788Z

  11. Pi Supply: Flick HAT - 3D Tracking & Gesture HAT for Raspberry Pi. https://uk.pi-supply.com/products/flick-hat-3d-tracking-gesture-hat-raspberry-pi. Accessed 11 Dec 2020.575Z

  12. Light, R.A.: Mosquitto: server and client implementation of the MQTT protocol. JOSS 2, 265 (2017)

    Article  Google Scholar 

  13. Salichs, M.A., et al.: Mini: a new social robot for the elderly. Int. J. Soc. Robot. 12(6), 1231–1249 (2020). https://doi.org/10.1007/s12369-020-00687-0

    Article  Google Scholar 

  14. Manuhara, G.W. M, Muthugala, M.A.V.J., Jayasekara, A.G.B.P: Design and development of an interactive service robot as a conversational companion for elderly people. In: 2018 Moratuwa Engineering Research Conference (MERCon). IEEE, pp. 378–383 (2018)

    Google Scholar 

  15. Kawahara, T.: Spoken dialogue system for a human-like conversational robot ERICA. In: D’Haro, L.F., Banchs, R.E., Li, H. (eds.) 9th International Workshop on Spoken Dialogue System Technology. LNEE, vol. 579, pp. 65–75. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-9443-0_6

    Chapter  Google Scholar 

  16. Kiefer, B., Willms, C.: Implementing diverse robotic interactive systems using VOnDA. In: International Joint Conference on Artificial Intelligence - Pacific Rim International Conference on Artificial Intelligence (2020)

    Google Scholar 

  17. Gümüslü, E., Barkana D.E., Köse, H.: Emotion recognition using EEG and physiological data for robot-assisted rehabilitation systems. In: Truong, K., Heylen, D., Czerwinski, M., et al. (eds) Companion Publication of the 2020 International Conference on Multimodal Interaction. ACM, New York, NY, USA, pp 379–387 (10252020)

    Google Scholar 

  18. Conti, D., Trubia, G., Buono, S., et al.: Affect recognition in autism: a single case study on integrating a humanoid robot in a standard therapy. Qwerty 14 (2019). https://doi.org/10.30557/QW000018

Download references

Acknowledgments

This joint research project “E-BRAiN - Evidence-based Robot-Assistance in Neurorehabilitation” is supported by the European Social Fund (ESF), reference: ESF/14-BM-A55–0001/19-A01, and the Ministry of Education, Science and Culture of Mecklenburg-Vorpommern, Germany. This work was further supported by the BDH Bundesverband Rehabilitation e.V. (charity for neurodisabilities) by a non-restricted personal grant to TP. The sponsors had no role in the decision to publish or any content of the publication.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexandru Bundea .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bundea, A., Bader, S., Forbrig, P. (2021). Interaction and Dialogue Design of a Humanoid Social Robot in an Analogue Neurorehabilitation Application. In: Zimmermann, A., Howlett, R.J., Jain, L.C., Schmidt, R. (eds) Human Centred Intelligent Systems . KES-HCIS 2021. Smart Innovation, Systems and Technologies, vol 244. Springer, Singapore. https://doi.org/10.1007/978-981-16-3264-8_8

Download citation

Publish with us

Policies and ethics