Skip to main content
Springer Nature Link
Log in

Does Elderly Enjoy Playing Bingo with a Robot? A Case Study with the Humanoid Robot Nadine

  • Conference paper
  • First Online:
Advances in Computer Graphics (CGI 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 13002))

Included in the following conference series:

  • 2265 Accesses

Abstract

There are considerable advancements in medical health care in recent years, resulting in a rising older population. As the workforce for such a population is not keeping pace, there is an urgent need to address this problem. Having robots to stimulating recreational activities for older adults can reduce the workload for caretakers and give them time to address the emotional needs of the elderly. In this paper, we investigate the effects of the humanoid social robot Nadine as an activity host for the elderly. We propose to evaluate this by placing Nadine humanoid social robot in a nursing home as a caretaker where she hosts bingo game. We record sessions with and without Nadine to understand the difference and acceptance of these two scenarios. We use computer vision methods to analyse the activities of the elderly to detect emotions and their involvement in the game. Our results present positive enforcement during recreational activity, Bingo, in the presence of Nadine. This research is in line with all ethical recommendations as shown in our Annex.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    http://dlib.net/.

  2. 2.

    https://github.com/open-mmlab/mmaction2.

References

  1. Agrigoroaie, R., Tapus, A.: The outcome of a week of intensive cognitive stimulation in an elderly care setup: a pilot test. In: 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 814–819. IEEE (2018)

    Google Scholar 

  2. Agrigoroaie, R., Tapus, A.: Physiological differences depending on task performed in a 5-day interaction scenario designed for the elderly: a pilot study. In: Ge, S.S., et al. (eds.) ICSR 2018. LNCS (LNAI), vol. 11357, pp. 192–201. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-05204-1_19

    Chapter  Google Scholar 

  3. Baka, E., Vishwanath, A., Mishra, N., Vleioras, G., Thalmann, N.M.: “Am I talking to a human or a robot?’’: a preliminary study of human’s perception in human-humanoid interaction and its effects in cognitive and emotional states. In: Gavrilova, M., Chang, J., Thalmann, N.M., Hitzer, E., Ishikawa, H. (eds.) CGI 2019. LNCS, vol. 11542, pp. 240–252. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22514-8_20

    Chapter  Google Scholar 

  4. Beck, A., Zhijun, Z., Magnenat-Thalmann, N.: Motion control for social behaviors. In: Magnenat-Thalmann, N., Yuan, J., Thalmann, D., You, B.-J. (eds.) Context Aware Human-Robot and Human-Agent Interaction. HIS, pp. 237–256. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-19947-4_11

    Chapter  Google Scholar 

  5. Blond, L.: Studying robots outside the lab: HRI as ethnography. Paladyn J. Behav. Robot. 10(1), 117–127 (2019). https://doi.org/10.1515/pjbr-2019-0007

  6. Chang, W., Šabanovic, S., Huber, L.: Use of seal-like robot PARO in sensory group therapy for older adults with dementia. In: 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 101–102 (2013)

    Google Scholar 

  7. Chang, W.L., Šabanović, S.: Exploring Taiwanese nursing homes as product ecologies for assistive robots. In: 2014 IEEE International Workshop on Advanced Robotics and its Social Impacts, pp. 32–37. IEEE (2014)

    Google Scholar 

  8. Cohen-Mansfield, J., Dakheel-Ali, M., Marx, M.S.: Engagement in persons with dementia: the concept and its measurement. Am. J. Geriatr. Psychiatry 17(4), 299–307 (2009)

    Article  Google Scholar 

  9. Correia, F., Alves-Oliveira, P., Petisca, S., Paiva, A., et al.: Social and entertainment robots for older adults (2017)

    Google Scholar 

  10. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of European Conference on Computer Vision, pp. 770–778 (2016)

    Google Scholar 

  11. Huisman, C., Kort, H.: Two-year use of care robot Zora in Dutch nursing homes: an evaluation study. Healthcare 7, 31 (2019). Multidisciplinary Digital Publishing Institute

    Google Scholar 

  12. Khosla, R., Chu, M.T.: Embodying care in Matilda: an affective communication robot for emotional wellbeing of older people in Australian residential care facilities. ACM Trans. Manag. Inf. Syst. (TMIS) 4(4), 1–33 (2013)

    Article  Google Scholar 

  13. Law, M., et al.: Developing assistive robots for people with mild cognitive impairment and mild dementia: a qualitative study with older adults and experts in aged care. BMJ Open 9(9), e031937 (2019)

    Article  Google Scholar 

  14. Lee, H.R., Tan, H., Šabanović, S.: That robot is not for me: addressing stereotypes of aging in assistive robot design. In: 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 312–317. IEEE (2016)

    Google Scholar 

  15. Li, J., Louie, W.Y.G., Mohamed, S., Despond, F., Nejat, G.: A user-study with tangy the bingo facilitating robot and long-term care residents. In: 2016 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS), pp. 109–115. IEEE (2016)

    Google Scholar 

  16. Liu, Z., Luo, P., Wang, X., Tang, X.: Large-scale CelebFaces attributes (CelebA) dataset (2018). Accessed 15 Aug 2018

    Google Scholar 

  17. Louie, W.Y.G., Li, J., Mohamed, C., Despond, F., Lee, V., Nejat, G.: Tangy the robot bingo facilitator: a performance review. J. Med. Devices 9(2) (2015)

    Google Scholar 

  18. Louie, W.-Y.G., Nejat, G.: A social robot learning to facilitate an assistive group-based activity from non-expert caregivers. Int. J. Soc. Robot. 12(5), 1159–1176 (2020). https://doi.org/10.1007/s12369-020-00621-4

    Article  Google Scholar 

  19. Magnenat Thalmann, N., Zhang, Z.: Social robots and virtual humans as assistive tools for improving our quality of life. In: 2014 5th International Conference on Digital Home, pp. 1–7. IEEE (2014)

    Google Scholar 

  20. Martinez-Martin, E., Escalona, F., Cazorla, M.: Socially assistive robots for older adults and people with autism: an overview. Electronics 9(2), 367 (2020)

    Article  Google Scholar 

  21. Melkas, H., Hennala, L., Pekkarinen, S., Kyrki, V.: Impacts of robot implementation on care personnel and clients in elderly-care institutions. Int. J. Med. Inform. 134, 104041 (2020)

    Article  Google Scholar 

  22. Mishra, N., Ramanathan, M., Satapathy, R., Cambria, E., Magnenat Thalmann, N.: Can a humanoid robot be part of the organizational workforce? A user study leveraging sentiment analysis. In: 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 1–7. IEEE (2019)

    Google Scholar 

  23. Neven, L.: ‘But obviously not for me’: robots, laboratories and the defiant identity of elder test users. Sociol. Health Illness 32(2), 335–347 (2010)

    Article  Google Scholar 

  24. Ramanathan, M., Mishra, N., Thalmann, N.M.: Nadine humanoid social robotics platform. In: Gavrilova, M., Chang, J., Thalmann, N.M., Hitzer, E., Ishikawa, H. (eds.) CGI 2019. LNCS, vol. 11542, pp. 490–496. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22514-8_49

    Chapter  Google Scholar 

  25. Šabanović, S., Bennett, C.C., Chang, W.L., Huber, L.: PARO robot affects diverse interaction modalities in group sensory therapy for older adults with dementia. In: 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR), pp. 1–6. IEEE (2013)

    Google Scholar 

  26. Šabanović, S., Chang, W.L.: Socializing robots: constructing robotic sociality in the design and use of the assistive robot PARO. AI Soc. 31(4), 537–551 (2016)

    Article  Google Scholar 

  27. Studies, B.C.: Meet Stevie the social robot that holds bingo lessons in a care home (2020). https://businesscasestudies.co.uk/meet-stevie-the-social-robot-that-holds-bingo-lessons-in-a-care-home/

  28. Teed, Z., Deng, J.: RAFT: recurrent all-pairs field transforms for optical flow. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2020)

    Google Scholar 

  29. Thompson, C., Mohamed, S., Louie, W.Y.G., He, J.C., Li, J., Nejat, G.: The robot tangy facilitating trivia games: a team-based user-study with long-term care residents. In: 2017 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS), pp. 173–178. IEEE (2017)

    Google Scholar 

  30. Tuisku, O., Pekkarinen, S., Hennala, L., Melkas, H.: Robots do not replace a nurse with a beating heart. Inf. Technol. People 32, 47–67 (2019)

    Article  Google Scholar 

  31. Wang, L., et al.: Temporal segment networks for action recognition in videos. IEEE Trans. Pattern Anal. Mach. Intell. 41(11), 2740–2755 (2018)

    Article  Google Scholar 

  32. Xiao, Y., Zhang, Z., Beck, A., Yuan, J., Thalmann, D.: Human-robot interaction by understanding upper body gestures. Presence Teleoperators Virtual Environ. 23(2), 133–154 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for Media Innovation, Nanyang Technological University, Singapore, Singapore

    Nidhi Mishra, Gauri Tulsulkar, Hanhui Li & Nadia Magnenat Thalmann

  2. MIRALab, University of Geneva, Geneva, Switzerland

    Nadia Magnenat Thalmann

  3. Goshen Consultancy Services, Singapore, Singapore

    Lim Hwee Er & Lee Mei Ping

  4. Bright Hill Evergreen Home, Singapore, Singapore

    Cheng Siok Khoong

Authors
  1. Nidhi Mishra
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gauri Tulsulkar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hanhui Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nadia Magnenat Thalmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lim Hwee Er
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Lee Mei Ping
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Cheng Siok Khoong
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Geneva, Carouge, Switzerland

    Nadia Magnenat-Thalmann

  2. University of Minnesota, Minneapolis, MN, USA

    Victoria Interrante

  3. EPFL, Lausanne, Switzerland

    Daniel Thalmann

  4. University of Crete, Heraklion, Crete, Greece

    George Papagiannakis

  5. Shanghai Jiao Tong University, Shanghai, China

    Bin Sheng

  6. University of Sydney, Sydney, NSW, Australia

    Jinman Kim

  7. University of Calgary, Calgary, AB, Canada

    Marina Gavrilova

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mishra, N. et al. (2021). Does Elderly Enjoy Playing Bingo with a Robot? A Case Study with the Humanoid Robot Nadine. In: Magnenat-Thalmann, N., et al. Advances in Computer Graphics. CGI 2021. Lecture Notes in Computer Science(), vol 13002. Springer, Cham. https://doi.org/10.1007/978-3-030-89029-2_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-89029-2_38

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-89028-5

  • Online ISBN: 978-3-030-89029-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation