Skip to main content

Chatto: An Emotionally Intelligent Avatar for Elderly Care in Ambient Assisted Living

  • Conference paper
  • First Online:
Ambient Intelligence – Software and Applications – 14th International Symposium on Ambient Intelligence (ISAmI 2023)

Abstract

In 2020, the number of people aged 60 years and older outnumbered children younger than 5 years and this trend is growing at a rapid pace. Therefore, elders are at higher risk of social isolation and loneliness due to the busy lifestyle of families in the current society. According to recent studies, conversational agents have a significant impact on the emotional and physical well-being and independence of elders in Ambient Assisted Living (AAL) environments. Chatto, a conversational agent with an animated avatar, aims to enhance the emotional well-being of elders by establishing an empathetic connection through interactive conversations.

This paper focuses on the implementation and benefits of Chatto for the elder population. The proposed solution offers numerous benefits for elders, including increased social interaction, emotional support, and real-time monitoring of their well-being. Utilizing advanced techniques to recognize facial expressions and analyze voice sentiment, Chatto offers a dynamic and interactive avatar. A key innovation of the proposed solution is the ability for caregivers to personalize the user experience by selecting which of Chatto’s animations are displayed and when resulting in a highly personalized and engaging experience. Usability tests with diverse elder users demonstrate that Chatto is user-friendly, easy to navigate, and offers an enjoyable experience. Future improvements, informed by user feedback, will further enhance the avatar’s intuitiveness and impact on the emotional well-being of elders.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Ageing and health. https://www.who.int/news-room/fact-sheets/detail/ageing-and-health

  2. Towards the NESTORE e-coach: a tangible and embodied conversational agent for older adults. In: Proceedings of the 2018 ACM International Joint Conference. Singapore. https://doi.org/10.1145/3267305.3274188

  3. Virtual Companion Based Mobile User Interface: An Intelligent and Simplified Mobile User Interface for the Elderly Users, shorttitle = Virtual Companion Based Mobile User Interface, doi = 10.1109/ISUVR.2017.10, author = Noh, Sangwoo and Han, Juyeon and Jo, Jinwoo and Choi, Ahyoung, month = jun, year = 2017, keywords = Animation, intelligent user interface, Meteorology, Mobile communication, Monitoring, Senior citizens, Speech recognition, User interfaces, Virtual companion, visualization in 3D, pages = 8-9

    Google Scholar 

  4. Callan, J.: Homework: Sentiment analysis (2016). http://boston.lti.cs.cmu.edu/classes/95-865-K/HW/HW3/

  5. Chang, Y.C., Hsing, Y.C.: Emotion-infused deep neural network for emotionally resonant conversation. Appl. Soft Comput. 113, 107861 (2021). https://doi.org/10.1016/j.asoc.2021.107861

    Article  Google Scholar 

  6. Muhammad, A.F., Susanto, D., Alimudin, A., Adila, F., Assidiqi, M.H., Nabhan, S.: Developing English conversation chatbot using dialogflow. In: 2020 International Electronics Symposium (IES), pp. 468–475 (2020). https://doi.org/10.1109/IES50839.2020.9231659

  7. Pinto, M.D., Greenblatt, A.M., Hickman, R.L., Rice, H.M., Thomas, T.L., Clochesy, J.M.: Assessing the critical parameters of eSMART-MH: a promising avatar-based digital therapeutic intervention to reduce depressive symptoms. Perspect. Psychiatr. Care 52(3), 157–168 (2016). https://doi.org/10.1111/ppc.12112

    Article  Google Scholar 

  8. Sansen, H., et al.: The Roberta IRONSIDE project a cognitive and physical robot coach for dependent persons. Modell. Meas. Control C 77(2), 169–181 (2016)

    Google Scholar 

  9. Serengil, S.I., Ozpinar, A.: Lightface: a hybrid deep face recognition framework. In: 2020 Innovations in Intelligent Systems and Applications Conference (ASYU), pp. 23–27. IEEE (2020). https://doi.org/10.1109/ASYU50717.2020.9259802

  10. Shaked, N.A.: Avatars and virtual agents - relationship interfaces for the elderly. Healthc. Technol. Lett. 4(3), 83–87 (2017). https://doi.org/10.1049/htl.2017.0009. https://onlinelibrary.wiley.com/doi/abs/10.1049/htl.2017.0009

  11. Wan, Y.T., Chiu, C.C., Liang, K.W., Chang, P.C.: Midoriko chatbot: LSTM-based emotional 3d avatar. In: 2019 IEEE 8th Global Conference on Consumer Electronics (GCCE), pp. 937–940 (2019). https://doi.org/10.1109/GCCE46687.2019.9015303. iSSN: 2378-8143

Download references

Acknowledgements

This work was supported by national funds through the Portuguese Foundation for Science and Technology (FCT), I.P., under the project UIDB/04524/2020 and was partially supported by Portuguese National funds through FITEC-Programa Interface with reference CIT “INOV-INESC Inovação-Financiamento Base”. The authors would also like to acknowledge FlatIcon for providing the icons used in the architecture diagram image.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to António Pereira .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mendes, C., Pereira, R., Ribeiro, J., Rodrigues, N., Pereira, A. (2023). Chatto: An Emotionally Intelligent Avatar for Elderly Care in Ambient Assisted Living. In: Novais, P., et al. Ambient Intelligence – Software and Applications – 14th International Symposium on Ambient Intelligence. ISAmI 2023. Lecture Notes in Networks and Systems, vol 770. Springer, Cham. https://doi.org/10.1007/978-3-031-43461-7_10

Download citation

Publish with us

Policies and ethics