Abstract
In this work, we present a robot-assisted photo reminiscence system. Previously, we focused on the development of the question generation system through a social robot interface. Results showed that the proposed system was able to produce coherent, related and appropriate questions that would trigger the reminiscence process. In this study, using an iterative incremental model, based on feedback from the end-users (elderly and caregivers), we deployed an improved prototype robotic system on a senior center with elderly users and in a lab setting for independent living elderly. Results from our feasibility study show that participants proactively engage with the robot and find the prospect of reminiscence therapy both effective and enjoyable.
This research was supported by the Joint Research Center for AI Technology and All Vista Healthcare under Ministry of Science and Technology of Taiwan, and Center for Artificial Intelligence & Advanced Robotics, National Taiwan University, under the grant numbers of 109-2634-F-002-027-, 109-2634-F-002-040– and 109-2634-F-002-041.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Life Expectancy, Our World in Data. https://ourworldindata.org/life-expectancy. Accessed 25 Jan 2021
Fertility rate, total (births per woman), The World Bank. https://data.worldbank.org/indicator/sp.dyn.tfrt.in. Accessed 25 Jan 2021
Dementia Factsheet, World Health Organization. http://www.who.int/mediacentre/factsheets/fs362/en/. Accessed 25 Jan 2021
Lin, Y.C., Dai, Y.T., Hwang, S.L.: The effect of reminiscence on the elderly population: a systematic review. Public Health Nurs. 20(4), 297–306 (2003)
Lawrence, V., Fossey, J., Ballard, C., Moniz-Cook, E., Murray, J.: Improving quality of life for people with dementia in care homes: making psychosocial interventions work. Br. J. Psychiatry 201(5), 344–351 (2012)
Abdollahi, H., Mollahosseini, A., Lane, J.T., Mahoor, M.H.: A pilot study on using an intelligent life-like robot as a companion for elderly individuals with dementia and depression. In: Proceedings of the IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids) (2017)
Tokushige, A., Yokojima, K., Sugiura, K., Iwasaki, Y., Araki, D.: Consideration of conversation with older adult with dementia by individual reminiscence therapy. In: 30th International Nursing Research Congress (2019)
Carós, M., Garolera, M., Radeva, P., Giro-i-Nieto, X.: Automatic reminiscence therapy for dementia. In: Proceedings of the 2020 International Conference on Multimedia Retrieval (ICMR 2020), pp. 383–387. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3372278.3391927
Asprino, L., Gangemi, A., Nuzzolese, A.G., Presutti, V., Recupero, D.R., Russo, A.: Ontology-based knowledge management for comprehensive geriatric assessment and reminiscence therapy on social robots. Data Science for Healthcare, pp. 173–193. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-05249-2_6
Wu, Y.L., Gamborino, E., Fu, L.C.: Interactive question posing system for robot-assisted photo reminiscence from personal photos. IEEE Trans. Cogn. Dev. Syst. 12, 439–450 (2019)
Kitamura, Y., Vi, C.T., Liu, G., Takashima, K., Itoh, Y., Subramanian, S.: D-FLIP: dynamic & flexible interactive PhotoShow. In: SIGGRAPH Asia 2013 Emerging Technologies (SA 2013), Article 6, pp. 1–3. Association for Computing Machinery, New York (2013). https://doi.org/10.1145/2542284.2542290
Huang, X., Takashima, K., Fujita, K., Kitamura, Y.: Dynamic, flexible and multi-dimensional visualization of digital photos and their metadata. In: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (ISS 2018), pp. 405–408. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3279778.3279923
Thepsoonthorn, C., Ogawa, K., Miyake, Y.: The relationship between robot’s nonverbal behavior and human’s likability based on human’s personality. Sci. Rep. 8, 8435 (2018). https://doi.org/10.1038/s41598-018-25314-x
Zhou, B., Lapedriza, A., Khosla, A., Oliva, A., Torralba, A.: Places: a 10 million image database for scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 40, 1452–1464 (2017)
Ahmad, K., Conci, N., Boato, G., De Natale, F.G.: USED: a large-scale social event detection dataset. In: Proceedings of the 7th International Conference on Multimedia Systems (MMSys 2016), Article 50, pp. 1–6. Association for Computing Machinery, New York (2016). https://doi.org/10.1145/2910017.2910624
Kalliatakis, G.: Keras-VGG16-Places365 (2017). https://github.com/GKalliatakis/Keras-VGG16-places365. Accessed 5 May 2020
Venkatesh, V., Davis, F.D.: A theoretical extension of the technology acceptance model: four longitudinal field studies. Manag. Sci. 46(2), 186–204 (2000)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Gamborino, E., Herrera Ruiz, A., Wang, JF., Tseng, TY., Yeh, SL., Fu, LC. (2021). Towards Effective Robot-Assisted Photo Reminiscence: Personalizing Interactions Through Visual Understanding and Inferring. In: Rau, PL.P. (eds) Cross-Cultural Design. Applications in Cultural Heritage, Tourism, Autonomous Vehicles, and Intelligent Agents. HCII 2021. Lecture Notes in Computer Science(), vol 12773. Springer, Cham. https://doi.org/10.1007/978-3-030-77080-8_27
Download citation
DOI: https://doi.org/10.1007/978-3-030-77080-8_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77079-2
Online ISBN: 978-3-030-77080-8
eBook Packages: Computer ScienceComputer Science (R0)