skip to main content
10.1145/3322276.3322331acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article

LiveNature: Ambient Display and Social Robot-Facilitated Multi-Sensory Engagement for People with Dementia

Published: 18 June 2019 Publication History

Abstract

The wellbeing of people with dementia in long-term care facilities is hindered, as they spend most of their time alone with little engagement in meaningful activities and an absence of pleasant sensory stimulation. We designed an interactive system called LiveNature that adopts a novel combined approach involving an ambient display unit and an interactive robotic sheep, to offer long-term access and to engage people with dementia in long-term care facilities in rewarding experiences. LiveNature aims to provide holistic multi-sensory engagement to provoke positive emotions, increase social bonding, and restore attentiveness and communication. The design was implemented within a Dutch nursing home. An evaluation of the user experience and the effectiveness of the design was conducted in a real-life setting with nine participants, five family members, two caregivers and four volunteers, using observational rating scales and semi-structured interviews. The results of the rating scales and the findings from qualitative data showed evidence of enhanced positive engagement.

References

[1]
Alzheimer's Society of UK. 2018. Retrieved October 6, 2018 from https://www.alzheimers.org.uk/about-us/news-and-media/facts-media
[2]
Matilda Annerstedt and Peter Währborg. 2011. Nature-assisted therapy: Systematic review of controlled and observational studies. Scandinavian Journal of Public Health 39, 4: 371--388.
[3]
Roger Baker, Jane Holloway, Chantal C.M. Holtkamp, Anita Larsson, Lindy C. Hartman, Rebecca Pearce, Birgitta Scherman, Seija Johansson, Peter W. Thomas, Lesley Ann Wareing, and Matthew Owens. 2003. Effects of multi-sensory stimulation for people with dementia. Journal of Advanced Nursing 43, 5: 465--477.
[4]
Saskia Bakker, Elise van den Hoven, and Berry Eggen. 2014. Evaluating peripheral interaction design. Human-Computer Interaction 30, 6: 473--506.
[5]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology, 3, 2: 77--101.
[6]
Marie-Andrée Cadieux, Linda J. Garcia, and Jonathan Patrick. 2013. Needs of people with dementia in long-term Care: A systematic review. American Journal of Alzheimer's Disease and Other Dementias 28, 8: 723--733.
[7]
Shu-Chuan Chen, Cindy Jones, and Wendy Moyle. 2018. Social robots for depression in older adults: A systematic review. Journal of Nursing Scholarship 50, 6: 612--622.
[8]
Nai-Ching Chi, Olivia Sparks, Shih-Yin Lin, Amanda Lazar, Hilaire J. Thompson, and George Demiris. 2017. Pilot testing a digital pet avatar for older adults. Geriatric Nursing 38, 6: 542--547.
[9]
Jiska Cohen-Mansfield, Maha Dakheel-Ali, and Marcia S. Marx. 2009. Engagement in persons with dementia: The concept and its measurement. The American Journal of Geriatric Psychiatry 17, 4: 299--307.
[10]
Diego Compagna, and Florian Kohlbacher. 2015. The limits of participatory technology development: The case of service robots in care facilities for older people. Technological forecasting and social change 93: 19--31.
[11]
Sunny Consolvo, Peter Roessler, and Brett E. Shelton. 2004. The CareNet display: Lessons learned from an in home evaluation of an ambient display. In International Conference on Ubiquitous Computing, 1--17. Springer, Berlin, Heidelberg.
[12]
Paul Dourish. 2001. Where the Action is: The Foundations of Embodied Interaction. MIT Press.
[13]
Julia Eggert, Cheryl J. Dye, Ellen Vincent, Veronica Parker, Shaundra B. Daily, Hiep Pham, Alison Turner Watson, Hollie Summey, and Tania Roy. 2015. Effects of viewing a preferred nature image and hearing preferred music on engagement, agitation, and mental status in persons with dementia. SAGE Open Medicine 3, 2050312115602579.
[14]
Yuan Feng, Suihuai Yu, Dirk van de Mortel, Emilia I. Barakova, G.W.Matthias Rauterberg, and Jun Hu. 2018. Closer to nature: Multi-sensory engagement in interactive nature experience for seniors with dementia. In Proceedings of the Sixth International Symposium of Chinese CHI, 49--56.
[15]
Susanne Frennert, and Britt Östlund. 2014. Review: Seven matters of concern of social robots and older people. International Journal of Social Robotics 6, 2: 299--310.
[16]
Joost van Hoof, Mariëlle P.J. Aarts, C.G. Rense, and Antonius M.C. Schoutens. 2009. Ambient bright light in dementia: Effects on behaviour and circadian rhythmicity. Building and Environment 44, 1: 146--155.
[17]
Andrew J. Howell, Raelyne L. Dopko, Holli-Anne Passmore, and Karen Buro. 2011. Nature connectedness: Associations with well-being and mindfulness. Personality and Individual Differences 51, 2: 166--171.
[18]
Julie Huschilt, and Laurie Clune. 2012. The use of socially assistive robots for dementia care. Journal of Gerontological Nursing 38, 10: 15--19.
[19]
Anke Jakob and Lesley Collier. 2017. Sensory enrichment for people living with dementia: Increasing the benefits of multisensory environments in dementia care through design. Design for Health 1, 1: 115--133.
[20]
Ian Andrew James and Louisa Jackman. 2011. Understanding Behaviour in Dementia That Challenges: A Guide to Assessment and Treatment. Jessica Kingsley Publishers.
[21]
Nina Jøranson, Ingeborg Pedersen, Anne Marie Mork Rokstad, Geir Aamodt, Christine Olsen, and Camilla Ihlebæk. 2016. Group activity with Paro in nursing homes: Systematic investigation of behaviors in participants. International Psychogeriatrics 28, 8: 1345--1354.
[22]
Helen C. Kales, Laura N. Gitlin, and Constantine G. Lyketsos. 2015. Assessment and management of behavioral and psychological symptoms of dementia. BMJ 350, h369.
[23]
Kai Kang, Xu Lin, Cun Li, Jun Hu, Bart Hengeveld, Caroline Hummels, and Matthias Rauterberg. 2018. Designing interactive public displays in caring environments: A case study of OutLook. Journal of Ambient Intelligence and Smart Environments 10, 6: 427--443.
[24]
Stephen C. Kramer, Erika Friedmann, and Penny L. Bernstein. 2009. Comparison of the effect of human interaction, animal-assisted therapy, and AIBO-assisted therapy on long-term care residents with dementia. Anthrozoos 22, 1: 43--57.
[25]
Powell M. Lawton, Kimberly Van Haitsma, and Jennifer Klapper. 1996. Observed affect in nursing home residents with Alzheimer's disease. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences 51, 1: 3--14.
[26]
Amanda Lazar, Hilaire Thompson, and George Demiris. 2014. A systematic review of the use of technology for reminiscence therapy. Health Education & Behavior 41,1_suppl: 51S-61S.
[27]
Amanda Lazar, Hilaire J. Thompson, Anne Marie Piper, and George Demiris. 2016. Rethinking the design of robotic pets for older adults. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems 1034--1046.
[28]
Alexander Libin and Jiska Cohen-Mansfield. 2004. Therapeutic robocat for nursing home residents with dementia: preliminary inquiry. American Journal of Alzheimer's Disease and Other Dementias 19, 2:111--116.
[29]
Tom Luyten, Susy Braun, Gaston Jamin, Susan van Hooren, and Luc de Witte. 2018. How nursing home residents with dementia respond to the interactive art installation 'VENSTER': A pilot study. Disability and Rehabilitation: Assistive Technology 13, 1: 87--94.
[30]
Jennifer Mankoff and Anind K. Dey. 2003. From conception to design. In Public and Situated Displays 210--230. Springer, Dordrecht.
[31]
Patrizia Marti, Margherita Bacigalupo, Leonardo Giusti, Claudio Mennecozzi, and Takanori Shibata. 2006. Socially assistive robotics in the treatment of behavioural and psychological symptoms of dementia. In The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics 483--488.
[32]
Ali Mazalek and Elise Van Den Hoven. 2009. Framing tangible interaction frameworks. Artificial Intelligence for Engineering Design, Analysis and Manufacturing 23, 3: 225--235.
[33]
Elaine Mordoch, Angela Osterreicher, Lorna Guse, Kerstin Roger, and Genevieve Thompson. 2013. Use of social commitment robots in the care of elderly people with dementia: A literature review. Maturitas 74, 1: 14--20.
[34]
John E. Morley. 2011. Dementia-related agitation. Journal of the American Medical Directors Association 12, 9: 611--612.
[35]
Kellie Morrissey, Gavin Wood, David Green, Nadia Pantidi, and John McCarthy. 2016. 'I'm a rambler, I'm a gambler, I'm a long way from home': The place of props, music, and design in dementia care. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems 1008--1020.
[36]
Wendy Moyle, Marguerite Bramble, Cindy J. Jones, and Jenny E. Murfield. 2017. "She had a smile on her face as wide as the great Australian bite": A qualitative examination of family perceptions of a therapeutic robot and a plush toy. The Gerontologist 59,1: 177--185.
[37]
Wendy Moyle, Lorraine Venturto, Susan Griffiths, Peter Grimbeek, Margaret McAllister, Debbie Oxlade, and Jenny Murfield. 2011. Factors influencing quality of life for people with dementia: A qualitative perspective. Aging & Mental Health 15, 8: 970--977.
[38]
Louis Neven. 2010. "But obviously not for me': robots, laboratories and the defiant identity of elder test users. Sociology of health & illness 32, 2: 335--347.
[39]
Christine Olsen, Ingeborg Pedersen, Astrid Bergland, Marie-Jose Enders-Slegers, and Camilla Ihlebæk. 2016. Engagement in elderly persons with dementia attending animal-assisted group activity. Dementia 18, 1: 245--261.
[40]
Giulia Perugia, Marta Diaz Doladeras, Andreu Català Mallofré, Matthias Rauterberg, and Emilia Barakova. 2017. Modelling engagement in dementia through behaviour. Contribution for socially interactive robotics. In 2017 IEEE International Conference on Rehabilitation Robotics (ICORR) 1112--1117.
[41]
Selma Sabanovic. 2010. Robots in society, society in robots. International Journal of Social Robotics 2, 4: 439--450.
[42]
Selma Sabanovic, Casey C. Bennett, Wan-Ling Chang, and Lesa Huber. 2013. PARO robot affects diverse interaction modalities in group sensory therapy for older adults with dementia. In 2013 IEEE International Conference on Rehabilitation Robotics (ICORR) 1--6.
[43]
Amanda Sharkey. 2014. Robots and human dignity: A consideration of the effects of robot care on the dignity of older people. Ethics and Information Technology 16, 63--75
[44]
Amanda Sharkey, and Noel Sharkey. 2012. Granny and the robots: ethical issues in robot care for the elderly. Ethics and information technology 14, 1: 27--40.
[45]
Robert Sparrow. 2002. The march of the robot dogs. Ethics and Information Technology 4, 4: 305--318.
[46]
Robert Sparrow and Linda Sparrow. 2006. In the hands of machines? The future of aged care. Minds and Machines 16, 2: 141--161.
[47]
Maranda A. Trahan, Julie Kuo, Michelle C. Carlson, and Laura N. Gitlin. 2014. A systematic review of strategies to foster activity engagement in persons with dementia. Health Education and Behavior 41,1_ Suppl: 70S-83S.
[48]
Sherry Turkle. 2017. Alone together: Why we expect more from technology and less from ourselves. Hachette UK.
[49]
Shannon Vallor. 2011. Carebots and caregivers: Sustaining the ethical ideal of care in the twenty-first century. Philosophy and Technology 24, 3: 251--268.
[50]
Kazuyoshi Wada, Yousuke Ikeda, Kaoru Inoue, and Reona Uehara. 2010. Development and preliminary evaluation of a caregiver's manual for robot therapy using the therapeutic seal robot Paro. In 19th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) 533--538.
[51]
Kazuyoshi Wada, Takanori Shibata, Toshimitsu Musha, and Shin Kimura. 2008. Robot therapy for elders affected by dementia. IEEE Engineering in Medicine and Biology Magazine 27, 4: 53--60.
[52]
Jayne Wallace, Anja Thieme, Gavin Wood, Guy Schofield, and Patrick Olivier. 2012. Enabling self, intimacy and a sense of home in dementia: an enquiry into design in a hospital setting. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 2629--2638.
[53]
Andrea Wilkinson, Marc Kanik, Judy O'Neill, Vishuda Charoenkitkarn, and Mark Chignell. 2017. Ambient activity technologies for managing responsive behaviours in dementia. In Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care 6, 1: 28--35. Sage India: New Delhi.
[54]
Bin Yu, Jun Hu, Mathias Funk, and Loe Feijs. 2017. A model of nature soundscape for calm information display. Interacting with Computers 29, 6: 813--823.

Cited By

View all
  • (2024)Aesthetics of Connectivity for Empowerment – Considerations and ChallengesCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3658379(438-440)Online publication date: 1-Jul-2024
  • (2024)Mariana's Song: Materializing Personhood through Non-Linear Multisensory Experiences Designed for People Living with Advanced DementiaProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660724(819-843)Online publication date: 1-Jul-2024
  • (2024)HCI Research in Sensitive Settings: Learning Researcher Reflexivity, Ethical Conduct and Empathy in Participatory Design ApproachesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636280(1-4)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. LiveNature: Ambient Display and Social Robot-Facilitated Multi-Sensory Engagement for People with Dementia

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    DIS '19: Proceedings of the 2019 on Designing Interactive Systems Conference
    June 2019
    1628 pages
    ISBN:9781450358507
    DOI:10.1145/3322276
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 June 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. ambient displays
    2. long-term care
    3. multi-sensory stimulation
    4. people with dementia
    5. social robots

    Qualifiers

    • Research-article

    Conference

    DIS '19
    Sponsor:
    DIS '19: Designing Interactive Systems Conference 2019
    June 23 - 28, 2019
    CA, San Diego, USA

    Acceptance Rates

    DIS '19 Paper Acceptance Rate 105 of 415 submissions, 25%;
    Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)118
    • Downloads (Last 6 weeks)14
    Reflects downloads up to 20 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Aesthetics of Connectivity for Empowerment – Considerations and ChallengesCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3658379(438-440)Online publication date: 1-Jul-2024
    • (2024)Mariana's Song: Materializing Personhood through Non-Linear Multisensory Experiences Designed for People Living with Advanced DementiaProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660724(819-843)Online publication date: 1-Jul-2024
    • (2024)HCI Research in Sensitive Settings: Learning Researcher Reflexivity, Ethical Conduct and Empathy in Participatory Design ApproachesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636280(1-4)Online publication date: 11-May-2024
    • (2024)VR multi-sensory Zaltman's metaphor elicitation technique: a new method for exploring the needs of older adults in social virtual realityUniversal Access in the Information Society10.1007/s10209-024-01099-xOnline publication date: 16-Mar-2024
    • (2023)Use of Socially Assistive Robots in Mental HealthHandbook of Research on Advances in Digital Technologies to Promote Rehabilitation and Community Participation10.4018/978-1-6684-9251-2.ch013(269-292)Online publication date: 8-Dec-2023
    • (2023)Invisible Textures: Comparing Machine and Human Perception of Environment Texture for ARProceedings of the 1st ACM Workshop on Mobile Immersive Computing, Networking, and Systems10.1145/3615452.3617937(229-236)Online publication date: 6-Oct-2023
    • (2023)Participatory Design for Whom? Designing Conversational User Interfaces for Sensitive Settings and Vulnerable PopulationsProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3597439(1-4)Online publication date: 19-Jul-2023
    • (2023)Sounds of HealthProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35703466:4(1-31)Online publication date: 11-Jan-2023
    • (2023)Switch2Move: Designing a Tangible Interface with People Living with Dementia for Initiating and Engaging in Music-Supported Exercises at HomeProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596017(1457-1471)Online publication date: 10-Jul-2023
    • (2023)Co-designing Social Robots with People Living with Dementia: Fostering Identity, Connectedness, Security, and AutonomyProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595987(2672-2688)Online publication date: 10-Jul-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media