poster

Interactive multimodal social robot for improving quality of care of elderly in Australian nursing homes

Authors:

Tomoharu YamaguchiAuthors Info & Claims

MM '12: Proceedings of the 20th ACM international conference on Multimedia

Pages 1173 - 1176

https://doi.org/10.1145/2393347.2396411

Published: 29 October 2012 Publication History

Get Access

Abstract

This paper describes the design of multimodal robotic system, embodiment of multimodal interaction (voice, gestures, emotion, touch panel and dance) in assistive social robot (Matilda) for modeling group based and one-to-one interactions with technology adverse elderly in nursing homes. It describes the human-centered evaluation of Matilda based on quality, naturalness, user satisfaction and predictive accuracy based on first ever field trials in Australia. The multimodal social robots have facilitated breaking the technology barriers with the elderly leading to several aged care facilities and community centers showing interest in future trials.

References

[1]

Australian-Bureau-of-Statistics. "Population by Age and Sex, Regions of Australia (cat no. 3235.0),".

Google Scholar

[2]

Australian-Bureau-of-Statistics. "Feature Article 1: Population by Age and Sex, Australian States and Territories".

Google Scholar

[3]

A. Jaimes, and N. Sebe, "Multimodal human-computer interaction: A survey," Computer Vision and Image Understanding, vol. 108, no. 1--2, pp. 116--134, 2007.

Digital Library

Google Scholar

[4]

K. M. Buckley, B. Q. Tran, and C. M. Prandoni, "Receptiveness, use and acceptance of telehealth by caregivers of stroke patients in the home," Online J Issues Nurs, vol. 9, no. 3, pp. 9, 2004.

Google Scholar

[5]

C. Lisetti, and C. LeRouge, "Affective computing in tele-home health," 2004.

Digital Library

Google Scholar

[6]

C. Lisetti, F. Nasoz, C. LeRouge et al., "Developing multimodal intelligent affective interfaces for tele-home health care," International Journal of Human-Computer Studies, vol. 59, no. 1--2, pp. 245--255, 2003.

Digital Library

Google Scholar

[7]

J. Naish, "21st century nurse," Nursing standard (Royal College of Nursing (Great Britain): 1987), vol. 24, no. 8, pp. 22, 2009.

Google Scholar

[8]

R. Cooper, S. Larsson, C. Matheson et al., "Coding instructional dialogue for information states," Deliverable D, vol. 1, 1999.

Google Scholar

[9]

A. P. Field, Discovering statistics using SPSS: SAGE publications Ltd, 2009.

Digital Library

Google Scholar

[10]

P. Ekamn, and W. Friesen, "Facial action coding system (FACS): manual," Consulting Psychologists Press, 1978.

Google Scholar

[11]

R. W. Picard, Affective computing: The MIT press, 2000.

Digital Library

Google Scholar

Cited By

View all

Alhouli SAlmania NSharma JSahoo D(2024)Multimodal Input Classification for a Companion Pet Robot using Deep LearningProceedings of the 2024 8th International Conference on Advances in Artificial Intelligence10.1145/3704137.3704197(180-189)Online publication date: 17-Oct-2024
https://dl.acm.org/doi/10.1145/3704137.3704197
Subramanian SDe Moor K(2023)Age-Inclusive Design of Video Streaming Services: Integrating Insights and Design ImplicationsProceedings of the 15th International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2023)10.1007/978-3-031-48306-6_5(51-56)Online publication date: 25-Nov-2023
https://doi.org/10.1007/978-3-031-48306-6_5
Axelsson ABuschmeier HSkantze G(2022)Modeling Feedback in Interaction With Conversational Agents—A ReviewFrontiers in Computer Science10.3389/fcomp.2022.7445744Online publication date: 15-Mar-2022
https://doi.org/10.3389/fcomp.2022.744574
Show More Cited By

Index Terms

Interactive multimodal social robot for improving quality of care of elderly in Australian nursing homes
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking

Recommendations

Nursing Care Quality in Nursing Homes: Cross-Sectional Versus Longitudinal Analysis

This empirical study of the relationship between nursing care adequacy and nursing care quality demonstrates that a positive relationship exists between the process and outcome dimensions of quality of nursing care. The results from the analysis of ...
A Study on Effect of Media Therapy for the Elderly with Dementia to Nursing Care Quality
Proceedings of the 8th International Conference on Universal Access in Human-Computer Interaction. Aging and Assistive Environments - Volume 8515

Japanese society contains an extremely large elderly population, unprecedented elsewhere in the world. In fact, the elderly make up about 23.3% of the Japanese population. Consequently, the number of elderly people with dementia is also increasing at an ...
Technology for Supporting Care Staff in Residential Homes

Care staff, those who attend to the day-to-day needs of people in residential facilities, represent an important segment of the health-care provision of those entrusted to their care. The potential use of technology by care staff has not been a focus of ...

Comments

Information & Contributors

Information

Published In

MM '12: Proceedings of the 20th ACM international conference on Multimedia

October 2012

1584 pages

ISBN:9781450310895

DOI:10.1145/2393347

General Chairs:
Noboru Babaguchi
Osaka University, Japan
,
Kiyoharu Aizawa
The University of Tokyo, Japan
,
John Smith
IBM, USA
,
Program Chairs:
Shin'ichi Satoh
National Institute of Informatics, Japan
,
Thomas Plagemann
University of Oslo, Norway
,
Xian-Sheng Hua
Microsoft, USA
,
Rong Yan
Facebook, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

MM '12

Sponsor:

SIGMM

MM '12: ACM Multimedia Conference

October 29 - November 2, 2012

Nara, Japan

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
854
Total Downloads

Downloads (Last 12 months)37
Downloads (Last 6 weeks)9

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Alhouli SAlmania NSharma JSahoo D(2024)Multimodal Input Classification for a Companion Pet Robot using Deep LearningProceedings of the 2024 8th International Conference on Advances in Artificial Intelligence10.1145/3704137.3704197(180-189)Online publication date: 17-Oct-2024
Subramanian SDe Moor K(2023)Age-Inclusive Design of Video Streaming Services: Integrating Insights and Design ImplicationsProceedings of the 15th International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2023)10.1007/978-3-031-48306-6_5(51-56)Online publication date: 25-Nov-2023
Axelsson ABuschmeier HSkantze G(2022)Modeling Feedback in Interaction With Conversational Agents—A ReviewFrontiers in Computer Science10.3389/fcomp.2022.7445744Online publication date: 15-Mar-2022
Ghafurian MMuñoz JBoger JHoey JDautenhahn K(2022)Socially Interactive Agents for Supporting AgingThe Handbook on Socially Interactive Agents10.1145/3563659.3563671(367-402)Online publication date: 27-Oct-2022
van Minkelen PKrahmer EVogt P(2022)Exploring How People with Expressive Aphasia Interact with and Perceive a Social RobotInternational Journal of Social Robotics10.1007/s12369-022-00908-814:8(1821-1840)Online publication date: 23-Aug-2022
(2022)The Handbook on Socially Interactive AgentsundefinedOnline publication date: 27-Oct-2022
Ghafurian MHoey JDautenhahn K(2021)Social Robots for the Care of Persons with DementiaACM Transactions on Human-Robot Interaction10.1145/346965310:4(1-31)Online publication date: 2-Sep-2021
Applewhite TZhong VDornberger R(2021)Novel Bidirectional Multimodal System for Affective Human-Robot Engagement2021 IEEE Symposium Series on Computational Intelligence (SSCI)10.1109/SSCI50451.2021.9659935(1-7)Online publication date: 5-Dec-2021
Naik LPalinko OBodenhagen LKruger N(2021)Multi-modal Proactive Approaching of Humans for Human-Robot Cooperative Tasks2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN)10.1109/RO-MAN50785.2021.9515475(323-329)Online publication date: 8-Aug-2021
Kia NCavanagh JMeacham HHalvorsen BCabrera PBartram T(2021)HealthcareThe Fourth Industrial Revolution10.1007/978-981-16-1614-3_11(183-195)Online publication date: 12-Aug-2021
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Nursing Care Quality in Nursing Homes: Cross-Sectional Versus Longitudinal Analysis

A Study on Effect of Media Therapy for the Elderly with Dementia to Nursing Care Quality

Technology for Supporting Care Staff in Residential Homes

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations