A ChatGPT-enabled Intelligent Assistive Technology for Homecare to Support Activities of Daily Living for People with Mild Dementia
Pages 1 - 7
Abstract
People with dementia (PwD) face significant cognitive challenges that hinder their ability to perform daily tasks, referred to as activities of daily living (ADLs), and are particularly impeded when it comes to the more intricate instrumental ADLs (IADLs). Lacking sufficient support, individuals with dementia are at a greater risk of losing their independence and becoming more vulnerable. A range of intelligent assistive technologies (IATs) have been proposed to help individuals with mild dementia perform certain ADLs on their own. However, most current IATs offer limited support for IADLs to PwD, primarily due to the technologies inability to comprehend the unique communication needs of PwD and a lack of user-specific customization. This paper presents a new proposed homecare assistive tool for people with mild dementia, called CATcare (Cognitive Assistive Technology Care). Our CATcare system, utilizing ChatGPT, offers a comprehensive understanding of PwD. Easily operated and configured via smartphone or smart glasses, it allows caregivers to tailor it to the unique IADL requirements of each care recipient. Additionally, it offers step-by-step guidance, prompts, and timely feedback to help PwD complete their desired tasks. Our research leverages the capabilities of transfer learning from AI models in indoor localization, object detection, and Natural Language Processing (NLP) and shows the potential and promise to develop a customizable and personalizable CATcare tool. This CATcare system is intended to improve the quality of life of PwD and reduce the burden of their caregivers.
References
[1]
Christina Patterson. "World alzheimer report 2018." (2018).
[2]
Alam Ridwan, Martha Anderson, Azziza Bankole, and John Lach. "Inferring physical agitation in dementia using smartwatch and sequential behavior models." In 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), pp. 170-173.
[3]
Emily Roberts, Guoliang Fan, and Xiaowei Chen. "Development of Assistive Technology for Instrumental Activities of Daily Living for Dementia Homecare Environments." Alzheimer's & Dementia 18 (2022): e068099.
[4]
Nguyen, Hoang, Claire EA Eccleston, Kathleen Veronica Doherty, Sunny Jang, and Fran McInerney. "Communication in dementia care: Experiences and needs of carers." Dementia 21, no. 4 (2022): 1381-1398.
[5]
Wang, Gubing, Chiara Marradi, Armagan Albayrak, and Tischa JM van der Cammen. "Co-designing with people with dementia: A scoping review of involving people with dementia in design research." Maturitas 127 (2019): 55-63.
[6]
MacNeil, Maggie, Emily Hirslund, Leonardo Baiocco-Romano, Ayse Kuspinar, and Paul Stolee. "A scoping review of the use of intelligent assistive technologies in rehabilitation practice with older adults." Disability and Rehabilitation: Assistive Technology (2023): 1-32.
[7]
Löbe, Clara, and Hanan AboJabel. "Empowering people with dementia via using intelligent assistive technology: A scoping review." Archives of Gerontology and Geriatrics 101 (2022): 104699.
[8]
Xiaowei Chen, Guoliang Fan, Emily Roberts, and Steven Howell Jr, “A Transfer Learning-based Smart Homecare Assistive Technology to Support Activities of Daily Living for People with Mild Dementia.” 2023 IEEE 23nd International Conference on Bioinformatics and Bioengineering (BIBE). IEEE. Accepted.
[9]
Ray, Partha Pratim. "ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope." Internet of Things and Cyber-Physical Systems (2023).
[10]
Pan, Sinno Jialin, and Qiang Yang. "A survey on transfer learning." IEEE Transactions on knowledge and data engineering 22, no. 10 (2009): 1345-1359.
[11]
Lee-Cheong, Stephen, Shabbir Amanullah, and Mackenzie Jardine. "New assistive technologies in dementia and mild cognitive impairment care: A review." Asian Journal of Psychiatry 73 (2022): 103135.
[12]
Tabira, Takayuki, "Characteristic of process analysis on instrumental activities of daily living according to the severity of cognitive impairment in community-dwelling older adults with Alzheimer's disease." International Psychogeriatrics (2022): 1-12.
[13]
Evans, Nina, "The experience of using prompting technology from the perspective of people with dementia and their primary carers." Aging & mental health 25.8 (2021): 1433-1441.
[14]
Desai, Shital, Joel Ong, Deborah Fels, and Arlene Astell. "Sound mixed reality prompts for people with dementia: A familiar and meaningful experience." In Designing Interactions for Music and Sound, pp. 151-176. Focal Press, 2022.
[15]
Coelho, Tiago, "Promoting reminiscences with virtual reality headsets: A pilot study with people with dementia." International journal of environmental research and public health 17.24 (2020): 9301.
[16]
Wangmo, Tenzin, Mirjam Lipps, Reto W. Kressig, and Marcello Ienca. "Ethical concerns with the use of intelligent assistive technology: findings from a qualitative study with professional stakeholders." BMC medical ethics 20, no. 1 (2019): 1-11.
[17]
Zhuang, Fuzhen, Zhiyuan Qi, Keyu Duan, Dongbo Xi, Yongchun Zhu, Hengshu Zhu, Hui Xiong, and Qing He. "A comprehensive survey on transfer learning." Proceedings of the IEEE 109, no. 1 (2020): 43-76.
[18]
Guo, Yunhui, Honghui Shi, Abhishek Kumar, Kristen Grauman, Tajana Rosing, and Rogerio Feris. "Spottune: transfer learning through adaptive fine-tuning." In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 4805-4814. 2019.
[19]
Sharma, Shallu, and Rajesh Mehra. "Effect of layer-wise fine-tuning in magnification-dependent classification of breast cancer histopathological image." The Visual Computer 36, no. 9 (2020): 1755-1769.
[20]
Hussain, Mahbub, Jordan J. Bird, and Diego R. Faria. "A study on cnn transfer learning for image classification." In Advances in Computational Intelligence Systems: Contributions Presented at the 18th UK Workshop on Computational Intelligence, September 5-7, 2018, Nottingham, UK, pp. 191-202. Springer International Publishing, 2019.
[21]
Alsing, Oscar. "Mobile object detection using tensorflow lite and transfer learning." (2018).
[22]
Kunze, Julius, Louis Kirsch, Ilia Kurenkov, Andreas Krug, Jens Johannsmeier, and Sebastian Stober. "Transfer learning for speech recognition on a budget." arXiv preprint arXiv:1706.00290 (2017).
[23]
Alyafeai, Zaid, Maged Saeed AlShaibani, and Irfan Ahmad. "A survey on transfer learning in natural language processing." arXiv preprint arXiv:2007.04239 (2020).
[24]
Wu, Tianyu, Shizhu He, Jingping Liu, Siqi Sun, Kang Liu, Qing-Long Han, and Yang Tang. "A brief overview of ChatGPT: The history, status quo and potential future development." IEEE/CAA Journal of Automatica Sinica 10, no. 5 (2023): 1122-1136.
[25]
Alessa, Abeer, and Hend Al-Khalifa. "Towards Designing a ChatGPT Conversational Companion for Elderly People." arXiv preprint arXiv:2304.09866 (2023).
[26]
Zaman, Kimia Tuz, Wordh Ul Hasan, Juan Li, and Cui Tao. "Empowering Caregivers of Alzheimer's Disease and Related Dementias (ADRD) with a GPT-Powered Voice Assistant: Leveraging Peer Insights from Social Media." In 2023 IEEE Symposium on Computers and Communications (ISCC), pp. 1-7. IEEE, 2023.
[27]
Sezgin, Emre, Joseph Sirrianni, and Simon L. Linwood. "Operationalizing and implementing pretrained, large artificial intelligence linguistic models in the US health care system: outlook of generative pretrained transformer 3 (GPT-3) as a service model." JMIR medical informatics 10, no. 2 (2022): e32875.
[28]
Thirunavukarasu, Arun James, Darren Shu Jeng Ting, Kabilan Elangovan, Laura Gutierrez, Ting Fang Tan, and Daniel Shu Wei Ting. "Large language models in medicine." Nature medicine 29, no. 8 (2023): 1930-1940.
[29]
Hamdoun, Salah, Rebecca Monteleone, Terri Bookman, and Katina Michael. "AI-based and digital mental health apps: Balancing need and risk." IEEE Technology and Society Magazine 42, no. 1 (2023): 25-36.
[30]
Hisan, Urfa Khairatun, and Muhammad Miftahul Amri. "ChatGPT and medical education: A double-edged sword." Journal of Pedagogy and Education Science 2, no. 01 (2023): 71-89.
[31]
Meskó, Bertalan. "Prompt engineering as an important emerging skill for medical professionals: tutorial." Journal of Medical Internet Research 25 (2023): e50638.
[32]
Banovic, Silva, Lejla Junuzovic Zunic, and Osman Sinanovic. "Communication difficulties as a result of dementia." Materia socio-medica 30, no. 3 (2018): 221.
[33]
OpenAI. https://platform.openai.com/docs/guides/fine-tuning/prepare-training-data. Accessed 08202023
[34]
Gulzar, Yonis. "Fruit image classification model based on MobileNetV2 with deep transfer learning technique." Sustainability 15, no. 3 (2023): 1906.
[35]
Patel, Rupa, and Anita Chaware. "Transfer learning with fine-tuned MobileNetV2 for diabetic retinopathy." In 2020 international conference for emerging technology (INCET), pp. 1-4. IEEE, 2020.
[36]
Sandler, Mark, Andrew Howard, Menglong Zhu, Andrey Zhmoginov, and Liang-Chieh Chen. "Mobilenetv2: Inverted residuals and linear bottlenecks." In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4510-4520. 2018.
[37]
Kuznetsova, Alina, Hassan Rom, Neil Alldrin, Jasper Uijlings, Ivan Krasin, Jordi Pont-Tuset, Shahab Kamali "The open images dataset v4: Unified image classification, object detection, and visual relationship detection at scale." International Journal of Computer Vision 128, no. 7 (2020): 1956-1981.
[38]
Wati, Sutresna. "Implementation of Convolutional Neural Network (CNN) in Android-Based Acne Detection Applications." In 2022 International Conference on Information Technology Research and Innovation (ICITRI), pp. 151-155. IEEE, 2022.
Index Terms
- A ChatGPT-enabled Intelligent Assistive Technology for Homecare to Support Activities of Daily Living for People with Mild Dementia
Index terms have been assigned to the content through auto-classification.
Recommendations
Ludic Game Approach as Assistive Technology for Activities of Daily Living Training
IHC '17: Proceedings of the XVI Brazilian Symposium on Human Factors in Computing SystemsActivities of Daily Living (ADL) are tasks that aim the personal and social development in the multiple daily activities focusing in the independence, autonomy and social coexistence of people with some type of disability. In this context, games ...
Process Mining for Activities of Daily Living in Smart Homecare
PCI '20: Proceedings of the 24th Pan-Hellenic Conference on InformaticsNowadays, an increasing number of people, particularly elderly people, live alone. The ageing population raises concerns in terms of their health and safety and leads to greater demand for elderly homecare. Recent developments in sensing technology and ...
Home based assistive technologies for people with mild dementia
ICOST'07: Proceedings of the 5th international conference on Smart homes and health telematicsThose suffering from mild dementia exhibit impairments of memory, thought and reasoning. It has been recognised that deployment of technological solutions to address such impairments may have a major positive impact on the quality of life and can be ...
Comments
Information & Contributors
Information
Published In
May 2024
68 pages
ISBN:9798400716812
DOI:10.1145/3678429
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 August 2024
Check for updates
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
Conference
ICHMI 2024
ICHMI 2024: 2024 4th International Conference on Human - Machine Interaction
May 24 - 26, 2024
Xi'an, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 190Total Downloads
- Downloads (Last 12 months)190
- Downloads (Last 6 weeks)71
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in