Abstract
Dementia is part of the normal ageing process and there are very few Augmented Reality (AR) technologies to help people with dementia. The implementation of these technologies is not fully successful due to limitations in the accuracy of image processing and interactive instruction. This paper aims to improve the accuracy and interactivity of the system to perform tasks in context-specific scenarios. Our objective is to increase the accuracy of video and the interactive instruction of the system by minimizing blurry image processing and overlaying the 3D images over 2D objects respectively. The recommended system involves Optional Frame Selection Algorithm (OFSA), with an 8D descriptor vector in speed up robust features (ESURF) to increase the accuracy of image processing, and overlay interactive 3D images to the original image to make the augmented instruction more effective. The result shows that the purposed (ESURF) algorithm utilizes more details and features in the descriptor vector to improve the regular speed up robust features (SURF) algorithm that comes from filtered OFSA. This result of performance shows that the ESURF algorithm outperforms regular SURF detectors in accuracy for matching objects. A usability study suggested that augmented interactive 3D images are more effective than just providing text as instruction. The proposed system emphasises on reducing blurry images for processing, maximising matching descriptors to increase accuracy during image processing, and to increase the interactivity instruction of the system, which provides dementia patients with more of a sense of the real environment and more effective instruction.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Quintana, E., Favela, J.: Augmented reality annotations to assist persons with Alzheimers and their caregivers. Pers. Ubiquit. Comput. 17(6), 1105–1116 (2013). https://doi.org/10.1007/s00779-012-0558-6
Boletsis, C., McCallum, S.: Augmented reality cubes for cognitive gaming: preliminary usability and game experience testing. Int. J. Serious Games 3–18 (2016). http://journal.seriousgamessociety.org/index.php?journal=IJSG&page=article&op=view&path%5B%5D=106&path%5B%5D=pdf_36
Hoe, Z.-Y., Lee, I.-J., Chen, C.-H., Chang, K.-P.: Using an augmented reality-based training system to promote spatial visualization ability for the elderly. Univ. Access Inf. Soc. 18, 327–342 (2019). https://doi.org/10.1007/s10209-017-0597-x
Chang, Y.J., Kang, Y.S., Huang, P.C.: An augmented reality (AR)-based vocational task prompting system for people with cognitive impairments. Res. Dev. Disabil. 34(10), 3049–3056 (2013). https://doi.org/10.1016/j.ridd.2013.06.026. Epub 21 July 2013, PMID: 23880030
Hervas, R., Bravo, J., Fontecha, J.: An assistive navigation system based on augmented reality and context awareness for people with mild cognitive impairments. IEEE J. Biomed. Health Inform. 18(1), 368–374 (2014). https://doi.org/10.1109/JBHI.2013.2266480
Schall, M.J., Rusch, M.L.: Augmented reality cues and elderly driver. Hum. Factors 55, 643–658 (2013)
Nasir, E.M., Sahar, N.M., Zainudin, A.: Development of augmented reality application for dementia patient (DARD). ARPN J. Eng. Appl. Sci. (2016)
Saracchini, R., Catalina, C., Bordoni, L.: A mobile augmented reality assistive technology for the elderly. Comunicar 23(45), 65–73 (2015). https://doi.org/10.3916/C45-2015-07
Morel, A., Bormans, K.: Memory palaces to improve quality of life in dementia. In: Raising Awareness for the Societal and Environmental Role of Engineering and (Re)Training Engineers for Participatory Design (Engineering4Society), pp. 115–129 (2015)
Kanno, K., Lamounier Jr., E., Cardoso, A., Lopes, E., Mendes de Lima, G.: Augmented reality system for aiding mild alzheimer patients and caregivers, pp. 593–594 (2018). https://doi.org/10.1109/VR.2018.8446143
Rohrbach, N., Gulde, P., Armstrong, A.R., et al.: An augmented reality approach for ADL support in Alzheimer’s disease: a crossover trial. J. NeuroEngineering Rehabil. 16, 66 (2019). https://doi.org/10.1186/s12984-019-0530-z
Yang, S., Pang, X., He, X.: A novel mobile application for medication adherence supervision based on AR and OpenCV designed for elderly patients. In: Gao, Q., Zhou, J. (eds.) HCII 2021. LNCS, vol. 12787, pp. 335–347. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-78111-8_23
Kanno, K., Lamounier, E., Jr., Cardoso, A., Lopes, E., Fakhouri, S.: Assisting individuals with Alzheimer’s disease using mobile augmented reality with voice interaction: an acceptance experiment with individuals in the early stages. Res. Biomed. Eng. 35, 1–12 (2019). https://doi.org/10.1007/s42600-019
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Maharjan, B., Albabawat, A.A., Salah, R.M., AlSallami, N., Altaf, S., Al-Jerew, O. (2023). Augmented Reality for Cognitive Impairment and Dementia. In: Daimi, K., Al Sadoon, A. (eds) Proceedings of the 2023 International Conference on Advances in Computing Research (ACR’23). ACR 2023. Lecture Notes in Networks and Systems, vol 700. Springer, Cham. https://doi.org/10.1007/978-3-031-33743-7_22
Download citation
DOI: https://doi.org/10.1007/978-3-031-33743-7_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-33742-0
Online ISBN: 978-3-031-33743-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)