Abstract
The growing elderly population has led to an increase in individuals suffering some kind of disability. The integration of object detection and recognition technologies into assistive devices open new possibilities for improving the independence and safety of such people. In this context, we propose a novel help system, based on Google Glass and YOLO to facilitate the daily activities of those people who have problems recognizing objects and remembering what they are used for. For example, the glasses’ speaker system verbalizes the name of an object the user needs to identify and pick up from a table, and the device confirms the correct selection. Additionally, an assistive application is deployed to support daily activities, where the glasses explain the function of an object when the user requires assistance. This innovative approach not only enhances cognitive stimulation but also provides practical support, significantly improving the quality of life for those individuals. In this work we analyze (experimentally) two different versions of the help system and, we conclude that both provide a good performance in terms of latency and reliability.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alshahrani K.M., Johnson J., Prudenzi A., O’Connor D.B. The effectiveness of psychological interventions for reducing PTSD and psychological distress in first responders: a systematic review and meta-analysis. 2022. PLoS ONE 17(8). https://doi.org/10.1371/journal.pone.0272732
Baragash, R.S., Aldowah, H., Ghazal, S.: Virtual and augmented reality applications to improve older adults’ quality of life: a systematic mapping review and future directions. Digit Health. (2022). https://doi.org/10.1177/20552076221132099
Bibbò, L., Bramanti, A., Sharma, J., Cotroneo, F.: AR platform for indoor navigation: new potential approach extensible to older people with cognitive impairment. BioMedInformatics 4, 1589–1619 (2024). https://doi.org/10.3390/biomedinformatics4030087
Buschert, V.C., et al.: Effects of a newly developed cognitive intervention in amnestic mild cognitive impairment and mild Alzheimer’s disease: a pilot study. J. Alzheimers Dis. 25(4), 679–694 (2011). https://doi.org/10.3233/JAD-2011-100999
Chang, W., Chen, L., Hsu, C., Chen, J., Yang, T., Lin, C. MedGlasses: A Wearable Smart-Glasses-Based Drug Pill Recognition System Using Deep Learning for Visually Impaired Chronic Patients. IEEE Access 2020. 8. 17013-10724. https://doi.org/10.1109/ACCESS.2020.2967400.
Choi, J., Twamley, E.W.: Cognitive rehabilitation therapies for Alzheimer’s disease: a review of methods to improve treatment engagement and self-efficacy. Neuropsychol. Rev. 23(1), 48–62 (2013). https://doi.org/10.1007/s11065-013-9227-4
Comas Herrera, A., Prince, M., Knapp, M., Karagiannidou, M., Guerchet, M. World Alzheimer Report: Improving healthcare for people with dementia. Coverage, quality and costs now and in the future. 2016 (2016). https://doi.org/10.13140/RG.2.2.22580.04483
Fowler, C., Rainey-Smith, S.R., Bird, S., et al.: Fifteen Years of the Australian Imaging, Biomarkers and Lifestyle (AIBL) study: progress and observations from 2,359 older adults spanning the spectrum from cognitive normality to Alzheimer’s Disease. J. Alzheimers Dis. Rep. 5(1), 443–468 (2021). https://doi.org/10.3233/ADR-210005
Guzmán, D.E., Rengifo, C.F., Guzmán, J.D., et al.: Virtual reality games for cognitive rehabilitation of older adults: a review of adaptive games, domains and techniques. Virtual Reality 28, 92 (2024). https://doi.org/10.1007/s10055-024-00968-3
Oliveira, C., Pereira, A., Vagos, P., Nóbrega, C., Gonçalves, J., Afonso, B.: Effectiveness of Mobile App-Based Psychological Interventions for College Students: A Systematic Review of the Literature. Front. Psychol. 12, 647606 (2021). https://doi.org/10.3389/fpsyg.2021.647606
Lin, T., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Lawrence, Z.C., Dollár, P.: Microsoft COCO: Common Objects in Context (2015). https://doi.org/10.48550/arXiv.1405.0312
Maeng, S., et al.: Effects of virtual reality-based cognitive training in the elderly with and without mild cognitive impairment. Psychiatry Investig. 18(7), 619–627 (2021). https://doi.org/10.30773/pi.2020.0446
Rosenberg, M., Tomioka, S., Barber, S.L.: Research to inform health systems’ responses to rapid population ageing: a collection of studies funded by the WHO Centre for Health Development in Kobe. Japan. Health Res Policy Sys 20(Suppl 1), 128 (2022). https://doi.org/10.1186/s12961-022-00917-z
Smith, K., et al.: Digital mental health: challenges and next steps. BMJ Mental Health 26 (2023). https://doi.org/10.1136/bmjment-2023-300670.
Tang, J.: Beginning Google Glass Development. Apress Berkeley, CA (2014). https://doi.org/10.1007/978-1-4302-6787-4
Tortora, C., et al.: Virtual reality and cognitive rehabilitation for older adults with mild cognitive impairment: a systematic review, Ageing Research Reviews, vol. 93 (2024). https://doi.org/10.1016/j.arr.2023.102146.
Woods, B., Aguirre, E., Spector, A.E., Orrell, M.: Cognitive stimulation to improve cognitive functioning in people with dementia. Cochrane Database of Systematic Reviews, Issue 2 (2012). https://doi.org/10.1002/14651858.CD005562.pub2.
Bashiri, F.S., LaRose, E., Badger, J.C., D’Souza, R.M., Yu, Z., Peissig, P.: Object detection to assist visually impaired people: a deep neural network adventure. In: Bebis, G., et al. (eds.) Advances in Visual Computing. ISVC 2018. LNCS, vol. 11241. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-03801-4_44
Sugashini, T., Balakrishnan, G.: YOLO glass: video-based smart object detection using squeeze and attention YOLO network. SIViP 18, 2105–2115 (2024). https://doi.org/10.1007/s11760-023-02855-x
Acknowledgements
This work has been funded by the projects R+D+i PID2021-123278OB-I00 and PDC2022-133370-I00 from MCI-N/AEI/10.13039/501100011033/ and ERDF funds; and the Department of Informatics of the University of Almería. M. Lupión is a fellowship of the FPU program from the Spanish Ministry of Education (FPU19/02756).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lupión, M., Sanjuan, J., González-Ruiz, V., Ortigosa, P. (2024). Empowering the Disabled: Object Detection and Recognition for Enhanced Autonomy. In: Bravo, J., Nugent, C., Cleland, I. (eds) Proceedings of the International Conference on Ubiquitous Computing and Ambient Intelligence (UCAmI 2024). UCAmI 2024. Lecture Notes in Networks and Systems, vol 1212. Springer, Cham. https://doi.org/10.1007/978-3-031-77571-0_27
Download citation
DOI: https://doi.org/10.1007/978-3-031-77571-0_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-77570-3
Online ISBN: 978-3-031-77571-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)