Abstract
A person with aphasia, caused by a damage to a brain, loses (partially or completely) the ability to use speech or writing. Rehabilitation is based on mental or motor exercises, stimulating the brain areas responsible for communication. The aim of our work was to implement an application (app) for smartphones that could be used for this rehabilitation. We used Google’s Cloud Vision for photo analysis. The initial prototype of the app was modified according to comments from a specialist. The usability tests with the target group of users prove the effectiveness of the app, and suggest the directions of further development.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Allen, M., McGrenere, J., Purves, B.: The field evaluation of a mobile digital image communication application designed for people with aphasia. ACM Trans. Access. Comput. (TACCESS) 1(1), 1–26 (2008)
Al Mahmud, A., Dijkhuis, S.Q., Blummel, L. Elberse, I.: Postboard: free-form tangible messaging for people with aphasia (and other people). In: CHI 2012, Austin, Texas, USA, pp. 1475–1480. ACM (2012)
Beukelman, D., Hux, K., Dietz, A., McKelvey, M., Weissling, K.: Using visual scene displays as communication support options for people with chronic, severe aphasia: a summary of AAC research and future research directions. Augment. Altern. Commun. 31(3), 234–45 (2015)
Brooke, J.: SUS: a retrospective. J. Usability Stud. 8(2), 29–40 (2013)
Chapey, R.: Language Intervention Strategies in Aphasia and Related Neurogenic Communication Disorders. Kluwer-Lippincott Williams & Wilkins, Philadelphia (2008)
Daemen, E., et al.: Designing a free style, indirect, and interactive storytelling application for people with aphasia. In: Baranauskas, C., Palanque, P., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4662, pp. 221–234. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74796-3_21
Martin, R.C.: Clean Code. Prentice Hall, Upper Saddle River (2009)
Menger, F., Morris, J., Salis, C.: Aphasia in an Internet age: wider perspectives on digital inclusion. Aphasiology 30(2–3), 112–132 (2015)
Mulfari, D., Celesti, A., Fazio, M., Villari, M., Puliafito, A.: Using Google Cloud Vision in assistive technology scenarios. In: IEEE ISCC, Messina, Italy (2016)
Acknowledgments
The authors would like to express thanks to Dr. Aleksandra Bala, a specialist in aphasiac patients, for her comments and help in experiments. This work was partially supported by the Research Center of PJAIT.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Gonera, J., Szklanny, K., Wichrowski, M., Wieczorkowska, A. (2018). Mobile Application with Image Recognition for Persons with Aphasia. In: Ceci, M., Japkowicz, N., Liu, J., Papadopoulos, G., Raś, Z. (eds) Foundations of Intelligent Systems. ISMIS 2018. Lecture Notes in Computer Science(), vol 11177. Springer, Cham. https://doi.org/10.1007/978-3-030-01851-1_11
Download citation
DOI: https://doi.org/10.1007/978-3-030-01851-1_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01850-4
Online ISBN: 978-3-030-01851-1
eBook Packages: Computer ScienceComputer Science (R0)