Abstract
Speech and language technology is currently being incorporated into e-health services addressed to the detection, assessment and rehabilitation of different types of speech and language disorders. This is the case of the Portuguese platform VITHEA, which provides remote access to automatic training sessions for aphasia rehabilitation. In VITHEA, patients’ answers to semantic confrontation exercises are validated using automatic speech recognition. Text-to-speech synthesis and a virtual agent are exploited to allow a natural multimodal interaction. While the effectiveness of the different technological components has been individually validated, there is a need for the assessment of the overall therapeutic platform. In this work, we report evaluation results of the complete therapeutic platform based on a survey collected from speech and language therapists. The results not only confirmed the significant usefulness of the platform for the treatment of aphasic patients, but also provided very relevant feedback that led to the introduction of additional features and to the development of similar solutions for other diseases .
This work was funded by Fundação para a Ciência e a Tecnologia (FCT) through the project RIPD/ADA/109646/2009 and partially supported by grant SFRH/BD/97187/2013, by national funds through FCT under project UIDB/50021/2020, and by CMUP-ERI/TIC/0033/2014 Program fund.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Pedersen, P., Jorgensen, H., Nakayama, H., Raaschou, H., Olsen, T.: Aphasia in acute stroke: incidence, determinants, and recovery. Ann. Neurol. 38, 659–666 (1995)
Wilshire, C., Coslett, H.: Aphasia and Language. Theory to practice. In: Disorders of Word Retrieval in Aphasia Theories and Potential Applications, pp. 82–107. The Guilford Press (2000)
Basso, A.: Prognostic factors in aphasia. Aphasiology 6(4), 337–348 (1992)
Bhogal, S., Teasell, R., Speechley, M.: Intensity of aphasia therapy, impact on recovery. In: Stroke, pp. 987–993 (2003)
Colby, K., Christinaz, D., Parkinson, R., Graham, S., Karpf, C.: A word finding computer program with a dynamic lexical-semantic memory for patients with anomia using an intelligent speech prosthesis. Brain Lang. 14(2), 272–281 (1981)
Katz, R., Nagy, V.: A computerized approach for improving word recognition in chronic aphasic patients. In: Brookshire, R. (ed.) Clinical Aphasiology: Conference Proceeding. Minneapolis BRK Publishers (1983)
Archibald, L., Orange, J., Jamieson, J.: Implementation of computer-based language therapy in aphasia. Ther. Adv. Neurol. Disord. 2(5), 299–311 (2009)
Adrián, J., González, M., Buiza, J., Sage, K.: Extending the use of spanish computer-assisted anomia rehabilitation program (carp-2) in people with aphasia. J. Commun. Disord. 44(6), 666–677 (2011)
Fink, R., Brecher, A., Sobel, P., Schwartz, M.: Computer-assisted treatment of word retrieval deficits in aphasia. Aphasiology 19(10–11), 943–954 (2005)
Jokel, R., Cupit, J., Rochon, E., Leonard, C.: Relearning lost vocabulary in non- fluent progressive aphasia with MossTalk Words®. Aphasiology 23(2), 175–191 (2009)
Abad, A., et al.: Automatic word naming recognition for an on-line aphasia treatment system. Comput. Speech Lang. 27(6), 1235–1248 (2013). https://doi.org/10.1016/j.csl.2012.10.003. http://www.sciencedirect.com/science/article/pii/S088523081200085X, special Issue on Speech and Language Processing for Assistive Technology
Abad, A., Pompili, A., Costa, Â., Trancoso, I.: Automatic word naming recognition for treatment and assessment of aphasia. In: INTERSPEECH (2012)
Meinedo, H., Abad, A., Pellegrini, T., Trancoso, I., Neto, J.: The \(L^2F\) broadcast news speech recognition system. In: Proceedings of Fala 2010 (2010)
Pinto, J., Lovitt, A., Hermansky, H.: Exploiting phoneme similarities in hybrid HMM-ANN keyword spotting. In: Proceedings of Interspeech, pp. 1610–1613 (2007)
Paulo, S., et al.: DIXI - a generic text-to-speech system for European Portuguese. In: Computational Processing of the Portuguese Language, pp. 91–100 (2008)
Trancoso, I., Viana, C., Barros, M., Caseiro, D., Paulo, S.: From Portuguese to Mirandese: fast porting of a letter-to-sound module using FSTs. In: Mamede, N.J., Trancoso, I., Baptista, J., das Graças Volpe Nunes, M. (eds.) PROPOR 2003. LNCS (LNAI), vol. 2721, pp. 49–56. Springer, Heidelberg (2003). https://doi.org/10.1007/3-540-45011-4_7
de Lemos Marques, G.J.: Development of a Mobile Application for Remote Speech Therapy. Master’s thesis, Instituto Superior Técnico, Lisbon, Portugal (2019)
Fielding, R., Taylor, R.: Principled design of the modern web architecture. ACM Trans. Internet Technol. 2(2), 115–150 (2002)
Mendonça, V., Coheur, L., Sardinha, A.: Vithea-kids: a platform for improving language skills of children with autism spectrum disorder. In: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, pp. 345–346. ACM (2015)
Mendonça, V.: Extending VITHEA in order to improve children’s linguistic skills. In: Silva, J., Ribeiro, R., Quaresma, P., Adami, A., Branco, A. (eds.) PROPOR 2016. LNCS (LNAI), vol. 9727, pp. 3–11. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-41552-9_1
Pompili, A., Amorim, C., Abad, A., Trancoso, I.: Speech and language technologies for the automatic monitoring and training of cognitive functions. In: Proceedings of SLPAT 2015: 6th Workshop on Speech and Language Processing for Assistive Technologies, pp. 103–109 (2015)
Oliveira, F., Abad, A., Trancoso, I.: A multiplayer voice-enabled game platform. In: PROPOR2020 (submitted)
Cavaco, S., et al.: BioVisualSpeech - A platform designed to help speech therapists (2016–2020). https://novasearch.org/biovisualspeech/project.php. Accessed 25 Oct 2019
TAPAS - Training Network on Automatic Processing of PAthological Speech (2018–2021). https://www.tapas-etn-eu.org. Accessed 25 Oct 2019
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Pompili, A., Abad, A., Trancoso, I., Fonseca, J., Martins, I.P. (2020). Evaluation and Extensions of an Automatic Speech Therapy Platform. In: Quaresma, P., Vieira, R., Aluísio, S., Moniz, H., Batista, F., Gonçalves, T. (eds) Computational Processing of the Portuguese Language. PROPOR 2020. Lecture Notes in Computer Science(), vol 12037. Springer, Cham. https://doi.org/10.1007/978-3-030-41505-1_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-41505-1_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-41504-4
Online ISBN: 978-3-030-41505-1
eBook Packages: Computer ScienceComputer Science (R0)