Abstract
An analysis of the prosodic characteristics of the voice of people with intellectual disability is presented in this paper. A serious game has been developed for training the communicative competences of people with intellectual disability, including those related with prosody. An evaluation of the video game was carried out and, as a result, a corpus with the recordings of the spoken turns of the game has been collected. This corpus is composed of a set of utterances produced by the target group of people with intellectual disability. The same set of sentences is pronounced by a control group of people without intellectual disability. This allows us to compare the prosodic profiles between the target and control groups. Prosodic features (F0, energy and duration) are automatically extracted and analyzed, revealing significant differences between the two groups. We trained an automatic classifier using exclusively prosodic features and 80 % of the sentences were correctly discriminated.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
This work has been partially funded by Recercaixa, ACUP, Obra Social La Caixa (project “!‘Juguemos a comunicar mejor! La mejora de la competencia prosódica como vía de integración educativa e inclusión social del alumnado con Necesidades Específicas de Apoyo Educativo” http://prado.uab.es/recercaixa/es/index.html) and by Ministerio de Economía y Competitividad (project TIN2014-59852-R “Videojuegos Sociales para la Asistencia y Mejora de la Pronunciación de la Lengua Española”).
References
Ananthakrishnan, S., Narayanan, S.S.: Automatic prosodic event detection using acoustic, lexical, and syntactic evidence. IEEE Trans. Audio Speech Lang. Process. 16(1), 216–228 (2008)
Boersma, P., et al.: Praat, a system for doing phonetics by computer. Glot Int. 5(9/10), 341–345 (2002)
Chapman, R.S.: Language development in children and adolescents with down syndrome. Ment. Retard. Dev. Disabil. Res. Rev. 3(4), 307–312 (1997)
Cleland, J., Wood, S., Hardcastle, W., Wishart, J., Timmins, C.: Relationship between speech, oromotor, language and cognitive abilities in children with down’s syndrome. Int. J. Lang. Commun. Disord. 45(1), 83–95 (2010)
Corrales, M., Escudero, D., Flores, V., González, C., Gutiérrez, Y.: Arquitectura para la interacción en un videojuego para el entrenamiento de la voz de personas con discapacidad intelectual. In: Actas del XXI Congreso Internacional de Interación Persona-Ordenador, pp. 445–448, September 2015
Corrales-Astorgano, M., Escudero-Mancebo, D., González-Ferreras, C.: The magic stone: a video game to improve communication skills of people with intellectual disabilities. In: Show and tell demostrations, Interspeech 2016, September 2016
Escudero-Mancebo, D., González-Ferreras, C., Vivaracho-Pascual, C., Cardenoso-Payo, V.: A fuzzy classifier to deal with similarity between labels on automatic prosodic labeling. Comput. Speech Lang. 28(1), 326–341 (2014)
Feng, J., Lazar, J., Kumin, L., Ozok, A.: Computer usage by children with down syndrome: challenges and future research. ACM Trans. Accessible Comput. 2(3), 13 (2010)
Gonzalez-Ferreras, C., Escudero-Mancebo, D., Vivaracho-Pascual, C., Cardeñoso Payo, V.: Improving automatic classification of prosodic events by pairwise coupling. IEEE Trans. Audio Speech Lang. Process. 20(7), 2045–2058 (2012)
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The WEKA data mining software: an update. ACM SIGKDD Explor. Newsl. 11(1), 10–18 (2009)
Kent, R.D., Vorperian, H.K.: Speech impairment in down syndrome: a review. J. Speech Lang. Hear. Res. 56(1), 178–210 (2013)
Martin, G.E., Klusek, J., Estigarribia, B., Roberts, J.E.: Language characteristics of individuals with down syndrome. Topics Lang. Disord. 29(2), 112 (2009)
Pettinato, M., Verhoeven, J.: Production and perception of word stress in children and adolescents with down syndrome. Down Syndr. Res. Practice 13, 48–61 (2008)
Saz, O., Lleida, E., Vaquero, C., Rodríguez, W.R.: The Alborada-I3A corpus of disordered speech. In: LREC (2010)
Saz, O., Simón, J., Rodríguez, W., Lleida, E., Vaquero, C., et al.: Analysis of acoustic features in speakers with cognitive disorders and speech impairments. EURASIP J. Adv. Sig. Process. 2009, 1 (2009)
Stojanovik, V.: Prosodic deficits in children with down syndrome. J. Neurolinguistics 24(2), 145–155 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Corrales-Astorgano, M., Escudero-Mancebo, D., González-Ferreras, C. (2016). Acoustic Analysis of Anomalous Use of Prosodic Features in a Corpus of People with Intellectual Disability. In: Abad, A., et al. Advances in Speech and Language Technologies for Iberian Languages. IberSPEECH 2016. Lecture Notes in Computer Science(), vol 10077. Springer, Cham. https://doi.org/10.1007/978-3-319-49169-1_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-49169-1_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-49168-4
Online ISBN: 978-3-319-49169-1
eBook Packages: Computer ScienceComputer Science (R0)