Abstract
The paper addresses the issue of error correction of the domain-specific output from the cloud Automatic Speech Recognition (ASR) system. The research and the solution were built for the Internet of Things (IoT) data collected in the process of applying voice control over home appliances. We describe an ASR post-processing module that reduces the word error rate (WER) of ASR hypotheses and consequently improves prediction of users’ intentions by the Natural Language Understanding (NLU) module. The study also compares three various English proficiency level groups of speakers and makes observations about differences of recognition accuracy ratio of users’ speech by a dialogue system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Choi, J., Lee, D., Ryu, S., Lee, K., Kim, K., Noh, H., Geunbae Lee, G.: Engine-independent ASR Error Management for Dialog Systems Situated Dialogue in Speech-Based Human-Computer Interaction. Signals and Communication Technology. Springer, Switzerland (2016)
Jeon, H., Oh, H.R., Hwang, I., Kim, J.: An intelligent dialogue agent for the IoT home. In: The Workshops of the Thirtieth AAAI Conference on Artificial Intelligence. Artificial Intelligence Applied to Assistive Technologies and Smart Environments: Technical report WS-16-01 (2016)
Traum, D., Georgila, K., Artstein, R., Leuski, A.: Evaluating spoken dialogue processing for time-offset interaction. In: Proceedings of the 16th SIGDIAL Conference, Praha, Czech Republic (2015)
Twiefel, J., Baumann, T., Heinrich, S., Wermter, S.: Improving domain-independent cloud-based speech recognition with domain-dependent phonetic post-processing. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence, CA (2014)
Razavi, M., Magimai Doss, M.: On recognition of non-native speech using probabilistic lexical model. In: Proceedings of the 15th Annual Conference of the International Speech Communication Association. Interspeech 2014 (2014)
Lambert, B., Raj, B., Singh, R.: Discriminatively trained dependency language modeling for conversational speech recognition. In: Proceedings of the 14th Annual Conference of the International Speech Communication Association. Interspeech 2013 (2013)
Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S.J., McClosky, D.: The stanford CoreNLP natural language processing toolkit. In: ACL 2014 Demo Session (2014)
Ziolko, B., Galka, J., Skurzok, D., Jadczyk, T.: Modified weighted Levenshtein distance in automatic speech recognition. In: Proceedings of KKZMBM (2010)
Morbini, F., Audhkhasi, K., Artstein, R., Van Segbroeck, M., Sagae, K., Georgiou, P., Traum, D.R., Narayanan, S.: A reranking approach for recognition and classification of speech input in conversational dialogue systems. In: Proceedings of the 2012 IEEE Spoken Language Technology Workshop (SLT), pp. 49–54. IEEE (2012)
Wang, W.Y., Artstein, R., Leuski, A., Traum, D.: Improving spoken dialogue understanding using phonetic mixture models. In: Proceedings of the 24th International Florida Artificial Intelligence Research Society Conference, pp. 329–334 (2011)
Sarma, A., Palmer, D.D.: Context-based speech recognition error detection and correction. In: Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, pp. 85–88 (2004)
CMUdict: Carnegie Mellon University open-source grapheme-to-phoneme dictionary 1993–2015 (2015). http://svn.code.sf.net/p/cmusphinx/code/trunk/cmudict/cmudict-0.7b
Novet, J.: Google says its speech recognition technology now has only an 8% word error rate (2015). http://venturebeat.com/2015/05/28/google-says-its-speech-recognition-technology-now-has-only-an-8-word-error-rate
Byambakhishig, E., Tanaka, K., Aihara, R., Nakashika, T., Takiguchi, T., Ariki, Y.: Error correction of automatic speech recognition based on normalized web distance. In: Proceedings of the INTERSPEECH 2014, pp. 2852–2856 (2014)
Speech Integration Group of Sun Microsystems Laboratories: Phoneme guesser from the tool FreeTTS v1.2 (2005). http://freetts.sourceforge.net/docs/index.php
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Zembrzuski, M. et al. (2017). Automatic Speech Recognition Adaptation to the IoT Domain Dialogue System. In: Kryszkiewicz, M., Appice, A., Ślęzak, D., Rybinski, H., Skowron, A., Raś, Z. (eds) Foundations of Intelligent Systems. ISMIS 2017. Lecture Notes in Computer Science(), vol 10352. Springer, Cham. https://doi.org/10.1007/978-3-319-60438-1_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-60438-1_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-60437-4
Online ISBN: 978-3-319-60438-1
eBook Packages: Computer ScienceComputer Science (R0)