Introduction
This paper describes a new approach to language generation for simulated users based on the construction of flexible templates extracted from a corpus. In our opinion a realistic user simulation on the speech level is based on two parts: user behavior and language generation. In this work we mainly concentrate on the language generation for simulated user interaction with spoken dialog systems (SDS). The presented approach could be used as part of a user simulation for intensive end-to-end system tests and evaluations and for testing purposes of the speech recognition and natural language understanding modules of an SDS.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ai, H., Litman, D.: Comparing real-real, simulated-simulated, and simulated-real spoken dialogue corpora. In: Proc. AAAI Workshop on Statistical and Empirical Approaches for SDS (2006)
Ai, H., Weng, F.: User simulation as testing for spoken dialog systems. In: Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue, Columbus, Ohio, pp. 164–171 (2008)
Chung, G.: Developing a flexible spoken dialog system using simulation. In: Proceedings of the 42nd Meeting of the Association for Computational Linguistics (ACL 2004), Barcelona, Spain, pp. 63–70 (July 2004)
Eckert, W., Levin, E., Pieraccini, R.: User modelling for spoken dialogue system evaluation. In: Proceedings of ASRU, pp. 80–87 (1997)
Filisko, E., Seneff, S.: Developing city name acquisition strategies in spoken dialogue systems via user simulation. In: Proceedings of SigDial, Lisbon, Portugal, vol. 6, pp. 144–154 (2005)
Georgila, K., Henderson, J., Lemon, O.: User simulation for spoken dialogue systems: Learning and evaluation. In: Proceedings of Interspeech (2006)
Griol, D., Hurtado, L.F., Segarra, E., Sanchis, E.: A statistical approach to spoken dialog systems design and evaluation. Speech Communication 50, 666–682 (2008)
Jost Schatzmann, B.T., Young, S.: Error simulation for training statistical dialogue systems. In: IEEE Automatic Speech Recognition and Understanding Workshop 2007, Kyoto, Japan (2007)
López-Cózar, R., de la Torre, A., Segura, J., Rubio, A.: Assessment of dialog systems by means of a new simulation technique. SpeCom 40, 387–407 (2003)
Jung, S., Lee, C., Kim, K., Lee, G.G.: An integrated dialog simulation technique for evaluating spoken dialog systems. Computer Speech and Language, 9–16 (2008)
Scheffler, K., Young, S.: Probabilistic simulation of human-machine dialogues. In: Proc. ICASSP, pp. 1217–1220 (2000)
Scheffler, T., Roller, R., Reithinger, N.: Speecheval – evaluating spoken dialog systems by user simulation. In: Proceedings of the 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems, Pasadena, CA, pp. 93–98 (2009)
Wang, C., Seneff, S., Chung, G.: Language model data filtering via user simulation and dialogue resynthesis. In: Proc. of INTERSPEECH (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Roller, R., Scheffler, T., Reithinger, N. (2011). Human-Machine Corpus Analysis for Generation and Interaction with Spoken Dialog Systems. In: Bach, J., Edelkamp, S. (eds) KI 2011: Advances in Artificial Intelligence. KI 2011. Lecture Notes in Computer Science(), vol 7006. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24455-1_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-24455-1_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24454-4
Online ISBN: 978-3-642-24455-1
eBook Packages: Computer ScienceComputer Science (R0)