Abstract
Dialogue Management (DM) is an essential issue in Spoken Dialogue Systems (SDS). Most of previous studies on DM do not consider the visual feedback from machine to user that could accelerate the dialogue process dramatically. Thus, in this paper, we firstly model the DM problem in SDS with visual feedback as Partially Observable Markov Decision Processes (POMDP). Additionally, Reinforcement Learning (RL) approach is utilized to solve this problem, which yields the Vision and Audition-based DM (VADM) scheme. Finally, extensive experiment results illustrate the performance improvements of the proposed VADM scheme over the existing scheme in different scenarios.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Mctear, M.F.: Spoken dialogue technology: Enabling the conversational user interface. ACM Computing Survey 34(1), 90–169 (2002)
van Drunen, A.: Dialogue management and automation in interaction with unmanned systems. In: Proceedings of the 2nd ATACCS (May 2012)
Yuan, X., Liu, G.: A task ontology model for domain independent dialogue management. In: IEEE International Conference on Virtual Environments Human-Computer Interfaces and Measurement Systems (2012)
Daubigney, L., Geist, M., Chandramohan, S., Pietquin, O.: A Comprehensive Reinforcement Learning Framework for Dialogue Management Optimization. IEEE Journal of Selected Topics in Signal Processing 6(8), 891–902 (2012)
Mori, D., Berta, R., De Gloria, A., Fiore, V., Magnani, L.: An easy to author dialogue management system for serious games. Journal on Computing and Cultural Heritage 6(2) (May 2013)
Ferreira, E., Lefvre, F.: Social signal and user adaptation in reinforcement learning-based dialogue management. In: MLIS 2013 (August 2013)
Thomson, B.: Statistical methods for spoken dialogue management, Ph.D. dissertation, Cambridge (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Ge, W., Xu, B. (2014). Dialogue Management in Spoken Dialogue System with Visual Feedback. In: Pham, DN., Park, SB. (eds) PRICAI 2014: Trends in Artificial Intelligence. PRICAI 2014. Lecture Notes in Computer Science(), vol 8862. Springer, Cham. https://doi.org/10.1007/978-3-319-13560-1_70
Download citation
DOI: https://doi.org/10.1007/978-3-319-13560-1_70
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-13559-5
Online ISBN: 978-3-319-13560-1
eBook Packages: Computer ScienceComputer Science (R0)