Saverio Perugini
ABSTRACT
Specifying and implementing flexible human-computer dialogs, such as those used in kiosks, is complex because of the numerous and varied directions in which each user might steer a dialog. The objective of this research is to improve dialog specification and implementation. To do so we developed a model for specifying and staging mixed-initiative dialogs. The model involves a dialog authoring notation, based on concepts from programming languages, for specifying a variety of unsolicited reporting, mixed-initiative dialogs in a concise representation that serves as a design for dialog implementation. Guided by this foundation, we built a dialog staging engine which operationalizes dialogs specified in this notation. The model, notation, and engine help automate the engineering of mixed-initiative dialog systems. These results also provide a proof-of-concept for dialog specification and implementation from the perspective of theoretical programming languages. The ubiquity of dialogs in domains such as travel, education, and health care with the increased use of interactive voice-response systems and virtual environments provide a fertile landscape for further investigation of these results.
- J. F. Allen. 1999. Mixed-Initiative Interaction. IEEE Intelligent Systems 14, 5 (1999), 14--16.Google Scholar
Digital Library
- F. Baader and T. Nipkow. 1999. Term Rewriting and All That. Cambridge University Press, Cambridge, UK. Google ScholarDigital Library
- T. Ball, C. Colby, P. Danielsen, L. J. Jagadeesan, R. Jagadeesan, K. Läufer, P. Mataga, and K. Rehor. 2000. Sisl: Several Interfaces, Single Logic. International Journal of Speech Technology 3, 2 (2000), 93--108.Google ScholarCross Ref
- F. Bechet, G. Riccardi, and D. Hakkani-Tür. 2004. Mining Spoken Dialogue Corpora for System Evaluation and Modeling. In Proceedings of the Association for Computational Linguistics (ACL) Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, Stroudsburg, PA, 134--141.Google Scholar
- D. Bohus and A. I. Rudnicky. 2003. RavenClaw: Dialog management using hierarchical task decomposition and an expectation agenda. In Proceedings of the Sixth Annual INTERSPEECH Conference. International Speech Communication Association.Google Scholar
- D. Bohus and A. I. Rudnicky. 2009. The RavenClaw Dialog Management Framework: Architecture and Systems. Computer Speech and Language 23, 3 (2009), 332--361. Google ScholarDigital Library
- R. Capra, M. Narayan, S. Perugini, N. Ramakrishnan, and M. A. Pérez-Quiñones. 2003. The Staging Transformation Approach to Mixing Initiative. In Working Notes of the IJCAI 2003 Workshop on Mixed-Initiative Intelligent Systems, G. Tecuci (Ed.). AAAI/MIT Press, Menlo Park, CA, 23--29.Google Scholar
- J. Chu-Carroll. 2000. MIMIC: An adaptive mixed initiative spoken dialogue system for information queries. In Proceedings of the Sixth Conference on Applied Natural Language Processing (ANLC). Association for Computational Linguistics, Stroudsburg, PA, 97--104. Google ScholarDigital Library
- A. Dix, J. Finlay, G. D. Abowd, and R. Beale. 2010. Human-Computer Interaction (third ed.). Prentice Hall, Harlow, England, Chapter 16: Dialog Notations and Design. Google ScholarDigital Library
- A. Dubrow. Seven Cyberlearning Technologies Transforming Education. Huffington Post, 6 April 2015. Available: http://www.huffingtonpost.com/aaron-dubrow/7-cyberlearning-technolog_b_6988976.html {Last accessed: 6 May 2016}.Google Scholar
- J. Feng, D. Hakkani-Tür, G. Di Fabbrizio, M. Gilbert, and M. Beutnagel. 2006. Webtalk: Towards Automatically Building Spoken Dialog Systems Through Mining Websites. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE Computer Society Press, Los Alamitos, CA, 573--576.Google Scholar
- R. Freedman. 2000. Using a Reactive Planner as the Basis for a Dialogue Agent. In Proceedings of the Thirteenth International Florida Artificial Intelligence Research Society Conference. 203--208. Google ScholarDigital Library
- D. P. Friedman and M. Wand. 2008. Essentials of Programming Languages (third ed.). MIT Press, Cambridge, MA. Google ScholarDigital Library
- J. Glass and S. Seneff. 2003. Flexible and Personalizable Mixed-initiative Dialogue Systems. In Proceedings of the North American Chapter of the Association for Computational Linguistics (ACL): Human Language Technologies (NAACL-HLT) Workshop on Research Directions in Dialogue Processing. Association for Computational Linguistics, Stroudsburg, PA, 19--21. Google ScholarDigital Library
- P. Graunke, R. Findler, S. Krishnamurthi, and M. Felleisen. 2001. Automatically Restructuring Programs for the Web. In Proceedings of the Sixteenth IEEE International Conference on Automated Software Engineering (ASE). 211--222. Google ScholarDigital Library
- M. Green. 1986. A Survey of Three Dialogue Models. ACM Transactions on Graphics 5, 3 (1986), 244--275. Google ScholarDigital Library
- C. I. Guinn. 1999. Evaluating Mixed-initiative Dialog. IEEE Intelligent Systems 14, 5 (1999), 21--23.Google Scholar
- E. Hagen and B. Grote. 1997. Planning Efficient Mixed-initiative Dialogue. In Proceedings of the Association for Computational Linguistics (ACL) Conference on Interactive Spoken Dialog Systems on Bringing Speech and NLP Together in Real Applications (ISDS). Association for Computational Linguistics, Stroudsburg, PA, 53--56. Google ScholarDigital Library
- S. Haller and S. McRoy (Eds.). 1997. Proceedings of the AAAI Spring Symposium on Computational Models for Mixed Initiative Interaction. Number SS-97-04. AAAI Press, Menlo Park, CA.Google Scholar
- J. Hochberg, N. Kambhatla, and S. Roukos. 2002. A Flexible Framework for Developing Mixed-initiative Dialog Systems. In Proceedings of the Third Association for Computational Linguistics (ACL) SIGDIAL Workshop on Discourse and Dialogue. Association for Computational Linguistics, Stroudsburg, PA, 60--63. Google ScholarDigital Library
- R. B. Inouye. 2004. Minimizing the Length of Non-mixed Initiative Dialogs. In Proceedings of the Association for Computational Linguistics (ACL) Workshop on Student Research. Association for Computational Linguistics, Stroudsburg, PA. Google ScholarDigital Library
- N. D. Jones. 1996. An Introduction to Partial Evaluation. Comput. Surveys 28, 3 (1996), 480--503. Google ScholarDigital Library
- P. Jordan, M. Ringenberg, and B. Hall. 2006. Rapidly Developing Dialogue Systems that Support Learning Studies. In Proceedings of Intelligent Tutoring Systems (ITS) Workshop on Teaching with Robots, Agents, and NLP. 1--8.Google Scholar
- A. Kobsa. 1988. User Models and Dialog Models: United They Stand. Computational Linguistics 14, 3 (1988), 91--94. Google ScholarDigital Library
- D. L. Kreher and D. R. Stinson. 1999. Combinatorial Algorithms: Generation, Enumeration, and Search. CRC Press, Boca Raton, FL.Google Scholar
- C. Lee, S. Jung, K. Kim, D. Lee, and G. G. Lee. 2010. Recent approaches to dialog management for spoken dialog systems. Journal of Computing Science and Engineering 4, 1 (2010), 1--22.Google ScholarCross Ref
- A. Leuski and D. Traum. 2011. NPCEditor: Creating Virtual Human Dialogue Using Information Retrieval Techniques. AI Magazine 32, 2 (2011), 42--56.Google ScholarDigital Library
- S. N. Malkov. 2010. Customizing a Functional Programming Language for Web Development. Computer Languages, Systems and Structures 36, 4 (2010), 345--351. Google ScholarDigital Library
- T. Misu, K. Georgila, A. Leuski, and D. Traum. 2012. Reinforcement Learning of Question-answering Dialogue Policies for Virtual Museum Guides. In Proceedings of the Thirteenth Annual Meeting of the Special Interest Group on Discourse and Dialogue. Association for Computational Linguistics, Stroudsburg, PA, 84--93. Google ScholarDigital Library
- M. Narayan, C. Williams, S. Perugini, and N. Ramakrishnan. 2004. Staging Transformations for Multimodal Web Interaction Management. In Proceedings of the Thirteenth International ACM World Wide Web Conference (WWW), M. Najork and C. E. Wills (Eds.). ACM Press, New York, NY, 212--223. Google ScholarDigital Library
- H. Partsch and R. Steinbrüggen. 1983. Program Transformation Systems. Comput. Surveys 15, 3 (1983), 199--236. Google ScholarDigital Library
- M. A. Pérez-Quiñones. 1996. Conversational Collaboration in User-initiated Interruption and Cancellation Requests. Ph.D. dissertation. The George Washington University.Google Scholar
- J. Polifroni, G. Chung, and S. Seneff. 2003. Towards the Automatic Generation of Mixed-Initiative Dialogue Systems from Web Content. In Proceedings of the Eighth European Conference on Speech Communication and Technology (EUROSPEECH). International Speech Communication Association, 193--196.Google Scholar
- D. Quan, D. Huynh, D. R. Karger, and R. Miller. 2003. User Interface Continuations. In Proceedings of the Sixteenth Annual ACM Symposium on User Interface Software and Technology (UIST). ACM Press, New York, NY, 145--148. Google ScholarDigital Library
- C. Queinnec. 2000. The Influence of Browsers on Evaluators or, Continuations to Program Web Servers. In Proceedings of the Fifth ACM SIGPLAN International Conference on Functional Programming (ICFP). ACM Press, New York, NY, 23--33. Also appears in ACM SIGPLAN Notices, 35(9), 2000. Google ScholarDigital Library
- N. Ramakrishnan, R. Capra, and M. A. Pérez-Quiñones. 2002. Mixed-Initiative Interaction = Mixed Computation. In Proceedings of the ACM SIGPLAN Workshop on Partial Evaluation and Semantics-Based Program Manipulation (PEPM), P. Thiemann (Ed.). ACM Press, New York, NY, 119--130. Also appears in ACM SIGPLAN Notices, 37(3), 2002. Google ScholarDigital Library
- F. Ricca and P. Tonella. 2001. Web Application Slicing. In Proceedings of the International Conference on Software Maintenance (ICSM). IEEE Computer Society Press, Los Alamitos, CA, 148--157. Google ScholarDigital Library
- F. Ricca, P. Tonella, and I. D. Baxter. 2001. Restructuring Web Applications via Transformation Rules. In Proceedings of the First International Workshop on Source Code Analysis and Manipulation (SCAM). IEEE Computer Society Press, Los Alamitos, CA, 150--160.Google Scholar
- A. Rudnicky, E. Thayer, P. Constantinides, C. Tchou, R. Stern, K. Lenzo, W. Xu, and A. Oh. 1999. Creating natural dialogs in the Carnegie Mellon communicator system. In Proceedings of the Sixth European Conference on Speech Communication and Technology (EUROSPEECH). International Speech Communication Association.Google Scholar
- A. Rudnicky and W. Xu. 1999. An agenda-based dialog management architecture for spoken language systems. IEEE Automatic Speech Recognition and Understanding Workshop 13, 4 (1999).Google Scholar
- R. C. Schank and R. P. Abelson. 1977. Scripts, Plans, Goals and Understanding: an Inquiry into Human Knowledge Structures. L. Erlbaum, Hillsdale, NJ.Google Scholar
- D. Stallard. 2001. Dialogue management in the Talk'n'Travel system. In Proceedings of the IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU). IEEE Computer Society Press, Los Alamitos, CA, 235--239.Google ScholarCross Ref
- M. Walker, L. Hirschman, and J. Aberdeen. 2000. Evaluation for DARPA communicator spoken dialogue systems. In Proceedings Second International Conference on Language Resources and Evaluation. European Language Resources Association.Google Scholar
- M. Walker and S. Whittaker. 1990. Mixed-initiative in dialogue: An investigation into discourse segmentation. In Proceedings of the Twenty-eighth Annual Meeting on Association for Computational Linguistics (ACL). Association for Computational Linguistics, Stroudsburg, PA, 70--78. Google ScholarDigital Library
- W. Wong, L. Cavedon, J. Thangarajah, and L. Padgham. 2012. Mixed-initiative Conversational System Using Question-answer Pairs Mined from the Web. In Proceedings of the Twenty-first ACM International Conference on Information and Knowledge Management (CIKM). ACM Press, New York, NY, 2707--2709. Google ScholarDigital Library
- X. Yao, E. Tosch, G. Chen, E. Nouri, R. Artstein, A. Leuski, K. Sagae, and D. Traum. 2012. Creating conversational characters using question generation tools. Dialogue and Discourse 3, 2 (2012), 125--146.Google ScholarCross Ref
Index Terms
- A language-based model for specifying and staging mixed-initiative dialogs
Recommendations
Natural Language, Mixed-initiative Personal Assistant Agents
IMCOM '18: Proceedings of the 12th International Conference on Ubiquitous Information Management and CommunicationThe increasing popularity and use of personal voice assistant technologies, such as Siri and Google Now, is driving and expanding progress toward the long-term and lofty goal of using artificial intelligence to build human-computer dialog systems ...
Staging transformations for multimodal web interaction management
WWW '04: Proceedings of the 13th international conference on World Wide WebMultimodal interfaces are becoming increasingly ubiquitous with the advent of mobile devices, accessibility considerations, and novel software technologies that combine diverse interaction media. In addition to improving access and delivery capabilities,...
Mixed-initiative Personal Assistants
SIGCSE '17: Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science EducationSpecification and implementation of flexible human-computer dialogs is challenging because of the complexity involved in rendering the dialog responsive to a vast number of varied paths through which users might desire to complete the dialog. To address ...
Comments