skip to main content
10.1145/1452392.1452415acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
poster

Towards a minimalist multimodal dialogue framework using recursive MVC pattern

Published: 20 October 2008 Publication History

Abstract

This paper presents a formal framework for multimodal dialogue systems by applying a set of complexity reduction patterns. The minimalist approach described in this paper combines recursive application of Model-View-Controller (MVC) design patterns with layering and interpretation. It leads to a modular, concise, flexible and dynamic framework building upon a few core constructs. This framework could expedite the development of complex multimodal dialogue systems with sound software development practices and techniques. A XML based prototype multimodal dialogue system that embodies this framework is developed and studied. Experimental results indicate that the proposed framework is effective and well suited for multimodal interaction in complex business transactions.

References

[1]
Stock, O., Zancanaro, M. (eds.): Multimodal Intelligent Information Presentation. Series Text, Speech and Language Technology, Vol 27. Springer, 2005.
[2]
Stanciulescu, Q. Limbourg, J. Vanderdonckt, B. Michotte, F. Montero, 2005. A Transformational Approach for Multimodal Web User Interfaces based on UsiXML, Proceedings of ICMI'05, pp. 259--266, October 2005.
[3]
Christian Elting, Gregor Mohler, 2002. Modeling Output in the EMBASSI Multimodal Dialogue System, ICMI 2002:111--116, Fourth IEEE International Conference on Multimodal Interfaces (ICMI'02), 2002.
[4]
Daniel Jurafsky, James H. Martin, 2000. Speech and Language Processing. Prentice Hall, 2000.
[5]
Erich Gamma, Richard Helm, Ralph Johnson, John Vlissides, 1995. Design Patterns. Addison Wesley, 1995.
[6]
EMMA: Extensible MultiModal Annotation markup language, W3C Candidate Recommendation, 11 December 2007.
[7]
Jullien Bouchet, Laurence Nigay, 2004. ICARE: a component-based approach for the design and development of multimodal interfaces. ICMI 2004: 1325--1328, 2004.
[8]
Li Li, Quanzhi Li, Wu Chou, Feng Liu, 2007. R-Flow: An Extensible XML Based Multimodal Dialogue System Architecture, Proceedings of 9th IEEE International Workshop on Multimedia Signal Processing (MMSP 2007), page 86--89, 2007.
[9]
M. Honkala, M. Pohja, 2006. Multimodal Interaction with XForms, Proceedings of ICWE'06, pp. 201--208, July 2006.
[10]
MMAI: Multimodal Architecture and Interfaces, W3C Working Draft, 14 April 2008.
[11]
SALT: SALTForum, http://www.saltforum.org/
[12]
SCXML: State Chart XML (SCXML): State Machine Notation for Control Abstraction 1.0, W3C Working Draft, 16 May 2008.
[13]
Sharon Oviatt, 1999. Ten myths of multimodal interaction, in Communications of ACM, 42(11):74--81, November 1999.
[14]
SMIL: Synchronized Multimedia Integration Language (SMIL 3.0), W3C Candidate Recommendation, 15 January 2008.
[15]
Stephane H. Maes, Chummun Ferial, 2001. Multi-Modal Browser Architecture, presentation (T2-010705) on 3GPP T2 meeting, September 2001.
[16]
VXML v2.1: Voice Extensible Markup Language (VoiceXML) 2.1, W3C Recommendation, 19 June 2007
[17]
VXML v3.0: Sneak Preview: VoiceXML 3.0, www.w3.org/Voice/2006/voicexml3.pdf
[18]
Johnston, M. et al. MATCH: An Architecture for Multimodal Dialogue Systems, Proceedings of the 40th Annual Meeting of ACL, Philadelphia, July 2002, pp. 376--383, 2002.
[19]
Herzog, G. et al. MULTIPLATFORM Testbed: An Integration Platform for Multimodal Dialog Systems. Proceedings of the HLT-NAACL 2003 workshop on Software engineering and architecture of language technology systems - Volume 8, Pages: 75--82, 2003.
[20]
Bunt, Harry, et al. Fusion and Coordination for Multimodal Interactive Information Presentation. In {1}, 2005
[21]
Kaiser, E. et al. Mutual Disambiguation of 3D Multimodal Interaction in Augmented and Virtual Reality, ICMI-PUI '03, November 5--7, 2003.
[22]
Dumas B. et al. Strengths and weaknesses of software architectures for the rapid creation of tangible and multimodal interfaces. TEI 2008, February 18--20, 2008.
[23]
Cohen, P.R. et al. QuickSet: Multimodal Interaction for Distributed Applications. Proceedings of ACM Multimedia 1997, pages 31--40, 1997.
[24]
Larson, James. et al. (eds). W3C Multimodal Interaction Framework, W3C NOTE, 06 May 2003.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICMI '08: Proceedings of the 10th international conference on Multimodal interfaces
October 2008
322 pages
ISBN:9781605581989
DOI:10.1145/1452392
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. dialogue
  2. multimodal
  3. mvc
  4. xml

Qualifiers

  • Poster

Conference

ICMI '08
Sponsor:
ICMI '08: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES
October 20 - 22, 2008
Crete, Chania, Greece

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 398
    Total Downloads
  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media