Skip to main content

SmartKom-Mobile: Intelligent Interaction with a Mobile System

  • Chapter
SmartKom: Foundations of Multimodal Dialogue Systems

Summary

This paper presents SmartKom-Mobile, the mobile version of the SmartKom system. SmartKom-Mobile brings together highly advanced user interaction and mobile computing in a novel way and allows for ubiquitous access to multidomain information. SmartKom-Mobile is device-independent and realizes multimodal interaction in cars and on mobile devices such as PDAs. With its siblings, SmartKom-Home and SmartKom-Public, it provides intelligent user interfaces for an extremely broad range of scenarios and environments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  • C.F. Baker, C.J. Fillmore, and J.B. Lowe. The Berkeley FrameNet Project. In: Proc. COLING-ACL’98, pp. 86–90, Montreal, Canada, 1998.

    Google Scholar 

  • M. Boualem, L. Almeida, I. Amdal, N. Beires, L. Boves, E. den Os, P. Filoche, R. Gomes, J. Eikeset Knudsen, K. Kvale, J. Rugelbak, C. Tallec, and N. Warakagoda. Eurescom MUST Project: Multimodal, Multi-lingual Information Services for Small Mobile Terminals. In: Proc. 9th Conf. of Traitement Automatique des Langues Naturel, Nancy, France, 2002.

    Google Scholar 

  • D. Bühler, J. Häußler, S. Krüger, and W. Minker. Flexible Multimodal Human-Machine Interaction in Mobile Environments. In: ECAI Workshop Notes of AIMS 2002, Lyon, France, 2002.

    Google Scholar 

  • L. Console, S. Gioria, I. Lombardi, V. Surano, and I. Torre. Adaptation and Personalization on Board Cars: A Framework and its Application to Tourist Services. In: Adaptive Hypermedia and Adaptive Web-Based Systems, LNCS, pp. 112–121, Berlin Heidelberg New York, 2002. Springer.

    Google Scholar 

  • Y. Ding, C. Kray, R. Malaka, and M. Schillo. RAJA — A Resource-Adaptive Java Agent Infrastructure. In: Proc. 5th Int. Conf. on Autonomous Agents, pp. 332–339, Montreal, Canada, 2001.

    Google Scholar 

  • C. Elting, J. Zwickel, and R. Malaka. Device-Dependant Modality Selection for User-Interfaces — An Empirical Study. In: Proc. Int. Conf. on Intelligent User Interfaces (IUI) 2003, Miami, FL, 2002.

    Google Scholar 

  • R. Engel. SPIN: Language Understanding for Spoken Dialogue Systems Using a Production System Approach. In: Proc. ICSLP-2002, pp. 2717–2720, Denver, CO, 2002.

    Google Scholar 

  • I. Gurevych, R. Malaka, R. Porzel, and H.P. Zorn. Semantic Coherence Scoring Using an Ontology. In: Proc. Human Language Technology Conference / North American Chapter of the Association for Computational Linguistics Annual Meeting 2003, pp. 88–95, Edmonton, Canada, 2003a.

    Google Scholar 

  • I. Gurevych, S. Merten, and R. Porzel. Automatic Creation of Interface Specifications from Ontologies. In: H. Cunningham and J. Patrick (eds.), Proc. HLT-NAACL 2003 Workshop on Software Engineering and Architecture of Language Technology Systems (SEALTS), pp. 59–66, Edmonton, Canada, 2003b. Association for Computational Linguistics.

    Google Scholar 

  • I. Gurevych, R. Porzel, E. Slinko, N. Pfleger, J. Alexandersson, and S. Merten. Less Is More: Using a Single Knowledge Representation in Dialogue Systems. In: Proc. HLT-NAACL’03 Workshop on Text Meaning, pp. 14–21, Edmonton, Canada, May 2003c.

    Google Scholar 

  • U. Haiber, H. Mangold, T. Pfau, P. Regel-Brietzmann, G. Ruske, and V. Schleß. Robust Recognition of Spontaneous Speech. In: W. Wahlster (ed.), Verbmobil: Foundations of Speech-to-Speech Translation, pp. 46–62, Berlin Heidelberg New York, 2000. Springer.

    Google Scholar 

  • J. Häußler and A. Zipf. Multimodale Karteninteraktion zur Navigationsuntersttzung für Fußgänger und Autofahrer. In: Proc. Symposium f ür Angewandte Geographische Informationstechnologie — AGIT 2003, Salzburg, Austria, 2003.

    Google Scholar 

  • G. Herzog, H. Kirchmann, S. Merten, A. Ndiaye, and P. Poller. MULTIPLATFORM Testbed: An Integration Platform for Multimodal Dialog Systems. In: Proc. HLTNAACL 2003 Workshop on Software Engineering and Architecture of Language Technology Systems (SEALTS), pp. 76–83, Edmonton, Canada, May 2003.

    Google Scholar 

  • X. Huang, A. Acero, C. Chelba, L. Deng, D. Duchene, J. Goodman, D. Hon, H. Jacoby, L. Jiang, R. Loynd, M. Mahajan, P. Mau, S. Meredith, S. Mughal, S. Neto, M. Plumpe, K. Wang, and Y. Wang. MIPAD: A Next Generation PDA Prototype. In: Proc. ICSLP-2000, Beijing, China, 2000.

    Google Scholar 

  • M. Joest and W. Stille. A User-Aware Tour Proposal Framework Using a Hybrid Optimization Approach. In: Proc. 10th ACM Int. Symposium on Advances in Geographic Information Systems, pp. 81–88, Washington, DC, 2002.

    Google Scholar 

  • M. Johnston, S. Bangalore, G. Vasireddy, A. Stent, P. Ehlen, M. Walker, S. Whittaker, and P. Maloor. MATCH: An Architecture for Multimodal Dialogue Systems. In: Proc. 10th ACM Int. Symposium on Advances in Geographic Information Systems, pp. 376–383, Washington, DC, 2002.

    Google Scholar 

  • C. Kray and R. Porzel. Spatial Cognition and Natural Language Interfaces in Mobile Personal Assistants. In: Proc. Workshop Artificial Intelligence in Mobile Systems at the 14th ECAI (AIMS 2000), Berlin, Germany, 2000.

    Google Scholar 

  • A. Krüger, A. Butz, C. Müller, C. Stahl, R. Wasinger, K. Steinberg, and A. Dirschl. The Connected User Interface: Realizing a Personal Situated Navigation Service. In: Proc. Int. Conf. on Intelligent User Interfaces (IUI) 2004, Funchal, Madeira, Portugal, 2004.

    Google Scholar 

  • R. Malaka. Artificial Intelligence Goes Mobile. In: Proc. Workshop Artificial Intelligence in Mobile Systems at the 14th ECAI (AIMS 2000), pp. 5–6, Berlin, Germany, 2000.

    Google Scholar 

  • R. Malaka and A. Zipf. Deep Map: Challenging IT Research in the Framework of a Tourist Information System. In: D.R. Fesenmaier, S. Klein, and D. Buhalis (eds.), Proc. 7th. Int. Conf. on Information and Communication Technologies in Tourism (ENTER 2000), pp. 15–27, Berlin Heidelberg New York, 26–28 April 2000. Springer.

    Google Scholar 

  • J. Müller, P. Poller, and V. Tschernomas. Situated Delegation-Oriented Multimodal Presentation. In: Proc. AAAI-Workshop on Intelligent Situation-Aware Media and Presentations (ISAMP), AAAI-2002, Edmonton, Canada, 2002.

    Google Scholar 

  • S.L. Oviatt. Multimodal Interfaces for Dynamic Interactive Maps. In: ACM (ed.), Proc. CHI-96, pp. 95–102, New York, 1996.

    Google Scholar 

  • N. Pfleger, J. Alexandersson, and T. Becker. Scoring Functions for Overlay and Their Application in Discourse Processing. In: Proc. KONVENS 2002, pp. 139–146, Saarbruecken, Germany, September-October 2002.

    Google Scholar 

  • R. Porzel and I. Gurevych. Towards Context-Adaptive Utterance Interpretation. In: Proc. the 3rd SIGdial Workshop on Discourse and Dialogue, pp. 90–95, Philadelphia, PA, 2002.

    Google Scholar 

  • S. Rapp, S. Torge, S. Goronzy, and R. Kompe. Dynamic Speech Interfaces. In: Proc. Workshop Artificial Intelligence in Mobile Systems, ECAI 2000, Berlin, Germany, 2000.

    Google Scholar 

  • H. Rößler, J. Sienel, W. Wajda, J. Hoffmann, and M. Kostrzewa. Multimodal Interaction for Mobile Environments. In: Proc. Int. Workshop on Information Presentation and Natural Multimodal Dialogue, Verona, Italy, 2001.

    Google Scholar 

  • W. Wahlster. SmartKom: Fusion and Fission of Speech, Gestures, and Facial Expressions. In: Proc. 1st Int. Workshop on Man-Machine Symbiotic Systems, pp. 213–225, Kyoto, Japan, 2002.

    Google Scholar 

  • W. Wahlster. SmartKom: Symmetric Multimodality in an Adaptive and Reusable Dialogue Shell. In: R. Krahl and D. Günther (eds.), Proc. Human Computer Interaction Status Conference 2003, pp. 47–62, Berlin, Germany, June 2003. DLR.

    Google Scholar 

  • W. Wahlster, E. André, B. Bandyopadhyay, W. Graf, and T. Rist. WIP: The Coordinated Generation of Multimodal Presentations From a Common Representation. In: O. Stock, J. Slack, and A. Ortony (eds.), Computational Theories of Communication and Their Applications, Berlin Heidelberg New York, 1991. Springer. Also available as Technical Report DFKI-RR-91-08, DFKI, Saarbruecken, Germany.

    Google Scholar 

  • W. Wahlster, N. Reithinger, and A. Blocher. SmartKom: Multimodal Communication with a Life-like Character. In: Proc. EUROSPEECH-01, vol. 3, pp. 1547–1550, Aalborg, Denmark, September 2001.

    Google Scholar 

  • A. Zipf and S. Krüger. TGML — Extending GML Through Temporal Constructs — A Proposal for a Spatiotemporal Framework in XML. In: Proc. 9th ACM Int. Symposium on Advances in Geographic Information Systems, Atlanta, GA, 2001.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Malaka, R. et al. (2006). SmartKom-Mobile: Intelligent Interaction with a Mobile System. In: Wahlster, W. (eds) SmartKom: Foundations of Multimodal Dialogue Systems. Cognitive Technologies. Springer, Berlin, Heidelberg . https://doi.org/10.1007/3-540-36678-4_32

Download citation

  • DOI: https://doi.org/10.1007/3-540-36678-4_32

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23732-7

  • Online ISBN: 978-3-540-36678-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics