Skip to main content
SpringerLink
Log in

Intuition as Instinctive Dialogue

  • Chapter
Book cover Computing with Instinct

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5897))

Abstract

A multimodal dialogue system which answers user questions in natural speech presents one of the main achievements of contemporary interaction-based AI technology. To allow for an intuitive, multimodal, task-based dialogue, the following must be employed: more than explicit models of the discourse of the interaction, the available information material, the domain of interest, the task, and/or models of a user or user group. The fact that humans adapt their dialogue behaviour over time according to their dialogue partners’ knowledge, attitude, and competence poses the question for us what the influence of intuition in this natural human communication behaviour might be. A concrete environment, where an intuition model extends a sensory-based modelling of instincts can be used and should help us to assess the significance of intuition in multimodal dialogue. We will explain the relevant concepts and references for self-study and offer a specific starting point of thinking about intuition as a recommendation to implement complex interaction systems with intuitive capabilities. We hope this chapter proposes avenues for future research to formalise the concept of intuition in technical, albeit human-centred, AI systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach, 2nd edn. Prentice-Hall, Englewood Cliffs (2003)

    MATH  Google Scholar 

  2. Mitchell, T.M.: Machine Learning. McGraw-Hill International Edit, New York (1997)

    MATH  Google Scholar 

  3. Maybury, M., Stock, O., Wahlster, W.: Intelligent interactive entertainment grand challenges. IEEE Intelligent Systems 21(5), 14–18 (2006)

    Article  Google Scholar 

  4. Maybury, M.T.: Planning multimedia explanations using communicative acts, pp. 59–74. American Association for Artificial Intelligence, Menlo Park (1993)

    Google Scholar 

  5. Sonntag, D.: Introspection and adaptable model integration for dialogue-based question answering. In: Proceedings of the Twenty-first International Joint Conferences on Artificial Intelligence, IJCAI (2009)

    Google Scholar 

  6. Cole, R.A., Mariani, J., Uszkoreit, H., Varile, G., Zaenen, A., Zue, V., Zampolli, A. (eds.): Survey of the State of the Art in Human Language Technology. Cambridge University Press and Giardini, New York (1997)

    Google Scholar 

  7. Jelinek, F.: Statistical Methods for Speech Recognition (Language, Speech, and Communication). The MIT Press, Cambridge (January1998)

    Google Scholar 

  8. McTear, M.F.: Spoken dialogue technology: Enabling the conversational user interface. ACM Computing Survey 34(1), 90–169 (2002)

    Article  Google Scholar 

  9. McTear, M.: Spoken Dialogue Technology. Springer, Berlin (2004)

    Book  Google Scholar 

  10. Dybkjaer, L., Minker, W. (eds.): Recent Trends in Discourse and Dialogue. Text, Speech and Language Technology, vol. 39. Springer, Dordrecht (2008)

    Google Scholar 

  11. Maybury, M., Wahlster, W. (eds.): Intelligent User Interfaces. Morgan Kaufmann, San Francisco (1998)

    Google Scholar 

  12. van Kuppevelt, J., Dybkjaer, L., Bernsen, N.O.: Advances in Natural Multimodal Dialogue Systems (Text, Speech and Language Technology). Springer-Verlag New York, Inc., Secaucus (2007)

    Google Scholar 

  13. Woszczyna, M., Aoki-Waibel, N., Buo, F., Coccaro, N., Horiguchi, K., Kemp, T., Lavie, A., McNair, A., Polzin, T., Rogina, I., Rose, C., Schultz, T., Suhm, B., Tomita, M., Waibel, A.: Janus 1993: towards spontaneous speech translation. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 1, pp. 345–348 (1994)

    Google Scholar 

  14. Wahlster, W. (ed.): VERBMOBIL: Foundations of Speech-to-Speech Translation. Springer, Heidelberg (2000)

    MATH  Google Scholar 

  15. Seneff, S., Hurley, E., Lau, R., Pao, C., Schmid, P., Zue, V.: Galaxy-II: A reference architecture for conversational system development. In: Proceedings of ICSLP 1998, vol. 3, pp. 931–934 (1998)

    Google Scholar 

  16. Walker, M.A., Passonneau, R.J., Boland, J.E.: Quantitative and Qualitative Evaluation of the Darpa Communicator Spoken Dialogue Systems. In: Meeting of the Association for Computational Linguistics, pp. 515–522 (2001)

    Google Scholar 

  17. Walker, M.A., Rudnicky, A., Prasad, R., Aberdeen, J., Bratt, E.O., Garofolo, J., Hastie, H., Le, A., Pellom, B., Potamianos, A., Passonneau, R., Roukos, S.S.G., Seneff, S., Stallard, D.: Darpa communicator: Cross-system results for the 2001 evaluation. In: Proceedings of ICSLP, pp. 269–272 (2002)

    Google Scholar 

  18. Wahlster, W. (ed.): SmartKom: Foundations of Multimodal Dialogue Systems. Springer, Berlin (2006)

    Google Scholar 

  19. Wahlster, W.: SmartWeb: Mobile Applications of the Semantic Web. In: Dadam, P., Reichert, M. (eds.) GI Jahrestagung 2004, pp. 26–27. Springer, Heidelberg (2004)

    Google Scholar 

  20. Reithinger, N., Bergweiler, S., Engel, R., Herzog, G., Pfleger, N., Romanelli, M., Sonntag, D.: A Look Under the Hood—Design and Development of the First SmartWeb System Demonstrator. In: Proceedings of the 7th International Conference on Multimodal Interfaces (ICMI), Trento, Italy (2005)

    Google Scholar 

  21. Sonntag, D., Engel, R., Herzog, G., Pfalzgraf, A., Pfleger, N., Romanelli, M., Reithinger, N.: [66] 272–295

    Google Scholar 

  22. Aaron, A., Chen, S., Cohen, P., Dharanipragada, S., Eide, E., Franz, M., Leroux, J.M., Luo, X., Maison, B., Mangu, L., Mathes, T., Novak, M., Olsen, P., Picheny, M., Printz, H., Ramabhadran, B., Sakrajda, A., Saon, G., Tydlitat, B., Visweswariah, K., Yuk, D.: Speech recognition for DARPA Communicator. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 1, pp. 489–492 (2001)

    Google Scholar 

  23. Sonntag, D., Reithinger, N.: SmartWeb Handheld Interaction: General Interactions and Result Display for User-System Multimodal Dialogue. In: Smartweb technical document, DFKI, Saarbruecken, Germany, vol. 5 (2007)

    Google Scholar 

  24. Reithinger, N., Alexandersson, J., Becker, T., Blocher, A., Engel, R., Löckelt, M., Müller, J., Pfleger, N., Poller, P., Streit, M., Tschernomas, V.: SmartKom: Adaptive and Flexible Multimodal Access to Multiple Applications. In: Proceedings of the 5th Int. Conf. on Multimodal Interfaces, pp. 101–108. ACM Press, Vancouver (2003)

    Chapter  Google Scholar 

  25. Horvitz, E.: Uncertainty, action, and interaction: In pursuit of mixed-initiative computing. IEEE Intelligent Systems 14, 17–20 (1999)

    Google Scholar 

  26. van Rijsbergen, C.J.: Information Retrieval, 2nd edn. Butterworths, London (1979)

    MATH  Google Scholar 

  27. Manning, C.D., Raghavan, P., Schütze, H.: Introduction to Information Retrieval. Cambridge University Press, New York (2008)

    Book  MATH  Google Scholar 

  28. Ingwersen, P.: Information Retrieval Interaction. Taylor Graham, London (1992)

    Google Scholar 

  29. Cai, Y.: [66] 17–46

    Google Scholar 

  30. Singh, S., Litman, D., Kearns, M., Walker, M.A.: Optimizing Dialogue Management with Reinforcement Learning: Experiments with the NJFun System. Journal of Artificial Intelligence Research (JAIR) 16, 105–133 (2002)

    MATH  Google Scholar 

  31. Jameson, A.: Adaptive interfaces and agents. In: The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, pp. 305–330. Lawrence Erlbaum Associates, Inc., Mahwah (2003)

    Google Scholar 

  32. Paek, T., Chickering, D.: The markov assumption in spoken dialogue management. In: Proceedings of the 6th SigDial Workshop on Discourse and Dialogue, Lisbon, Portugal (2005)

    Google Scholar 

  33. Oviatt, S., Swindells, C., Arthur, A.: Implicit user-adaptive system engagement in speech and pen interfaces. In: CHI 2008: Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, pp. 969–978. ACM, New York (2008)

    Chapter  Google Scholar 

  34. Sonntag, D.: Ontologies and Adaptivity in Dialogue for Question Answering. AKA Press and IOS Press (January 2010)

    Google Scholar 

  35. Strachan, L., Anderson, J., Evans, M.: Pragmatic user modelling in a commercial software system. In: Proceedings of the 6th International Conference on User Modeling, pp. 189–200. Springer, Heidelberg (1997)

    Google Scholar 

  36. Forbes-Riley, K., Litman, D.: A user modeling-based performance analysis of a wizarded uncertainty-adaptive dialogue system corpus. In: Proceedings of Interspeech (2009)

    Google Scholar 

  37. Zukerman, I., Litman, D.J.: Natural language processing and user modeling: Synergies and limitations. User Model. User-Adapt. Interact. 11(1-2), 129–158 (2001)

    Article  MATH  Google Scholar 

  38. Kaizer, S., Bunt, H.: Multidimensional dialogue management. In: Proceedings of the 7th SigDial Workshop on Discourse and Dialogue, Sydney, Australia (July 2006)

    Google Scholar 

  39. Brown, P., Levinson, S.C.: Politeness: Some Universals in Language Usage (Studies in Interactional Sociolinguistics). Cambridge University Press, Cambridge (1987)

    Google Scholar 

  40. Gruber, T.R.: Towards Principles for the Design of Ontologies Used for Knowledge Sharing. In: Guarino, N., Poli, R. (eds.) Formal Ontology in Conceptual Analysis and Knowledge Representation. Kluwer Academic Publishers, The Netherlands (1993)

    Google Scholar 

  41. Oviatt, S., MacEachern, M., Levow, G.A.: Predicting hyperarticulate speech during human-computer error resolution. Speech Commun. 24(2), 87–110 (1998)

    Article  Google Scholar 

  42. Paek, T., Horvitz, E., Ringger, E.: Continuous Listening for Unconstrained Spoken Dialog. In: Proceedings of the 6th International Conference on Spoken Language Processing, ICSLP 2000 (2000)

    Google Scholar 

  43. Gebhard, P.: Emotionalisierung interaktiver Virtueller Charaktere - Ein mehrschichtiges Computermodell zur Erzeugung und Simulation von Gefuehlen in Echtzeit. PhD thesis, Saarland University (2007)

    Google Scholar 

  44. Ruckmick, C.A.: The Psychology of Feeling and Emotion. McGraw-Hill, New York (1936)

    Book  Google Scholar 

  45. Morris, W.N.: Mood: The Frame of Mind. Springer, New York (1989)

    Book  Google Scholar 

  46. Reithinger, N., Gebhard, P., Löckelt, M., Ndiaye, A., Pfleger, N., Klesen, M.: Virtualhuman: dialogic and affective interaction with virtual characters. In: ICMI 2006: Proceedings of the 8th international conference on Multimodal interfaces, pp. 51–58. ACM, New York (2006)

    Google Scholar 

  47. André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds.): ADS 2004. LNCS (LNAI), vol. 3068. Springer, Heidelberg (2004)

    Google Scholar 

  48. Mehrabian, A.: Outline of a general emotion-based theory of temperament. In: Explorations in temperament: International Perspectives on Theory and Measurement, pp. 75–86. Plenum, New York (1991)

    Chapter  Google Scholar 

  49. Ortony, A., Clore, G.L., Collins, A.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1988)

    Book  Google Scholar 

  50. McCrae, R., John, O.: An introduction to the five-factor model and its applications 60, 175–215 (1992)

    Google Scholar 

  51. Minsky, M.: The Emotion Machine: Commonsense Thinking, Artificial Intelligence, and the Future of the Human Mind. Simon & Schuster, New York (November 2006)

    Google Scholar 

  52. Tosa, N., Nakatsu, R.: Life-like communication agent -emotion sensing character ”mic” & feeling session character ”muse”-. In: ICMCS 1996: Proceedings of the 1996 International Conference on Multimedia Computing and Systems (ICMCS 1996). IEEE Computer Society, Washington, DC (1996)

    Google Scholar 

  53. Batliner, A.: Whence and whither: The automatic recognition of emotions in speech (invited keynote). In: André, E., Dybkjær, L., Minker, W., Neumann, H., Pieraccini, R., Weber, M. (eds.) PIT 2008. LNCS (LNAI), vol. 5078, pp. 1–1. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  54. Rotaru, M., Litman, D.J., Forbes-Riley, K.: Interactions between speech recognition problems and user emotions. In: Proceedings of Interspeech 2005 (2005)

    Google Scholar 

  55. Litman, D.J., Moore, J.D., Dzikovska, M., Farrow, E.: Using natural language processing to analyze tutorial dialogue corpora across domains modalities. In: [67] 149–156

    Google Scholar 

  56. van Turnhout, K., Terken, J., Bakx, I., Eggen, B.: Identifying the intended addressee in mixed human-human and human-computer interaction from non-verbal features. In: ICMI 2005: Proceedings of the 7th International Conference on Multimodal Interfaces, pp. 175–182. ACM, New York (2005)

    Google Scholar 

  57. Mehrabian, A.: Nonverbal Communication. Aldine-Atherton, Chicago, Illinois (1972)

    Google Scholar 

  58. Valstar, M., Pantic, M.: Fully automatic facial action unit detection and temporal analysis. In: CVPRW 2006: Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop, vol. 149. IEEE Computer Society, Washington, DC (2006)

    Google Scholar 

  59. Tao, H., Huang, T.S.: Connected vibrations: A modal analysis approach for non-rigid motion tracking. In: CVPR 1998: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 735. IEEE Computer Society, Washington, DC (1998)

    Google Scholar 

  60. Keltner, D., Ekman, P.: Facial Expression of Emotion. In: Handbook of Emotions, pp. 236–249. The Guilford Press, New York (2000)

    Google Scholar 

  61. Forbes-Riley, K., Litman, D.J.: Adapting to student uncertainty improves tutoring dialogues. In: [67], pp. 33–40

    Google Scholar 

  62. Nelson, T.O., Narens, L.: Metamemory: A theoretical framework and new findings. In: Bower, G.H. (ed.) The Psychology of Learning and Motivation: Advances in Research and Theory, vol. 26, pp. 125–169. Academic Press, London (1990)

    Google Scholar 

  63. Sonntag, D.: On introspection, metacognitive control and augmented data mining live cycles. CoRR abs/0807.4417 (2008)

    Google Scholar 

  64. Chu, S.W., ONeill, I., Hanna, P., McTear, M.: An approach to multi-strategy dialogue management. In: Proceedings of INTERSPEECH, Lisbon, Portugal, pp. 865–868 (2005)

    Google Scholar 

  65. Studer, R., Ankolekar, A., Hitzler, P., Sure, Y.: A Semantic Future for AI. IEEE Intelligent Systems 21(4), 8–9 (2006)

    Article  Google Scholar 

  66. Huang, T.S., Nijholt, A., Pantic, M., Pentland, A. (eds.): ICMI/IJCAI Workshops 2007. LNCS (LNAI), vol. 4451. Springer, Heidelberg (2007)

    Google Scholar 

  67. Dimitrova, V., Mizoguchi, R., du Boulay, B., Graesser, A.C. (eds.): Artificial Intelligence in Education: Building Learning Systems that Care: From Knowledge Representation to Affective Modelling, Proceedings of the 14th International Conference on Artificial Intelligence in Education, AIED 2009 Frontiers in Artificial Intelligence and Applications, Brighton, UK, July 6-10, vol. 200. IOS Press, Amsterdam (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. German Research Center for Artificial Intelligence, 66123, Saarbrücken, Germany

    Daniel Sonntag

Authors
  1. Daniel Sonntag
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Ambient Intelligence Lab, CIC-2218, Carnegie Mellon University, 4720 Forbes Avenue, 15213, Pittsburgh, PA, USA

    Yang Cai

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Sonntag, D. (2011). Intuition as Instinctive Dialogue. In: Cai, Y. (eds) Computing with Instinct. Lecture Notes in Computer Science(), vol 5897. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19757-4_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-19757-4_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-19756-7

  • Online ISBN: 978-3-642-19757-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation