Skip to main content
SpringerLink
Log in

First-Personness Approach to Co-operative Multimodal Interaction

  • Conference paper
  • First Online:
Advances in Multimodal Interfaces — ICMI 2000 (ICMI 2000)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1948))

Included in the following conference series:

Abstract

Using natural language in addition to graphical user interfaces is often used as an argument for a better interaction. However, just adding spoken language might not lead to a better interaction. In this article we will look deeper into how the spoken language should be used in a co- operative multimodal interface. Based on empirical investigations, we have noticed that for multimodal information systems efficiency is especially important. Our results indicate that efficiency can be divided into functional and linguistic efficiency. Functional efficiency has a tight relation to solving the task fast. Linguistic efficiency concerns how to make the contributions meaningful and appropriate in the context. For linguistic efficiency user’s perception of first-personness [1] is important, as well as giving users support for understanding the interface, and to adapt the responses to the user. In this article focus is on linguistic efficiency for a multimodal timetable information system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Laurel, B.: 0. In D. A. Norman and S. W. Draper (Eds.) User Centered Systems Design, New Perspectives on Human-Computer Interaction. Hillsdale, NJ: Lawrence Erlbaum (1986) 67–85

    Google Scholar 

  2. Brennan, S.: Conversation as Direct Manipulation. In B. Laurel (Ed.) The Art of Human-Computer Interface Design. Reading, MA: Addison-Wesley Publishing Company (1990) 393–416

    Google Scholar 

  3. Maybury, M.: Toward Cooperative Multimedia Interaction. In H. Bunt, R.-J. Buen, and T. Borghuis (eds.) Multimodal Human-Computer Communication, Systems, Techniques, and Evaluation. Lecture Notes in Artificial Intelligence 1374. Springer Verlag (1998) 13–38

    Google Scholar 

  4. McGlashan, S.; Towards Multimodal Dialogue Management. In Proceedings of Twente Workshop on Language Technology 11, Enschede, The Netherlands (1996)

    Google Scholar 

  5. Grice, H. P.: Logic and Conversation (From William James Lectures, Harvard University, 1967). In P. Cole, and J. Morgan (Eds.) Syntax and Sematics 3: Speech Acts. New York: Academic Press (1975)

    Google Scholar 

  6. Fais, L., Loken-Kim, K.-H., and Park, Y.-D.,:. Speaker’s Responses to Requests for Repetition in a Multimodal Language Processing Environment. In H. Bunt, R.-J. Buen, and T. Borghuis (eds.) Multimodal Human-Computer Communication, Systems, Techniques, and Evaluation. Lecture Notes in Artificial Intelligence1374.springer Verlag (1998) 264–278

    Google Scholar 

  7. McGlashan, S., Fraser, N. M., Gilbert, G. N., Bilange, E., Heisterkamp, P., and Youd, N. J.: Dialogue Management for Telephone Information Systems. In Proceedings of the International Conference on Applied Language Processing, Trento, Italy (1992)

    Google Scholar 

  8. Clark, H. H., and Schaefer, E. F.: Contribution to Discourse. Cognitive Science. Vol. 13, (1989) 259–294

    Article  Google Scholar 

  9. Brennan, S. E. and Hulteen, E. A.: Interaction and feedback in a spoken language system. In AAAI-93 Fall Symposium on Human-Computer Collaboration: Reconciling Theory, Syntesizing Practice. AAAI Technical Report FS-93-05 (1993) 1–5

    Google Scholar 

  10. Pérez-Quiñones, M. A., and Sibert, J. L.: A Collaborative Model of Feedback in Human-Computer Interaction. In Proceeding of Conference on Human Factors in Computing, (CHI 96), Vancover, Canada (1996) 316–323

    Google Scholar 

  11. Jönsson, A. and Dahlbäck, N.: Talking to a Computer is not Like Talking to Your Best Friend. In Proceedings of The first Scandinivian Conference on Artificial Intelligence, Tromsø, Norway (1988)

    Google Scholar 

  12. Cheepen, C., and Monaghan, J.: Designing for Naturalness in Automated Dialogues. In Y. Wilks (Ed.) Machine Conversation. Boston: Kluwer Academic Publishers (1999) 127–142

    Google Scholar 

  13. William, D. and Cheepen, C.: “Just speak naturally”: Designing for naturalness in automated spoken dialogues. In Proceedings of Conference on Human Factors in Computing Systems (CHI.98), Los Angeles (1998) 243–244

    Google Scholar 

  14. Chu-Carroll, J., and Nickerson, J. S.: Evaluating Automatic Dialogue Strategy Adaptation for a Spoken Dialogue System. In Proceedings of 1st Meeting of the North American Chapter of the Association of Computational Linguistics, Seattle, WA (2000) 202–209

    Google Scholar 

  15. Dahlbäck, N., Flycht-Eriksson, A., Jönsson, A, and Qvarfordt, P.: An Architecture for Multi-Modal Natural Dialogue Systems. In Proceedings of ESCA Tutorial and Research Workshop (ETRW) on Interactive Dialogue in Multi-Modal Systems, Germany (1999) 53–56

    Google Scholar 

  16. Qvarfordt, P., and Jönsson, A.: Effects on Using Speech in Timetable Information System for the WWW. In Proceedings of the ICSLP’98, Sydney, Australia (1998) 1635–1638

    Google Scholar 

  17. Bunt, H., Ahn, R., Beun, R.-J., Borghuis, T., and van Overveld, K.: Multimodal Cooperation with the DENK system. In H. Bunt, R.-J. Buen, and T. Borghuis (Eds.) Multimodal Human-Computer Communication, Systems, Techniques, and Evaluation. Lecture Notes in Artificial Intelligence 1374. Springer Verlag (1998) pp39-67.

    Google Scholar 

  18. Sidner, C. L., Boettner, C., and Rich, C.: Lessons Learned in Building Spoken Language Collaborative Interface Agents. In Proceedings of ANLP/NNAACLP 2000 Workshop on Conversational Systems, Seattle, WA (2000) 1–6

    Google Scholar 

  19. Hayes, P. J. and Reddy, D. R.: Steps toward graceful interaction in spoken and written man-machine communication. International Journal of Man-Machine Studies 19 (1983) 231–284

    Article  Google Scholar 

  20. Flycht-Eriksson, A.: A Domain Knowledge Manager for Dialogue Systems. In Proceedings of European Conference on Artificial Intelligence (ECAI’00). Berlin: Germany (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer and Information Science, Natural Language Processing Laboratory, 83 Linköpings universitet, SE-581, Sweden

    Pernilla Qvarfordt & Lena Santamarta

Authors
  1. Pernilla Qvarfordt
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lena Santamarta
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute of Automation, Chinese Academy of Sciences, P.O.Box 2728, 100080, Beijing, China

    Tieniu Tan

  2. Computer Department, Media Laboratory, Tsinghua University, 100084, Beijing, China

    Yuanchun Shi

  3. Institute of Computing Technology, Chinese Academy of Sciences, P.O.Box 2704, 100080, Beijing, China

    Wen Gao

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Qvarfordt, P., Santamarta, L. (2000). First-Personness Approach to Co-operative Multimodal Interaction. In: Tan, T., Shi, Y., Gao, W. (eds) Advances in Multimodal Interfaces — ICMI 2000. ICMI 2000. Lecture Notes in Computer Science, vol 1948. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-40063-X_84

Download citation

  • DOI: https://doi.org/10.1007/3-540-40063-X_84

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-41180-2

  • Online ISBN: 978-3-540-40063-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation