Skip to main content
SpringerLink
Log in

Interactions between human–human multi-threaded dialogues and driving

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

In-car devices with speech user interfaces are proliferating. How can we build these interfaces such that they allow human–computer interactions with multiple devices to overlap in time, but without interfering with the driving task? We suggest that interface design can be inspired by the way people deal with this problem in human–human dialogues and propose discovering human dialogue behaviors of interest through experiments. In this paper, we discuss how to design an appropriate human–human dialogue scenario for such experiments. We also report on one human–human experiment, in terms of the dialogue behaviors found, and impact on the verbal tasks and on driving. We also offer design considerations based on the results of the study.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. Most of this work is derived from the second author’s Ph.D. dissertation [5].

  2. Some subject pairs, including the ones from the dialogue excerpt in Table 1, decided that the dispatcher’s first utterance would also reveal the location of the dispatcher’s object. Thus, utterance 1 in Table 1 is also communicating that the dispatcher’s object is in the kitchen. In our study, three of the 16 participant pairs negotiated during the training period.

References

  1. Horrey WJ, Wickens CD (2006) Examining the impact of cell phone conversations on driving using meta-analytic techniques. Hum Factors 48(1):196–205

    Article  Google Scholar 

  2. Kun AL, Paek T, Medenica Z (2007) The effect of speech interface accuracy on driving performance. In: Proceedings of Interspeech, Antwerp, Belgium

    Google Scholar 

  3. Heeman PA, Yang F, Kun AL, Shyrokov A (2005) Conventions in human–human multi-threaded dialogues: a preliminary study. In: Proceedings of the international conference on intelligent user interfaces, San Diego, CA

  4. Reuda-Domingo T, Lardelli-Claret P, de Luna-del-Castillo JD, Jimenez-Moleon JJ, Garcia-Martin M, Bueno-Cavanillas A (2004) The influence of passengers on the risk of the driver causing a car collision in Spain: analysis of collisions from 1990 to 1999. Accident Anal Prevent 36:481–489

    Google Scholar 

  5. Shyrokov A (2010) Human-human multi-threaded spoken dialogs in the presence of driving. Doctoral dissertation, University of New Hampshire

  6. Shyrokov A (2006) Setting up experiments to test a multi-threaded speech user interface. Technical report ECE.P54.2006.1, University of New Hampshire

  7. Toh SL, Yang F, Heeman PA (2006) An annotation scheme for agreement analysis. In: Proceedings of the 9th international conference on spoken language processing (ICSLP-06), Pittsburgh PA

  8. Shyrokov A, Kun A, Heeman P (2007) Experimental modeling of human–human multi-threaded dialogues in the presence of a manual-visual task. In: Proceedings of the 8th SIGdial workshop on discourse and dialogue, Antwerp, Belgium

  9. Anderson AH, Bader M, Bard EC, Boyle E, Doherty G, Garrod S, Isard S, Kowtko J, McAllister J, Miller J, Sotillo C, Thompson H, Weinert R (1991) The HCRC map task corpus. Lang Speech 34(4):351–366

    Google Scholar 

  10. Villing J, Holtelius C, Larsson S, Lindstrom A, Seward A, Aberg N (2008) Interruption, resumption and domain switching in in-vehicle dialogue. In: Proceedings of GoTAL, 6th international conference on natural language processing, Gothenburg, Sweden

  11. Lindstrom A, Villing J, Larsson S (2008) The effect of cognitive load on disfluencies during in-vehicle spoken dialogue. In: Proceedings of Interspeech, Brisbane, Australia

  12. Villing J (2010) Now, Where Was I? Resumption strategies for an in-vehicle dialogue system. In: Proceedings of the 48th annual meeting of the association for computational linguistics, Uppsala, Sweden

  13. Vollrath M (2007) Speech and driving-solution or problem? Intell Transp Syst 1:89–94

    Google Scholar 

  14. Wickens CD (2002) Multiple resources and performance prediction. Theor Issues Ergonom Sci 3(2):159–177

    Article  Google Scholar 

  15. Kun AL, Shyrokov A, Heeman PA (2010) Spoken tasks for human–human experiments: towards in-car speech user interfaces for multi-threaded dialogue. In: Proceedings of 2nd international conference on automotive user interfaces and interactive vehicular applications (AutomotiveUI ’10), Pittsburgh, PA

  16. Strayer DL, Johnston WA (2001) Driven to distraction: dual-task studies of simulated driving and conversing on a cellular phone. Psychol Sci 12(6):462–466

    Article  Google Scholar 

  17. Tsimhoni O, Green P (1999) Visual demand of driving curves determined by visual occlusion. In: Proceedings of the vision in vehicles 8 conference, Boston, MA

  18. Yang F, Heeman PA, Kun AL (2011) An investigation of interruptions and resumptions in multi-tasking dialogues. Comput Linguist 37:1

    Article  Google Scholar 

  19. Oviatt S, Darves C, Coulston R (2004) Toward adaptive conversational interfaces: modeling speech convergence with animated personas. Trans Comput Hum Interact 11:300–328

    Article  Google Scholar 

  20. Palinko O, Kun AL, Shyrokov A, Heeman P (2010) Estimating cognitive load using remote eye tracking in a driving simulator. In: Proceedings of the eye tracking research and applications conference, Austin, TX

  21. Beatty J (1982) Task evoked pupillary responses, processing load and structure of processing resources. Psychol Bull 91(2):276–292

    Article  Google Scholar 

  22. Vergauwe E, Barrouillet P, Camos V (2010) Do mental processes share a domain-general resource? Psychol Sci 21(3):384–390

    Article  Google Scholar 

  23. Drews FA, Pasupathi M, Strayer DL (2008) Passenger and cell phone conversations in simulated driving. J Exp Psychol Appl 14(4):392–400

    Google Scholar 

Download references

Acknowledgments

This work was funded by the NSF under grant IIS-0326496 and by the US Department of Justice under grants 2006DDBXK099, 2008DNBXK221, 2009D1BXK021, and 2010DDBXK226.

Author information

Authors and Affiliations

  1. Electrical and Computer Engineering Department, University of New Hampshire, Kingsbury Hall, Durham, NH, 03824, USA

    Andrew L. Kun & Alexander Shyrokov

  2. Biomedical Engineering Department, Center for Spoken Language Understanding, Oregon Health and Science University, Beaverton, OR, 97006, USA

    Peter A. Heeman

Authors
  1. Andrew L. Kun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alexander Shyrokov
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Peter A. Heeman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrew L. Kun.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kun, A.L., Shyrokov, A. & Heeman, P.A. Interactions between human–human multi-threaded dialogues and driving. Pers Ubiquit Comput 17, 825–834 (2013). https://doi.org/10.1007/s00779-012-0518-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-012-0518-1

Keywords

Search

Navigation