skip to main content
10.1145/2516540.2516553acmotherconferencesArticle/Chapter ViewAbstractPublication PagesautomotiveuiConference Proceedingsconference-collections
research-article

International evaluation of NLU benefits in the domain of in-vehicle speech dialog systems

Published:28 October 2013Publication History

ABSTRACT

An in-vehicle speech dialog system (SDS) can support visualhaptic interfaces and reduce eyes-off-road time while driving. This work evaluates two SDS that varied according to the degree of natural language understanding afforded by the speech dialog system. In a Wizard of Oz simulation, two alternative SDSs were tested in a driving simulator. The Lane Change Test was used to compare a command and control system with a system supporting natural language input. This driving simulator study was conducted using the same setup in Germany, USA, and China. 40 participants per country were instructed to perform interaction tasks from contexts like media, telephone, and navigation. The results show that natural language SDS could lead to a faster and more intuitive way of interacting with in-vehicle SDS. US and Chinese users especially preferred the natural language enabled system over the command and control system.

References

  1. Branigan, H. P., Pickering, M. J. Pearson, J. and McLean, J.F. 2010. Linguistic alignment between people and computers. Journal of Pragmatics, 42, 2355--2368.Google ScholarGoogle ScholarCross RefCross Ref
  2. Brooke, J. 1996. SUS: A Quick and Dirty Usability Scale. In Usability Evaluation in Industry, P. W. Jordan, B. Thomas, B. A. Weerdmeester & I. L. McClelland, Eds. London: Taylor & Francis, 189--194.Google ScholarGoogle Scholar
  3. Brumby, D. P., Davies, S. C., Janssen, C. P., and Grace, J. J. 2011. Fast or safe? How Performance Objectives Determine Modality Output Choices while Interacting on the Move. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI'11. ACM, New York, NY, 473--482. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Cameron, H. 2000. Speech at the interface. Proceedings of the COST249 Workshop on Speech in Telephone Networks (Ghent, Belgium, May 2000), 1--7.Google ScholarGoogle Scholar
  5. Hackenberg, L. 2013. Maschinen als kollaborative Gesprächspartner. Doctoral Thesis. Technical University Braunschweig.Google ScholarGoogle Scholar
  6. Hamerich, S. W. 2009. Sprachbedienung im Automobil: Teilautomatisierte Entwicklung benutzerfreundlicher Dialogsysteme. Springer, Berlin Heidelberg.Google ScholarGoogle Scholar
  7. ISO, ISO 26022:2010 - Road vehicles - Ergonomic aspects of transport information and control systems - Simulated lane change test to assess in-vehicle secondary task demand. 2010.Google ScholarGoogle Scholar
  8. Leiber, P. 2010. Ergonomische Produktgestaltung am Beispiel mobiler Geräte im interkulturellen Vergleich: China-Deutschland-USA. Doctoral Thesis, Technical University Chemnitz.Google ScholarGoogle Scholar
  9. Maciej, J., and Vollrath, M. 2009. Comparison of manual vs. speech-based interaction with in-vehicle information systems. Accident Analysis and Prevention, 41, 924--930.Google ScholarGoogle ScholarCross RefCross Ref
  10. Pickering, M. J., and Garrod, S. 2004. Toward a mechanistic psychology of dialogue. Behavioral and Brain Sciences, 27, 169--190.Google ScholarGoogle ScholarCross RefCross Ref
  11. Salvucci, D. D. 2001. Predicting the effects of in-car interface use on driver performance: An integrated model approach. International Journal of Human-Computer Studies, 55, 85--107.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Tsimhoni, O., Smith, D., and Green, P. 2004. Address entry while driving: Speech recognition versus a touch-screen keyboard. Human Factors, 46, 600--610.Google ScholarGoogle ScholarCross RefCross Ref
  13. Wechsung, I., Schaffer, S., Schleicher, R., Naumann, A., and Möller, S. 2010. Proceedings of the 11th Annual Conference of the ISCA (Makuhari, Chiba, Japan, 2010). Interspeech '10. ISCA, 1930--1933.Google ScholarGoogle Scholar
  14. Wickens, C. D. 2002. Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3, 2, 159--177.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. International evaluation of NLU benefits in the domain of in-vehicle speech dialog systems

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Other conferences
              AutomotiveUI '13: Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
              October 2013
              281 pages
              ISBN:9781450324786
              DOI:10.1145/2516540

              Copyright © 2013 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 28 October 2013

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • research-article

              Acceptance Rates

              AutomotiveUI '13 Paper Acceptance Rate41of67submissions,61%Overall Acceptance Rate248of566submissions,44%

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader