skip to main content
research-article

Rapid prototyping and evaluation of in-vehicle interfaces

Published:16 June 2009Publication History
Skip Abstract Section

Abstract

As driver distraction from in-vehicle devices becomes an increasingly critical issue, researchers have aimed to establish better scientific understanding of distraction along with better engineering tools to build less distracting devices. This article presents a new system, Distract-R, that allows designers to rapidly prototype and evaluate new in-vehicle interfaces. The core engine of the system relies on a rigorous cognitive model of driver behavior which, when integrated with models of task behavior on the prototyped interfaces, generate predictions of driver performance and distraction. Distract-R allows a designer to prototype basic interfaces, demonstrate possible tasks on these interfaces, specify relevant driver characteristics and driving scenarios, and finally simulate, visualize, and analyze the resulting behavior as generated by the cognitive model. The article includes three modeling studies that demonstrate the system's ability to account for various aspects of driver performance for several types of in-vehicle interfaces. More generally, Distract-R illustrates how cognitive models can be used as internal simulation engines for design tools intended for nonmodelers, with the ultimate goal of helping to understand and predict user behavior in multitasking environments.

References

  1. Alm, H. and Nilsson, L. 1994. Changes in driver behaviour as a function of hands-free mobile phones—A simulator study. Accid. Anal. Preven. 26, 441--451.Google ScholarGoogle ScholarCross RefCross Ref
  2. Altmann, E. M. and Gray, W. D. 2008. An integrated model of cognitive control in task switching. Psych. Rev. 115, 602--639.Google ScholarGoogle ScholarCross RefCross Ref
  3. Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., and Qin, Y. 2004. An integrated theory of the mind. Psych. Rev. 111, 1036--1060.Google ScholarGoogle ScholarCross RefCross Ref
  4. Anderson, J. R., Bothell, D., Lebiere, C., and Matessa, M. 1998. An integrated theory of list memory. J. Mem. Lang. 38, 341--380.Google ScholarGoogle ScholarCross RefCross Ref
  5. Anderson, J. R. and Matessa, M. 1997. A production system theory of serial memory. Psych. Rev. 104, 728--748.Google ScholarGoogle ScholarCross RefCross Ref
  6. Anderson, J. R., Taatgen, N. A., and Byrne, M. D. 2005. Learning to achieve perfect time sharing: Architectural implications of Hazeltine, Teague, & Ivry 2002. J. Exp. Psych.: Hum. Percept. Perform. 31, 749--761.Google ScholarGoogle ScholarCross RefCross Ref
  7. Best, B. J., and Lebiere, C. 2003. Spatial plans, communication, and teamwork in synthetic MOUT agents. In Proceedings of the 12th Conference on Behavior Representation In Modeling and Simulation.Google ScholarGoogle Scholar
  8. Brookhuis, K. A., De Vries, G., and De Waard, D. 1991. The effects of mobile telephoning on driver performance. Accid. Anal. Preven. 23, 309--316.Google ScholarGoogle ScholarCross RefCross Ref
  9. Brumby, D. P., Howes, A., and Salvucci, D. D. 2007. A cognitive constraint model of dual-task trade-offs in a highly dynamic driving task. In Human Factors in Computing Systems: CHI 2007 Conference Proceedings. (pp. 233--242). ACM Press, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Byrne, M. D., and Anderson, J. R. 2001. Serial modules in parallel: The psychological refractory period and perfect time-sharing. Psych. Revi. 108, 847--869.Google ScholarGoogle ScholarCross RefCross Ref
  11. Card, S. K., Moran, T.P. and Newell, A. 1983. The psychology of human-computer interaction. Lawrence Erlbaum Associates. Hillsdale, NJ. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Das, A. and Stuerzlinger, W. 2007. A cognitive simulation model for novice text entry on cell phone keypads. In Proceedings of the European Conference on Cognitive Ergonomics. 141--147. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Fitts, P. M. 1954. The information capacity of the human motor system in controlling the amplitude of movement. J. Exper. Psych. 47, 381--391.Google ScholarGoogle ScholarCross RefCross Ref
  14. Fuchs, A. F. 1971. The saccadic system. In The Control of Eye Movements, Bach-Y-Rita, P., Collins, C. C., and Hyde, J. E., Eds., Academic Press, New York, 343--362.Google ScholarGoogle Scholar
  15. Gray, W. D. and Schoelles, M. J. 2003. The nature and timing of interruptions in a complex cognitive task: Empirical data and computational cognitive models. In Proceedings of the 25th Annual Meeting of the Cognitive Science Society.Google ScholarGoogle Scholar
  16. Green, P. 1999. The 15-second rule for driver information systems. In Proceeding of the 9th Annual Meeting of ITS America. Intelligent Transportation Society of America, Washington, D.C.Google ScholarGoogle Scholar
  17. Greenberg, J. A., Tijerina, L., Curry, R., Artz, B. A., Cathey, L., Kochhar, D., Kozak, K., Blommer, M., and Grant, P. 2003. Driver distraction: Evaluation with event detection paradigm. Transport Resear. Rec. 1843, 1--9.Google ScholarGoogle ScholarCross RefCross Ref
  18. Gunzelmann, G., Gross, J. B., Gluck, K. A., and Dinges, D. F. (in press). Sleep deprivation and sustained attention performance: Integrating mathematical and cognitive modeling. Cognit. Sci.Google ScholarGoogle Scholar
  19. Hancock, P. A., Lesch, M., and Simmons, L. 2003. The distraction effects of phone use during a crucial driving maneuver. Accid. Anal. Preven. 35, 501--514.Google ScholarGoogle ScholarCross RefCross Ref
  20. Hankey, J. M., Dingus, T., A., Hanowski, R. J., Wierwille, W. W., and Andrews, C. 2000. In-vehicle information systems behavioral model and design support: Final report. Tech. Rep. No. FHWA-RD-00-135, Federal Highway Administration, U.S. Department of Transportation.Google ScholarGoogle Scholar
  21. Hendricks, D. L., Freedman, M., Zador, P. L., and Fell, J. C. 2001. The relative frequency of unsafe driving acts in serious traffic crashes. Report for Contract No. DTNH22-94-C-05020, National Highway Traffic Safety Administration, U.S. Department of Transportation.Google ScholarGoogle Scholar
  22. Horrey, W. J. and Wickens, C. D. 2004. Driving and side task performance: The effects of display clutter, separation, and modality. Human Factors, 46, 611--624.Google ScholarGoogle ScholarCross RefCross Ref
  23. Howes, A., Vera, A., and Lewis, R. L. 2007. Bounding rational analysis: Constraints on asymptotic performance. In Integrated Models of Cognitive Systems (403--413) W. D. Gray (Ed.) Oxford University Press.Google ScholarGoogle Scholar
  24. Hudson, S. E., John, B. E., Knudsen, K., and Byrne, M. D. 1999. A tool for creating predictive performance models from user interface demonstrations. CHI Letters 1, 1, 93--102.Google ScholarGoogle Scholar
  25. John, B. E. and Kieras, D. E. 1996. The GOMS family of user interface analysis techniques: Comparison and contrast. ACM Trans. Comput.-Hum. Interac. 3, 320--351. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. John, B. E., Prevas, K., Salvucci, D. D., and Koedinger, K. 2004a. Predictive human performance modeling made easy. In Human Factors in Computing Systems: CHI 2004 Conference Proceedings. ACM Press, New York, 455--462. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. John, B. E., Salvucci, D. D., Centgraf, P., and Prevas, K. 2004b. Integrating models and tools in the context of driving and in-vehicle devices. In Proceedings of the 6th International Conference on Cognitive Modeling. Lawrence Erlbaum Associates. Mahwah, NJ, 130--135.Google ScholarGoogle Scholar
  28. John, B. E. and Salvucci, D. D. 2005. Multi-purpose prototypes for assessing user interfaces in pervasive computing systems. IEEE Perv. Comput. 4, 27--34. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Kieras, D. E., Wood, S. D., Abotel, K., and Hornof, A. 1995. GLEAN: A computer-based tool for rapid GOMS model usability evaluation of user interface designs. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST'95). Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Landay, J. A. and Myers, B. A. 1995. Interactive sketching for the early stages of user interface design. In Proceedings of the Conference on Human Factors in Computing Systems (CHI'95). ACM Press, New York, 43--50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Lee, J. D., Caven, B., Haake, S., and Brown, T. L. 2001. Speech-based interaction with in-vehicle computers: The effect of speech-based e-mail on drivers' attention to the roadway. Human Factors, 43, 631--640.Google ScholarGoogle ScholarCross RefCross Ref
  32. Liu, Y., Feyen, R., and Tsimhoni, O. 2005. Queueing network-model human processor (QN-MHP): A computational architecture for multi-task performance in human-machine systems. ACM Trans. Comput.-Hum. Interac. 13, 37--70. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Maynard, H. B., Stegemerten, G. J., and Schwab, J. L. 1948. Methods-Time Measurement. McGraw-Hill, New York.Google ScholarGoogle Scholar
  34. Mclane, R. C. and Wierwille, W. W. 1975. The influence of motion and audio cues on driver performance in an automobile simulator. Hum. Fact. 17, 488--501.Google ScholarGoogle ScholarCross RefCross Ref
  35. Mcknight, A. J. and Mcknight, A. S. 1993. The effect of cellular phone use upon driver attention. Accid. Anal. Preven. 25, 259--265.Google ScholarGoogle ScholarCross RefCross Ref
  36. Meyer, D. E., Glass, J. M., Mueller, S. T., Seymour, T. L., and Kieras, D. E. 2001. Executive-process interactive control: A unified computational theory for answering twenty questions (and more) about cognitive ageing. Euro. J. Cogn. Psych. 13, 123--164.Google ScholarGoogle ScholarCross RefCross Ref
  37. Myers, B., Mcdaniel, R., and Wolber, D. 2000. Programming by example: Intelligence in demonstrational interfaces. Commun. ACM. 43, 82--89. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Paganelli, L. and Paternò, F. 2003. A tool for creating design models from web site code. Int. J. Softw. Engin. Knowl. Engin. 13, 169--189.Google ScholarGoogle ScholarCross RefCross Ref
  39. Reed, M. P. and Green, P. A. 1999. Comparison of driving performance on-road and in a low-cost driving simulator using a concurrent telephone dialing task. Ergonomics 42, 1015--1037.Google ScholarGoogle ScholarCross RefCross Ref
  40. Ritter, F. E., Reifers, A. L., Klein, A. C., and Schoelles, M. J. 2007. Lessons from defining theories of stress. In Integrated Models of Cognitive Systems. In W. Gray Ed. Oxford University Press. New York, NY.Google ScholarGoogle Scholar
  41. Ritter, F. E., Van Rooy, D., St. Amant, R., and Simpson, K. 2006. Providing user models with direct access to computer interfaces: An exploratory study of a simple human-robot interface. IEEE Trans. Syst. Man, and Cybern. 36, 592--601. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Salvucci, D. D. 2001. Predicting the effects of in-car interface use on driver performance: An integrated model approach. Int. J. Hum.-Comput. Stud. 55, 85--107.Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Salvucci, D. D. 2005. A multitasking general executive for compound continuous tasks. Cognit. Sci. 29, 457--492.Google ScholarGoogle ScholarCross RefCross Ref
  44. Salvucci, D. D. 2006. Modeling driver behavior in a cognitive architecture. Hum. Fact. 48, 362--380.Google ScholarGoogle ScholarCross RefCross Ref
  45. Salvucci, D. D., Chavez, A. K., and Lee, F. J. 2004. Modeling effects of age in complex tasks: A case study in driving. To appear in Proceedings of the 26th Annual Conference of the Cognitive Science Society.Google ScholarGoogle Scholar
  46. Salvucci, D. D., John, B. E., Prevas, K., and Centgraf, P. 2005. Rapid development of keystroke-level models for on- and off-the-desktop interfaces. Manuscript in preparation.Google ScholarGoogle Scholar
  47. Salvucci, D. D. and Lee, F. J. 2003. Simple cognitive modeling in a complex cognitive architecture. In CHI 2003 Conference Proceedings. ACM Press, New York, 265--272. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Salvucci, D. D. and Macuga, K. L. 2002. Predicting the effects of cellular-phone dialing on driver performance. Cognit. Syst. Resear. 3, 95--102. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Salvucci, D. D. and Taatgen, N. A. 2008. Threaded cognition: An integrated theory of concurrent multitasking. Psych. Rev. 115, 101--130.Google ScholarGoogle ScholarCross RefCross Ref
  50. Salvucci, D. D., Zuber, M., Beregovaia, E., and Markley, D. 2005. Distract-R: Rapid prototyping and evaluation of in-vehicle interfaces. In Human Factors in Computing Systems: CHI 2005 Conference Proceedings ACM Press, New York, 581--589. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. St. Amant, R., Horton, T. E., and Ritter, F. E. 2007. Model-based evaluation of expert cell phone menu interaction. ACM Trans. Hum.-Comput. Interac. 14, 1--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. St. Amant, R., Lieberman, H., Potter, R., and Zettlemoyer, L. 2000. Visual generation in programming by example. Comm. ACM 43, 107--114. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. St. Amant, R. and Ritter, F. E. 2005. Specifying ACT-R models of user interaction with a GOMS language. Cognit. Syst. Resear. 6, 71--88. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Strayer, D. L. and Drews, F. A. 2004. Profiles in driver distraction: Effects of cell phone conversations on younger and older drivers. Hum. Fact. 46, 640--649.Google ScholarGoogle ScholarCross RefCross Ref
  55. Strayer, D. L. and Johnston, W. A. 2001. Driven to distraction: Dual-task studies of simulated driving and conversing on a cellular telephone. Psych. Sci. 12, 462--466.Google ScholarGoogle ScholarCross RefCross Ref
  56. Taatgen, N. A. and Lee, F. J. 2003. Production compilation: A simple mechanism to model complex skill acquisition. Hum. Fact. 45, 61--76.Google ScholarGoogle ScholarCross RefCross Ref
  57. Tijerina, L., Johnston, S., Parmer, E., Winterbottom, M. D., and Goodman, M. 2000. Driver distraction with route guidance systems. Tech. Rep. DOT HS 809 069, East Liberty, OH: National Highway Traffic Safety Administration.Google ScholarGoogle Scholar
  58. Tollinger, I., Lewis, R. L., Mccurdy, M., Tollinger, P., Vera, A. H., Howes, A., and Pelton, L. 2005. Supporting efficient development of cognitive models at multiple skill levels: exploring recent advances in constraint-based modeling. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 411--420. Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Wickens, C. D., Goh, J., Helleberg, J., Horrey, W. J., and Talleur, D. A. 2003. Attentional models of multitask pilot performance using advanced display technology. Hum. Fact. 45, 360--380.Google ScholarGoogle ScholarCross RefCross Ref
  60. Wu, C. and Liu, Y. 2007. Queueing network modeling of driver workload and performance. IEEE Trans. Intell. Transport. Syst. 8, 528--537. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Rapid prototyping and evaluation of in-vehicle interfaces

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            • Published in

              cover image ACM Transactions on Computer-Human Interaction
              ACM Transactions on Computer-Human Interaction  Volume 16, Issue 2
              June 2009
              148 pages
              ISSN:1073-0516
              EISSN:1557-7325
              DOI:10.1145/1534903
              Issue’s Table of Contents

              Copyright © 2009 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 16 June 2009
              • Revised: 1 January 2009
              • Accepted: 1 January 2009
              • Received: 1 May 2008
              Published in tochi Volume 16, Issue 2

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • research-article
              • Research
              • Refereed

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader