Skip to main content
SpringerLink
Log in

ADAPT: A Predictive Cognitive Model of User Visual Attention and Action Planning

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

We present a computational cognitive model of novice and expert aviation pilot action planning called ADAPT that models performance in a dynamically changing simulated flight environment. We perform rigorous tests of ADAPT's predictive validity by comparing the performance of individual human pilots to that of their respective models. Individual pilots were asked to execute a series of flight maneuvers using a flight simulator, and their eye fixations and control movements were recorded in a time-synched database. Computational models of each of the 25 individual pilots were constructed, and the individual models simulated execution of the same flight maneuvers performed by the human pilots. The time-synched eye fixations and control movements of individual pilots and their respective models were compared, and rigorous tests of ADAPT's predictive validity were performed. The model explains and predicts a significant portion of pilot visual attention and control movements during flight as a function of piloting expertise. Implications for adaptive training systems are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Allen, J. F. and Perrault, C. R.: 1980, Analyzing intention in utterances. Artificial Intelligence, 15, 143-178.

    Google Scholar 

  • Anderson, D. A.: 1989, Artificial Intelligence and Intelligent Systems. Wiley and Sons, New York.

    Google Scholar 

  • Anderson, J. R.: 1993, Rules of the Mind, Erlbaum, Hillsdale, NJ.

    Google Scholar 

  • Anderson, J. R. and Douglass, S.: (in press). Visual attention and problem solving. Journal of Experimental Psychology: Learning, Memory and Cognition.

  • Broadbent, D. E.: 1993, Comparison with human experiments. In: D. E. Broadbent (ed.), The simulation of human intelligence. Blackwell, Cambridge, MA, pp. 198-217.

    Google Scholar 

  • Chase, W. G. and Ericsson, K. A.: 1982, Skill and working memory. Psychology of Learning and Motivation, 16, 1-8.

    Google Scholar 

  • Doane, S. M., Mannes, S. M., Kintsch, W. and Polson, P. G.: 1992, Modeling User Command Production: A Comprehension-Based Approach. User Modeling and User Adapted Interaction, 2(3), 249-285.

    Google Scholar 

  • Doane, S. M., McNamara, D. S., Kintsch, W., Polson, P. G. and Clawson, D.: 1992, Prompt comprehension in UNIX command production. Memory and Cognition, 20(4), 327-343.

    Google Scholar 

  • Doane, S. M. and Sohn, Y.W.: 1999, Instrument Scanning as a Function of Piloting Expertise. Manuscript submitted for publication.

  • Doane, S. M., Sohn, Y. W., Adams, D. and McNamara, D. S.: 1994, Learning from instruction: A comprehension-based approach. Proceedings of the 16th Annual Conference of the Cognitive Science Society, Atlanta, GA: Erlbaum, pp. 254-259.

    Google Scholar 

  • Doane, S. M., Sohn, Y. W., McNamara, D. S. and Adams, D.: (in press). Comprehension-based skill acquisition. Cognitive Science.

  • Dogan, P.: 1991, The instrument flight training manual. Santa Clarita, CA: Aviation Book Company.

    Google Scholar 

  • Dreyfus, H. L.: 1996, Response to my critics. Artificial Intelligence, 80, 171-191.

    Google Scholar 

  • Dreyfus, H. L.: 1992, What computers still can't do: A critique of artificial reason. Cambridge, MA, MIT Press.

    Google Scholar 

  • Ericsson, K. A. and Kintsch, W.: 1995, Long-term working memory. Psychological Review, 102, 211-245.

    Google Scholar 

  • Federal Aviation Administration: 1980, Instrument flying handbook. U.S. Department of transportation.

  • Fox, J., Merwin, D., Marsh, R., Sohn, Y., Doane, S., Kramer, A., Lintern, G. and Wickens, C.: 1995, Modeling pilot skill acquisition. Paper presented at the Biennial Aviation Psychology Conference. Columbus, OH.

  • Gernsbacher, M. A.: 1990, Language comprehension as structure building. Erlbaum, Hillsdale, NJ.

    Google Scholar 

  • Hoecker, D. G., Corker, K. M., Roth, E. M., Lipner, M. H. and Bunzo, M. S.: 1994, Man-machine design and analysis system (MIDAS) applied to a computer-based procedure-aiding system. Proceedings of the 38th Annual Meeting of the Human Factors and Ergonomics Society, Part 1, Human Factors and Ergonomics Society, Nashville, TN, pp. 195-199.

    Google Scholar 

  • Holyoak, K. J.: 1991, Symbolic connectionism: toward third-generation theories of expertise. In: K. A. Ericsson and J. Smith (eds.), Toward a general theory of expertise, Cambridge University Press, pp. 301-336.

  • Holyoak, K. J. and Thagard, P.: 1989, Analogical mapping by constraint satisfaction. Cognitive Science, 13, 295-355.

    Google Scholar 

  • Just, M. A. and Carpenter, P. A.: 1992, A capacity theory of comprehension. Psychological Review, 99, 122-149.

    Google Scholar 

  • Kintsch, W.: 1998, Comprehension: A Paradigm for Cognition, Cambridge University Press, Cambridge, MA.

    Google Scholar 

  • Kintsch, W.: 1988, The use of knowledge in discourse processing: A construction-integration model. Psychological Review, 95, 163-182.

    Google Scholar 

  • Kintsch, W.: 1994, The psychology of discourse processing. In: M. A. Gernsbacher (ed.), Handbook of Psycholinguistics, Academic Press, San Diego, pp. 721-739.

    Google Scholar 

  • Kitajima, M. and Polson, P. G.: 1995, A comprehension-based model of correct performance and errors in skilled, display-based, human-computer interaction. International Journal of Human-Computer Studies, 43, 65-99.

    Google Scholar 

  • Lovett, M. C. and Anderson, J. R.: 1996, History of success and current context in problem solving. Cognitive Psychology, 31, 168-217.

    Google Scholar 

  • Mannes, S. M. and Doane, S. M.: 1991, A hybrid model of script generation: Or getting the best of both worlds. Connection Science, 3(1), 61-87.

    Google Scholar 

  • Mannes, S. M. and Kintsch, W.: 1991, Routine computing tasks; Planning as understanding. Cognitive Science, 15(3), 305-342.

    Google Scholar 

  • Meyer, D. E. and Kieras, D. E.: 1997, A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic Mechanisms. Psychological Review, 104, 3-65.

    Google Scholar 

  • Miller, J. R. and Kintsch, W.: 1980, Readability and recall of short prose passages: A theoretical analysis. Journal of Experimental Psychology: Human Learning and Memory, 6, 335-354.

    Google Scholar 

  • Newell, A.: 1987, Unified theories of cognition (The 1987 William James Lectures). Harvard University Press, Cambridge, MA.

    Google Scholar 

  • Recker, M. M. and Pirolli, P.: 1995, Modeling individual di¡erences in students' learning strategies. The Journal of the Learning Sciences, 4, 1-38.

    Google Scholar 

  • Rosenbloom, P. S., Laird, J. E. and Newell, A.: 1991, Toward the knowledge level in SOAR: The role of architecture in the use of knowledge. In: K. VanLehn (ed.), Architectures For Intelligence. Erlbaum, Hillsdale, NJ, pp. 75-112.

    Google Scholar 

  • Rosenbloom, P. S., Laird, J. E., Newell, A. and McCarl, R.: 1991, A preliminary analysis of the SOAR architecture as a basis for general intelligence. Artificial Intelligence, 47, 289-325.

    Google Scholar 

  • Rouse, W. B., Geddes, N. D. and Curry, R. E.: 1988, An architecture for intelligent interfaces: Outline of an approach to supporting operators of complex systems. Human-Computer Interaction, 3, 87-122.

    Google Scholar 

  • Schank, R. C. and Abelson, R. P.: 1977, Scripts, Plans, Goals and Understanding. Erlbaum, Hillsdale, NJ.

    Google Scholar 

  • Schmalhofer, F. and Tschaitschian, B.: 1993, The acquisition of a procedure schema from text and experiences. Proceedings of the 15th Annual Conference of the Cognitive Science Society. (pp. 883-888). Erlbaum, Hillsdale, NJ, pp. 883-888.

    Google Scholar 

  • Selfridge, O. G.: 1998, Pandemonium: A paradigm for learning. In: J. A. Anderson and E. Rosenfeld (eds.), Neurocomputing: Foundations of Research. MIT Press, Cambridge, MA, pp. 117-122

    Google Scholar 

  • Sohn, Y. W. and Doane, S. M.: 1997, Cognitive constraints on computer problem solving skills. Journal of Experimental Psychology: Applied, 3, 288-312.

    Google Scholar 

  • Thagard, P.: 1989, Explanatory coherence. Brain and Behavioral Sciences, 12, 435-467.

    Google Scholar 

  • Turner, A. A. and Greene, E.: 1978, Construction and use of a propositional text base. Catalog of Selected Documents in Psychology, 8 MS, 1713-1758.

    Google Scholar 

  • van Dijk, T. A. and Kintsch, W.: 1983, Strategies of discourse comprehension. Academic Press, New York.

    Google Scholar 

  • VanLehn, K.: 1988, Student modeling. In: M. C. Polson and J. J. Richardson (eds.), Foundations of intelligent tutoring systems. Erlbaum, Hillsdale, NJ, pp. 55-76.

    Google Scholar 

  • VanLehn, K., (ed.): 1991, Architectures For Intelligence. Erlbaum, Hillsdale, NJ, 1991, pp. 75-112.

    Google Scholar 

  • Wilensky, R.: Why John married Mary: Understanding stories involving recurring goals. Cognitive Science, 2, 235-266.

  • Zachary, W.: 1996, Interface agents in complex systems. In: C. A. Ntuen and E. H. Park (eds.), Human Interaction with Complex Systems: Conceptual Principles and Design Practice. Kluwer, Norwell, MA, pp. 397-401.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, Mississippi State University, Mississippi State, P.O. Box 6161, MS, 39762, USA

    Stephanie M. Doane

  2. Department of Psychology, University of Connecticut, 406 Babbidge Road, U-20, Storrs, CT, USA

    Young Woo Sohn

Authors
  1. Stephanie M. Doane
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Young Woo Sohn
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Doane, S.M., Sohn, Y.W. ADAPT: A Predictive Cognitive Model of User Visual Attention and Action Planning. User Modeling and User-Adapted Interaction 10, 1–45 (2000). https://doi.org/10.1023/A:1008311003128

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008311003128

Search

Navigation