Abstract
The purpose of this article is to describe how research at the intersection of cognition, technology, and work can be generalized beyond the source context of scientific inquiry and confirmation. Special emphasis is given to resolve confusion about the use of terms such as “ecological validity” and the “real world.” The ultimate goal is to foster a more productive dialog on the merits of where and how research on important cognitive engineering topics, such as cognitive adaptation to change and uncertainty, should be conducted.
Similar content being viewed by others
Notes
The situation in agricultural research can of course be more sophisticated than I have portrayed, in that researchers may sample environments (e.g., soil properties) to disentangle main (e.g., fertilizer) and interaction (fertilizer X soil) effects, to identify those environments in which a particular fertilizer will be useful. However, it remains the case the manner in which research findings are ultimately applied is physical rather than statistical-inferential, just as in much medical research where physical generalization is typical (by patients’ use of pharmaceuticals).
References
Brunswik E (1952) The conceptual framework of psychology. University of Chicago Press, Chicago
Brunswik E (1955) Representative design and probabilistic theory in a functional psychology. Psychol Rev 62:193–217
Brunswik E (1956) Perception and the representative design of psychological experiments. University of California Press, Berkeley
Degani A, Shafto M, Kirlik A (2006) What makes vicarious functioning work? Exploring the geometry of human-technology interaction. In: Kirlik A (ed) Adaptive perspectives on human-technology interaction: methods and models for cognitive engineering and human-computer interaction. Oxford University Press, New York, pp 179–198
Dewey J (1896) The reflex arc concept in psychology. Psychol Rev 3:357–370
Dhami M, Hertwig R, Hoffrage U (2004) The role of representative design in an ecological approach to cognition. Psychol Bull 130:959–988
Flach J (1995) The ecology of human machine systems: a personal history. In: Flach J, Hancock P, Caird J, Vicente K (eds) Global perspectives on the ecology of human-machine systems. Lawrence Erlbaum Associates, Mahwah, pp 1–13
Flach J, Mulder M, van Paassen MM (2004) The concept of the situation in psychology. In: Banbury S, Tremblay S (eds) A cognitive approach to situation awareness: theory, measurement, and application. Ashgate, Aldershot, pp 42–60
Funder DC (2009) Naïve and obvious questions. Perspect Psychol Sci 4(4):340–344
Gibson JJ (1950) The perception of the visual world. Houghton Mifflin, Boston
Gibson JJ (1966) The senses considered as perceptual systems. Houghton Mifflin, Boston
Gibson JJ (1986) The ecological approach to visual perception. Lawrence Erlbaum Associates, Hillsdale Originally work published in 1979
Goldstein W (2006) Introduction to Brunswikian theory and method. In: Kirlik (2006)
Hajdukiewicz JR, Vicente KJ (2004) A theoretical note on the relationship between work domain analysis and task analysis. Theor Issues Ergon Sci 5:527–538
Hammond KR, Stewart TR (2001) The essential Brunswik. Oxford University Press, New York
Heft H (2001) Ecological psychology in context: James Gibson, Roger Barker, and the legacy of William James’ radical empiricism. Lawrence Erlbaum Associates, Mahwah
Hoc J-M (2001) Towards ecological validity of research in cognitive ergonomics. Theor Issues Ergon Sci 2(3):278–288
Hochberg JE, Krantz D (2004) Brunswik and Bayes. Contemp Psychol 49:785–787
Hollnagel E, Woods DD (1983/1999). Cognitive systems engineering: new wine in new bottles. Int J Hum Comput Stud 51:339–356
Hutchins E (1995) Cognition in the wild. MIT Press, Cambridge
Kahneman D, Klein G (2006) Conditions for intuitive expertise. Am Psychol 64(6):515–526
Kirlik A (1995) Requirements for psychological models to support design: toward ecological task analysis. In: Flach J, Hancock P, Caird J, Vicente K (eds) Global perspectives on the ecology of human-machine systems. Lawrence Erlbaum Associates, Mahwah, pp 68–120
Kirlik A (2000). Conducting generalizable research in the age of the field study. In: Proceedings of the human factors and ergonomics society 44th annual meeting. Santa Monica, CA
Kirlik A (2006) Adaptive perspectives on human-technology interaction: methods and models for cognitive engineering and human-computer interaction. Oxford University Press, New York
Kirlik A (2009) Brunswikian resources for event perception research. Perception 38:376–398
Klatzky RL (2009) Giving psychological science away: the role of applications courses. Perspect Psychol Sci 4(5):522–530
Klein G (1993) A recognition primed decision (RPD) model of rapid decision making. In: Klein GA, Orasanu J, Calderwood R, Zsambok CE (eds) Decision making in action: models and methods. Ablex, Norwood
Klein G (1997) Sources of power. MIT Press, Cambridge
Klein G, Ross KG, Moon BM, Klein DE, Hoffman RR, Hollnagel E (May/June 2003). Macrocognition. IEEE Int Syst 18(3):81–85
Norman DA (1988) The psychology of everyday things. Basic Books, New York
Perrow C (1984) Normal accidents: living with high-risk technologies. Basic Books, New York
Rogers WA (2008) Editorial. J Exp Psychol Appl 14(1):1–4
Rozin P (2009) What kind of empirical research should we publish, fund, and reward? A different perspective. Perspect Psychol Sci 4(4):435–439
Shadish WR, Cook TD, Campbell DT (2002) Experimental and quasi-experimental designs for generalized causal inference. Wadsworth, NY
Simon HA (1957) Models of man. Wiley, NY
Suchman LA (1987) Plans and situated actions. Cambridge University Press, New York
Toulmin S (2001) Return to reason. Harvard University Press, Cambridge
Vicente KJ, Rassmussen J (1990) The ecology of human-machine systems II: mediating “direct perception” in complex work domains. Ecol Psychol 2(3):207–249
Wolf B (1999). Vicarious functioning as a central process-characteristic of human behavior. Retrieved Aug 2009 from: http://www.brunswik.org/notes/index.html
Acknowledgments
I am grateful to John Flach for his comments on a previous version of this article.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kirlik, A. Relevance versus generalization in cognitive engineering. Cogn Tech Work 14, 213–220 (2012). https://doi.org/10.1007/s10111-011-0204-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10111-011-0204-5