Abstract
Verbalisation (or talk-aloud protocols) has been used as a technique for knowledge elicitation in research for some time. It allows the researcher some degree of access to the reasoning behind participants’ decisions. The verbalisation technique is said to directly represent cognitive task processes while not affecting performance. Using a combined methodology of concurrent and retrospective verbalisation to study the effects of verbalisation on pilots’ task performance in simulator conditions, the findings of this case study suggest that, on the contrary, instructing operators to verbalise their thought processes while performing complex tasks may interfere with task-related cognition under some conditions, thereby compromising safety.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abbott T (1993) Functional categories for future flight deck designs (NASA Technical Memorandum TM-109005). NASA Langley Research Center, Hampton
Blackman HS, Nelson WR (1987) Techniques for incorporating operator expertise into intelligent aids and training. Reliab Eng Syst Saf 22:371–385
De Waard D (1996) The measurement of drivers’ mental workload. Groningen University, Traffic Research Center, Groningen
Dekker SW (2002) Reconstructing human contributions to accidents: the new view on error and performance. J Saf Res 33(3):371–385
Dix A, Finlay J, Abowd G, Beale R (1993) Human–computer interaction. Prentice Hall, Englewood Cliffs
Duncan J, Williams P, Brown I (1991) Components of driving skill: experience does not mean expertise. Ergonomics 34:919–937
Earl L, Bates P, Murray PS, Glendon AI, Creed PA (2012) Testing the benefits of a single pilot line operations safety audit: an aviation pilot study. Aviat Psychol Appl Hum Factors 2(2):49–61
Ellis R (ed) (2005) Planning and task performance in a second language. John Benjamins, Philadelphia
Ericsson KA, Simon HA (1978) Retrospective verbal reports as data. Carnegie-Mellon University, Department of Psychology, Pittsburgh
Ericsson KA, Simon HA (1980) Verbal reports as data. Psychol Rev 87:215–251
Ericsson KA, Simon HA (1993) Protocol analysis: verbal reports as data, revised edn. Bradford Books/MIT Press, Cambridge
Erlandsson M, Jansson A (2013) Verbal reports and domain-specific knowledge: a comparison between collegial and retrospective verbalisation. Cogn Technol Work 15(3):239–254
Fox MC, Ericsson KA, Best R (2011) Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods. Psychol Bull 137(2):316–344
Gee JP (2014) An introduction to discourse analysis: theory and method. Routledge, New York
Glaser B, Strauss A (1967) The discovery grounded theory: strategies for qualitative inquiry. Aldin, Chicago
Kantowitz BH (1988) Defining and measuring pilot mental workload. In: NASA. Langley Research Center, Mental-State Estimation, 1987, p 179–188 (SEE N88-23370 16-53)
Lave J (1988) Cognition in practice: mind, mathematics and culture in everyday life. Cambridge University Press, Cambridge, UK
Leont’ev AN (1978) Activity, consciousness and personality. Prentice Hall, Englewood Cliffs
Luria AR (1981) Language and cognition. Wiley, New York
McIlroy RC, Stanton NA, Remington B (2012) Developing expertise in military communications planning: do verbal reports change with experience? Behav Inf Technol 31(6):617–629
Monsell S (2003) Task switching. Trends Cogn Sci 7(3):134–140
Mosier KL, Skitka LJ, Heers S, Burdick M (1998) Automation bias: decision making and performance in high-tech cockpits. Int J Aviat Psychol 8(1):47–63
Nielsen J, Christiansen N (2000) Mindtape: a tool for reflection in participatory design. In participatory design. In: Cherkasky T, Greenbaum J, Mambrey P, Pors JK (eds) Proceedings of participatory design conference: designing digital environments, November 28–December 1, 2000, New York. Computer Professionals for Social Responsibility, Stanford, CA, pp 309–313
Nielsen J, Clemmensen T, Yssing C (2002) Getting access to what goes on in people’s heads? reflections on the think-aloud technique. In: Proceedings of the second Nordic conference on human–computer interaction, Aarhus, Denmark, October 19–23. ACM, New York, pp 101–110
Nisbett RE, Wilson TD (1977) Telling more than we can know: verbal reports on mental processes. Psychol Rev 84:231–259
Roth WM, Lee Y-J (2007) “Vygotsky’s neglected theory”: cultural-historical activity theory. Rev Educ Res 77(2):186–232
Scaife M, Rogers Y (1996) External cognition: how do graphical representations work? Int J Hum Comput Stud 45(2):185–213
Seale C, Silverman D (1997) Ensuring rigour in qualitative research. Eur J Pub Health 7(4):379–384
Smagorinsky P (1998) Thinking and speech and protocol analysis. Mind Cult Act 5(3):157–177
Taylor KL, Dionne JP (2000) Accessing problem solving strategy knowledge: the complimentary use of concurrent verbal protocols and retrospective debriefing. J Educ Psychol 92(3):413–425
Vygotsky LS (1978) Mind in society: the development of higher psychological processes. Harvard University Press, Cambridge, MA
Wartofsky MW (1979) Models: representation and the scientific understanding (Boston Studies in the philosophy and history of science, 129. Reidel, Dordrecht
Wertcsh JV (1985) Vygotsky and the social formation of mind. Harvard University Press, Cambridge
Wright RB, Converse SA (1992) Method bias and concurrent verbal protocol in software usability testing. In: Proceedings of human factors society 36th annual meeting, Atlanta, Georgia, pp 1220–1224
Acknowledgements
With acknowledgement to Wolff Michael Roth for his valued advice and review of the paper in its early stages.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Earl, L., Mavin, T.J. & Soo, K. Demands on cognitive processing: implications for verbalisation in complex work environments. Cogn Tech Work 19, 31–46 (2017). https://doi.org/10.1007/s10111-016-0395-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10111-016-0395-x