Skip to main content
SpringerLink
Log in

Measuring Situation Awareness in Control Room Teams

  • Conference paper
  • First Online:
Book cover Engineering Psychology and Cognitive Ergonomics. Cognition and Design (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 12187))

Included in the following conference series:

  • 1848 Accesses

Abstract

The importance of monitoring activities in control rooms continues to increase. Teams of operators are required to monitor a system for any abnormal system behavior, and must be able to exert manual control over the system in case of automation failure. Being ready to act requires operators to be aware of the system status at all times. However, developing and maintaining high situation awareness in a highly complex and dynamic environment can be challenging. Hence, the absence of situation awareness has often been attributed as the cause of human error in the past. A better understanding of situation awareness using different methods for quantification are required in order to reduce error and enhance the training of control room teams. The following study concentrates on evaluating situation awareness in a simulated control center task. Twenty-one three-person teams (Nā€‰=ā€‰63 participants) were tested. Performance, gaze, and communication data were integrated as individual measures of situation awareness. A relationship between the three measures was identified. Post-hoc analyses revealed differences between high and low performers with regards to their situation awareness. The development of situation awareness over time was also taken into consideration. Results reveal that when investigating situation awareness in control room teams, the use of multiple measures is a promising approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Suchman, L.: Centers of coordination: a case and some themes. In: Resnick, L.B., SƤljƶ, R., Pontecorvo, C., Burge, B. (eds.) Discourse, Tools and Reasoning: Essays on Situated Cognition, pp. 41ā€“62. Springer, Heidelberg (1997). https://doi.org/10.1007/978-3-662-03362-3_3

    Google ScholarĀ 

  2. EiƟfeldt, H., et al.: Aviator 2030 ā€“ Ability requirements in future ATM systems II: Simulations and Experiments (28). DLR, Kƶln (2009)

    Google ScholarĀ 

  3. Vicente, K.J., Roth, E.M., Mumaw, R.J.: How do operators monitor a complex, dynamic work domain? the impact of control room technology. Int. J. Hum Comput Stud. 54(6), 831ā€“856 (2001)

    MATHĀ  Google ScholarĀ 

  4. Carvalho, P.V.R., Vidal, M.C.R., de Carvalho, E.F.: Nuclear power plant communications in normative and actual practice: a field study of control room operatorsā€™ communications. Hum. Factors Ergon. Manuf. 17(1), 43ā€“78 (2007)

    Google ScholarĀ 

  5. Sharma, C., Bhavsar, P., Srinivasan, B., Srinivasan, R.: Eye gaze movement studies of control room operators: a novel approach to improve process safety. Comput. Chem. Eng. 85, 43ā€“57 (2016)

    Google ScholarĀ 

  6. Endsley, M.R.: Design and evaluation for situation awareness enhancement. In: Proceedings of the Human Factors Society 32nd Annual Meeting, pp. 97ā€“101. Human Factors Society, Santa Monica (1988)

    Google ScholarĀ 

  7. Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors 37(1), 32ā€“64 (1995)

    Google ScholarĀ 

  8. Bell, H.H., Lyon, D.R.: Using observer ratings to access situation awareness. In: Endsley, M.R., Garland, D.J. (eds.) Situation Awareness Analaysis and Measurement, pp. 129ā€“146 (2000)

    Google ScholarĀ 

  9. Cak, S., Say, B., Misirlisoy, M.: Effects of working memory, attention, and expertise on pilotsā€™ situation awareness. Cogn. Technol. Work 22, 1ā€“10 (2019). https://doi.org/10.1007/s10111-019-00551-w

    Google ScholarĀ 

  10. Hauland, G.: Measuring individual and team situation awareness during planning tasks in training of en route air traffic control. Int. J. Aviat. Psychol. 18(3), 290ā€“304 (2008)

    Google ScholarĀ 

  11. Ma, R., Kaber, D.B.: Situation awareness and driving performance in a simulated navigation task. Ergonomics 50(8), 1351ā€“1364 (2007)

    Google ScholarĀ 

  12. Zhang, Y., et al.: Effects of integrated graphical displays on situation awareness in anaesthesiology. Cogn. Technol. Work 4(2), 82ā€“90 (2002)

    Google ScholarĀ 

  13. Gillespie, B.M., Gwinner, K., Fairweather, N., Chaboyer, W.: Building shared situational awareness in surgery through distributed dialog. J. Multidisc. Healthc. 6, 109ā€“118 (2013)

    Google ScholarĀ 

  14. Burns, C.M., et al.: Evaluation of ecological interface design for nuclear process control: situation awareness effects. Hum. Factors 50(4), 663ā€“679 (2008)

    Google ScholarĀ 

  15. Hogg, D.N., FOLLESāŠ˜, K., Strand-Volden, F., Torralba, B.: Development of a situation awareness measure to evaluate advanced alarm systems in nuclear power plant control rooms. Ergonomics 38(11), 2394ā€“2413 (1995)

    Google ScholarĀ 

  16. Lif, P., GranĆ„sen, M., Sommestad, T.: Development and validation of technique to measure cyber situation awareness. In: 2017 International Conference on Cyber Situational Awareness, Data Analytics And Assessment (Cyber SA), pp. 1ā€“8. IEEE (2017)

    Google ScholarĀ 

  17. Jones, D.G., Endsley, M.R.: Sources of situation awareness errors in aviation. Aviat. Space Eviron. Med. 67(6), 507ā€“512 (1996)

    Google ScholarĀ 

  18. Endsley, M.R., Garland, D.J.: Theoretical underpinnings of situation awareness: a critical review. Situat. Aware. Anal. Meas. 1, 24 (2000)

    Google ScholarĀ 

  19. Fang, Y., Cho, Y.K., Durso, F., Seo, J.: Assessment of operatorā€™s situation awareness for smart operation of mobile cranes. Autom. Constr. 85, 65ā€“75 (2018)

    Google ScholarĀ 

  20. Gutzwiller, R.S., Clegg, B.A.: The role of working memory in levels of situation awareness. J. Cogn. Eng. Decis. Making 7(2), 141ā€“154 (2013)

    Google ScholarĀ 

  21. Gardner, A.K., Kosemund, M., Martinez, J.: Examining the feasibility and predictive validity of the SAGAT tool to assess situation awareness among medical trainees. Simul. Healthc. 12(1), 17ā€“21 (2017)

    Google ScholarĀ 

  22. Hasse, C., Bruder, C.: Eye-tracking measurements and their link to a normative model of monitoring behaviour. Ergonomics 58(3), 355ā€“367 (2015)

    Google ScholarĀ 

  23. PeiƟl, S., Wickens, C.D., Baruah, R.: Eye-tracking measures in aviation: a selective literature review. Int. J. Aerosp. Psychol. 28(3ā€“4), 98ā€“112 (2018)

    Google ScholarĀ 

  24. Ball, L.J., Phillips, P., Wade, C.N., Quayle, J.D.: Effects of belief and logic on syllogistic reasoning: Eye-movement evidence for selective processing models. Exp. Psychol. 53, 77ā€“86 (2006)

    Google ScholarĀ 

  25. Tsai, M.J., Hou, H.T., Lai, M.L., Liu, W.Y., Yang, F.Y.: Visual attention for solving multiple-choice science problem: an eye-tracking analysis. Comput. Educ. 58(1), 375ā€“385 (2012)

    Google ScholarĀ 

  26. Merat, N., Jamson, A.H., Lai, F.C.H., Carsten, O.: Highly automated driving, secondary task performance, and driver state. Hum. Factors 54(5), 762ā€“771 (2012)

    Google ScholarĀ 

  27. Underwood, G., Chapman, P., Brocklehurst, N., Underwood, J., Crundall, D.: Visual attention while driving: sequences of eye fixations made by experienced and novice drivers. Ergonomics 46(6), 629ā€“646 (2003)

    Google ScholarĀ 

  28. Law, B., Atkins, M.S., Kirkpatrick, A.E., Lomax, A.J.: Eye gaze patterns differentiate novice and experts in a virtual laparoscopic surgery training environment. In: Proceedings of the 2004 symposium on Eye tracking research & applications, pp. 41ā€“48 (2004)

    Google ScholarĀ 

  29. Jarodzka, H., Scheiter, K., Gerjets, P., Van Gog, T.: In the eyes of the beholder: how experts and novices interpret dynamic stimuli. Learn. Instr. 20(2), 146ā€“154 (2010)

    Google ScholarĀ 

  30. Fink, L.K., Lange, E.B., Groner, R.: The application of eye-tracking in music research. J. Eye Mov. Res. 11(2) (2018)

    Google ScholarĀ 

  31. Charness, N., Reingold, E.M., Pomplun, M., Stampe, D.M.: The perceptual aspect of skilled performance in chess: evidence from eye movements. Mem. Cogn. 29(8), 1146ā€“1152 (2001)

    Google ScholarĀ 

  32. Bruder, C., Hasse, C.: Differences between experts and novices in the monitoring of automated systems. Int. J. Ind. Ergon. 72, 1ā€“11 (2019)

    Google ScholarĀ 

  33. Gegenfurtner, A., Lehtinen, E., SƤljƶ, R.: Expertise differences in the comprehension of visualizations: a meta-analysis of eye-tracking research in professional domains. Educ. Psychol. Rev. 23(4), 523ā€“552 (2011)

    Google ScholarĀ 

  34. Garbis, C., Artman, H.: Team Situation Awareness as Communicative Practices. A Cognitive Approach to Situation Awareness: Theory and Application. Ashgate, Aldershot (2004)

    Google ScholarĀ 

  35. Wright, M.C., Endsley, M.R.: Building shared situation awareness in healthcare settings. In: Improving healthcare team communication, pp. 97ā€“114. CRC Press, Boca Raton (2017)

    Google ScholarĀ 

  36. Leonard, M., Graham, S., Bonacum, D.: The human factor: the critical importance of effective teamwork and communication in providing safe care. BMJ Qual. Saf. 13(suppl 1), i85ā€“i90 (2004)

    Google ScholarĀ 

  37. Salas, E., Prince, C., Baker, D.P., Shrestha, L.: Situation awareness in team performance: implications for measurement and training. Hum. Factors 37(1), 123ā€“136 (1995)

    Google ScholarĀ 

  38. Gorman, J.C., Cooke, N.J., Winner, J.L.: Measuring team situation awareness in decentralized command and control environments. Ergonomics 49(12ā€“13), 1312ā€“1325 (2006)

    Google ScholarĀ 

  39. Cooke, N.J., Gorman, J.C., Myers, C.W., Duran, J.L.: Interactive team cognition. Cogn. Sci. 37, 255ā€“285 (2013)

    Google ScholarĀ 

  40. Schulze-Kissing, D., Bruder, C.: Der Einsatz synthetischer Aufgabenumgebungen zur Untersuchung kollaborativer Prozesse in Leitzentralen am Beispiel der ā€˜ā€˜Generic Control Center Task Environnmentā€™ā€™ (ConCenT). In: Proceedings of the Workshop Cognitive Systems, Bochum (2016)

    Google ScholarĀ 

  41. Bruder, C., EiƟfeldt, H., Maschke, P., Hasse, C.: A model for future aviation: operators monitoring appropriately. Aviat. Psychol. Appl. Hum. Factors 4(1), 13ā€“22 (2014)

    Google ScholarĀ 

  42. Jacob, R.J.K., Karn, K.S.: Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. In: HyƶnƤ, J., Radach, R., Deubel, H. (eds.) The Mindā€™s Eye: Cognitive and Applied Aspects of Eye Movement Research, pp. 573ā€“605 (2003)

    Google ScholarĀ 

  43. Pannasch, S.: Ereignisbezogene VerƤnderungen der visuellen Fixationsdauer (Unpublished doctoral dissertation). Technische UniversitƤt Dresden, Dresden (2003)

    Google ScholarĀ 

  44. Stout, R.J., Cannon-Bowers, J.A., Salas, E., Milanovich, D.M.: Planning, shared mental models, and coordinated performance: an empirical link is established. Hum. Factors 41(1), 61ā€“71 (1999)

    Google ScholarĀ 

  45. Chang, S., Waid, E., Martinec, D.V., Zheng, B., Swanstrom, L.L.: Verbal communication improves laparoscopic team performance. Surg. Innov. 15(2), 143ā€“147 (2008)

    Google ScholarĀ 

  46. Kallus, K.: Anticipatory processes in critical flight situations. In: Mechanisms in the Chain of Safety, pp. 113ā€“122. CRC Press, Boca Raton (2017)

    Google ScholarĀ 

  47. Poole, A., Ball, L.J.: Eye tracking in HCI and usability research: current status and future prospects. In: Ghaoui, C. (ed.) Encyclopedia of Human Computer Interaction, pp. 211ā€“219. Idea Group, Pennsylvania (2006)

    Google ScholarĀ 

  48. Cooke, N.J., Gorman, J.C., Duran, J.L., Taylor, A.R.: Team cognition in experienced command and-control teams. J. Exp. Psychol. Appl. 13, 146ā€“157 (2007)

    Google ScholarĀ 

Download references

Author information

Authors and Affiliations

  1. German Aerospace Center (DLR), Aviation and Space Psychology, Hamburg, Germany

    Carolina BarzantnyĀ &Ā Carmen Bruder

Authors
  1. Carolina Barzantny
    View author publications

    You can also search for this author in PubMedĀ Google Scholar

  2. Carmen Bruder
    View author publications

    You can also search for this author in PubMedĀ Google Scholar

Corresponding author

Correspondence to Carolina Barzantny .

Editor information

Editors and Affiliations

  1. Coventry University, Coventry, UK

    Don Harris

  2. Cranfield University, Cranfield, UK

    Wen-Chin Li

Rights and permissions

Reprints and permissions

Copyright information

Ā© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Barzantny, C., Bruder, C. (2020). Measuring Situation Awareness in Control Room Teams. In: Harris, D., Li, WC. (eds) Engineering Psychology and Cognitive Ergonomics. Cognition and Design. HCII 2020. Lecture Notes in Computer Science(), vol 12187. Springer, Cham. https://doi.org/10.1007/978-3-030-49183-3_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49183-3_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49182-6

  • Online ISBN: 978-3-030-49183-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation