Skip to main content
SpringerLink
Log in

From “Knowing What” to “Knowing When”: Exploring a Concept of Situation Awareness Synchrony for Evaluating SA Dynamics in Teams

  • Conference paper
  • First Online:
Adaptive Instructional Systems (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12214))

Included in the following conference series:

  • 1127 Accesses

Abstract

This concept paper presents an initial exploration of measuring Situation Awareness (SA) dynamics in team settings. SA dynamics refer to the evaluation of SA’s temporal evolution of one or more teammates. We discuss why current methods are inherently limited by the subjective nature of SA and why it is important to identify measures for the temporal evolution of SA. Most current approaches focus on measuring the accuracy of SA (i.e., What? is known)and the similarity in the context of shared SA, often resulting in rather qualitative assessments. However, quantitative assessments are important to address temporal aspects (i.e., When? and ultimately For how long?). Thus, we propose, as a complementary approach to accuracy and similarity of SA, to consider the concept of SA synchrony as a quantitative metric of SA dynamics in teams. Specifically, we highlight the existence of three latencies with high relevance to shared SA dynamics and discuss options for their assessment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Endsley, M.R.: Situation awareness in aviation systems. In: Handbook of aviation human factors, pp. 257–276. Lawrence Erlbaum Associates Publishers, Mahwah (1999)

    Google Scholar 

  2. Foushee, H.C., Helmreich, R.L.: Group interaction and flight crew performance. In: Wiener, E.L., Nagel, D.C. (eds.) Human Factors in Aviation. Cognition and Perception, pp. 189–227. Academic Press, San Diego (1988)

    Google Scholar 

  3. Salas, E., Cannon-Bowers, J.A., Johnston, J.H.: How can you turn a team of experts into an expert team?: Emerging training strategies. In: Naturalistic Decision Making, pp. 359–370 (1997)

    Google Scholar 

  4. Endsley, M.R., Bolstad, C.A., Jones, D.G., Riley, J.M.: Situation awareness oriented design: from user’s cognitive requirements to creating effective supporting technologies. Proc. Hum. Factors Ergon. Soc. Ann. Meet. 47(3), 268–272 (2003)

    Article  Google Scholar 

  5. Chen, Y., Qian, Z., Lei, W.: Designing a situational awareness information display: adopting an affordance-based framework to amplify user experience in environmental interaction design. Informatics 3(2), 6 (2016)

    Article  Google Scholar 

  6. M. R. Endsley, Designing for Situation Awareness. 2016

    Google Scholar 

  7. Scerbo, M.W.: Theoretical perspectives on adaptive automation. In: Automation and Human Performance: Theory and Applications, pp. 37–63. Lawrence Erlbaum Associates, Inc., Hillsdale (1996)

    Google Scholar 

  8. de Winter, J.C.F., Eisma, Y.B., Cabrall, C.D.D., Hancock, P.A., Stanton, N.A.: Situation awareness based on eye movements in relation to the task environment. Cogn. Technol. Work 21(1), 99–111 (2019)

    Article  Google Scholar 

  9. Nofi, A.: Defining and measuring shared situational awareness. PLoS ONE 5, 76 (2000)

    Google Scholar 

  10. Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors J. Hum. Factors Ergon. Soc. 37(1), 32–64 (1995)

    Article  Google Scholar 

  11. Sulistyawati, K., Wickens, C.D., Chui, Y.P.: Exploring the concept of team situation awareness in a simulated air combat environment. J. Cogn. Eng. Decis. Making 3(4), 309–330 (2009)

    Article  Google Scholar 

  12. Gorman, J.C., Cooke, N.J., Winner, J.L.: Measuring team situation awareness in decentralized command and control environments. Ergonomics 49(12–13), 1312–1325 (2006)

    Article  Google Scholar 

  13. Salmon, P.M., Stanton, N.A., Walker, G.H., Jenkins, D.P.: What really is going on? Review of situation awareness models for individuals and teams. Theory Issues Ergon. Sci. 9(4), 297–323 (2008)

    Article  Google Scholar 

  14. Stanton, N.A., Salmon, P.M., Walker, G.H., Salas, E., Hancock, P.A.: State-of-science: situation awareness in individuals, teams and systems. Ergonomics 60(4), 449–466 (2017)

    Article  Google Scholar 

  15. Meireles, L., Alves, L., Cruz, J.: Conceptualization and measurement of individual situation awareness (SA) in expert populations across operational domains: a systematic review of the literature with a practical purpose on our minds. Proc. Hum. Factors Ergon. Soc. 2, 1093–1097 (2018)

    Google Scholar 

  16. Taylor, R.M.: Situational awareness rating technique (SART): the development of a tool for aircrew systems design. In: Situational Aware. Aerosp. Oper., no. AGARD-CP-478, pp. 3/1–3/17 (1990)

    Google Scholar 

  17. Waag, W.L., Houck, M.R.: Tools for assessing situational awareness in an operational fighter environment. Aviat. Sp. Environ. Med. 65(5 Suppl), A13–A19 (1994)

    Google Scholar 

  18. Vidulich, M.A., Hughes, E.R.: Testing a subjective metric of situation awareness. Proc. Hum. Factors Soc. 2, 1307–1311 (1991)

    Google Scholar 

  19. Matthews, M.D., Beal, S.A.: Assessing situation awareness in field training exercises. ARI DTIC Report No. 1795 (2002)

    Google Scholar 

  20. Salmon, P., Stanton, N., Walker, G., Green, D.: Situation awareness measurement: a review of applicability for C4i environments. Appl. Ergon. 37(2), 225–238 (2006)

    Google Scholar 

  21. Endsley, M.R., Selcon, S.J., Hardiman, T.D., Croft, D.G.: Comparative analysis of SAGAT and SART for evaluations of situation awareness. Proc. Hum. Factors Ergon. Soc. Ann. Meet. 42(1), 82–86 (1998)

    Google Scholar 

  22. Endsley, M.R.: Situation awareness global assessment technique (SAGAT). In: Proceedings of the IEEE 1988 national aerospace and electronics conference (NAECON 1988), pp. 789–795 (1988)

    Google Scholar 

  23. Hauss, Y., Gauss, B., Eyferth, K.: SALSA-a new approach to measure situational awareness in air traffic control. Focusing attention on aviation safety. In: 11th International Symposium on Aviation Psychology, Columbus, pp. 1–20 (2001)

    Google Scholar 

  24. Hogg, D.N., Follesø, K., Volden, F.S., Torralba, B.: SACRI: A measure of situation awareness for use in the evaluation of nuclear power plant control room systems providing information about the current process state (1994)

    Google Scholar 

  25. Durso, F.T., Hackworth, C.A., Truitt, T.R.: Situation awareness as a predictor of performance in en route air traffic controllers. Air Traffic Control Q. 6(1), 1–20 (1999)

    Article  Google Scholar 

  26. Veltman, J.A., Gaillard, A.W.K.: Physiological workload reactions to increasing levels of task difficulty. Ergonomics 41(5), 656–669 (1998)

    Article  Google Scholar 

  27. Kramer, A.F.: Physiological metrics of mental workload: a review of recent progress. In: Multiple-task performance, pp. 279–328 (1991)

    Google Scholar 

  28. Roscoe, A.H.: Heart rate as a psychophysiological measure for in-flight workload assessment. Ergonomics 36(9), 1055–1062 (1993)

    Article  Google Scholar 

  29. Nofi, A.: Defining and measuring shared situational awareness. 5 (2000)

    Google Scholar 

  30. Stanton, N.A., Salmon, P.M., Walker, G.H., Salas, E., Hancock, P.A.: State-of-Science: situation awareness in individuals, teams and systems. Ergonomics 60(4), 1–33 (2017)

    Article  Google Scholar 

  31. Cooke, N.J., Stout, R.J., Salas, E.: A knowledge elicitation approach to the measurement of the team situation awareness (2001)

    Google Scholar 

  32. Endsley, M.R., Garland, D.J.: Situation awareness analysis and measurement. CRC Press, Boca Raton (2000)

    Book  Google Scholar 

  33. Höglund, F., Berggren, P., Nählinder, S.: Using shared priorities to measure shared situation awareness. In: Proceedings of the 7th International ISCRAM Conference–Seattle, vol. 1 (2010)

    Google Scholar 

  34. Saner, L.D., Bolstad, C.A., Gonzalez, C., Cuevas, H.M.: Measuring and predicting shared situation awareness in teams. J. Cogn. Eng. Decis. Making 3(3), 280–308 (2009)

    Article  Google Scholar 

  35. Bolstad, C.A., Foltz, P., Franzke, M., Cuevas, H.M., Rosenstein, M., Costello, A.M.: Predicting situation awareness from team communications pearson knowledge technologies. Proc. Hum. Factors Ergon. Soc. Ann. Meet. 51, 789–793 (2007)

    Google Scholar 

  36. Prytz, E., Rybing, J., Jonson, C.-O., Petterson, A., Berggren, P., Johansson, B.: An exploratory study of a low-level shared awareness measure using mission-critical locations during an emergency exercise. Proc. Hum. Factors Ergon. Soc. Ann. Meet. 59(1), 1152–1156 (2015)

    Article  Google Scholar 

  37. Salas, E., Cooke, N.J., Rosen, M.A.: On teams, teamwork, and team performance discoveries and developments. Hum. Factors 50(3), 540–547 (2008)

    Article  Google Scholar 

  38. Hjelmfelt, A.T., Pokrant, M.A.: Coherent tactical picture. CNA RM 97(129), 1998 (1998)

    Google Scholar 

  39. Adams, M.J., Tenney, Y.J., Pew, R.W.: Situation awareness and the cognitive management of complex systems. Hum. Factors 37(1), 85–104 (1995)

    Article  Google Scholar 

  40. Ziemke, T., Schaefer, K.E., Endsley, M.: Situation awareness in human-machine interactive systems. Cogn. Syst. Res. 46, 1–2 (2017)

    Article  Google Scholar 

  41. Cain, A.A., Schuster, D.: A quantitative measure for shared and complementary situation awareness. Hfes 60(1), 1823–1827 (2016)

    Google Scholar 

  42. Ososky, S. et al.: The importance of shared mental models and shared situation awareness for transforming robots from tools to teammates. In: Proceedings of the SPIE, vol. 8387, p. 838710 (2012)

    Google Scholar 

  43. Endsley, M., Jones, W.M.: A model of inter and intra team situation awareness: implications for design, training and measurement. In: McNeese, M., Salas, E., Endsley, M. (eds.) New Trends in Cooperative Activities: Understanding System Dynamics in Complex Environments, pp. 46–67. New trends Coop. Act. Underst. Syst. dyanmics complex Environ. Hum. FActors Ergon. Soc., Santa Monica, CA (2001)

    Google Scholar 

  44. Perla, P.P., Markowitz, M., Nofi, A.A., Weuve, C., Loughran, J.: Gaming and shared situation awareness. Center for Naval Analyses Alexandria VA (2000)

    Google Scholar 

  45. Cooke, N.J., Stout, R., Salas, E.: Broadening the measurement of situation awareness through cognitive engineering methods. Hum. Factors Ergon. Soc. 41(4), 215–219 (1997)

    Google Scholar 

  46. Delaherche, E., Chetouani, M., Mahdhaoui, A., Saint-Georges, C., Viaux, S., Cohen, D.: Interpersonal synchrony: a survey of evaluation methods across disciplines. IEEE Trans. Affect. Comput. 3(3), 349–365 (2012)

    Article  Google Scholar 

  47. Schwarz, J., Fuchs, S.: Multidimensional real-time assessment of user state and performance to trigger dynamic system adaptation. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) AC 2017. LNCS (LNAI), vol. 10284, pp. 383–398. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-58628-1_30

    Chapter  Google Scholar 

  48. Jorna, P.: Heart rate and workload variations in actual and simulated flight. Ergonomics 36(9), 1043–1054 (1993)

    Article  Google Scholar 

  49. Tomarken, A.J.: A psychometric perspective on psychophysiological measures. Psychol. Assess. 7(3), 387 (1995)

    Article  Google Scholar 

  50. Kilingaru, K., Tweedale, J.W., Thatcher, S., Jain, L.C.: Monitoring pilot ‘situation awareness’. J. Intell. Fuzzy Syst. 24(3), 457–466 (2013)

    Article  Google Scholar 

  51. Moore, K., Gugerty, L.: Development of a novel measure of situation awareness: the case for eye movement analysis. Proc. Hum. Factors Ergon. Soc. Ann. Meet. 54(19), 1650–1654 (2010)

    Google Scholar 

  52. van de Merwe, K., van Dijk, H., Zon, R.: Eye movements as an indicator of situation awareness in a flight simulator experiment. Int. J. Aviat. Psychol. 22(1), 78–95 (2012)

    Article  Google Scholar 

  53. Hauland, G.: Measuring team situation awareness by means of eye movement data. In: Proceedings of HCI International 2003, vol. 3, pp. 230–234 (2019)

    Google Scholar 

  54. Calcagnì, A., Lombardi, L., Sulpizio, S.: Analyzing spatial data from mouse tracker methodology: an entropic approach. Behav. Res. Methods 49(6), 2012–2030 (2017)

    Article  Google Scholar 

  55. Frisch, S., Dshemuchadse, M., Görner, M., Goschke, T., Scherbaum, S.: Unraveling the sub-processes of selective attention: insights from dynamic modeling and continuous behavior. Cogn. Process. 16(4), 377–388 (2015)

    Article  Google Scholar 

  56. Kieslich, P., Henninger, F., Wulff, D., haslbeck, J., Schulte-Mecklenbeck, M.: Mouse-tracking: a practical guide to implementation and analysis (2018)

    Google Scholar 

  57. Freeman, J.B., Ambady, N.: MouseTracker: software for studying real-time mental processing using a computer mouse-tracking method. Behav. Res. Methods 42(1), 226–241 (2010)

    Article  Google Scholar 

  58. Salas, E., Prince, C., Baker, D.P., Shrestha, L.: Situation awareness in team performance: implications for measurement and training. Hum. Factors 37(1), 123–136 (1995)

    Article  Google Scholar 

  59. Sonnenwald, D.H., Maglaughlin, K.L., Whitton, M.C.: Designing to support situation awareness across distances: an example from a scientific collaboratory. Inf. Process. Manag. 40(6), 989–1011 (2004)

    Article  MATH  Google Scholar 

  60. Salmon, P.M., Stanton, N.A., Walker, G.H., Jenkins, D.P., Rafferty, L.: Is it really better to share? Distributed situation awareness and its implications for collaborative system design. Theory Issues Ergon. Sci. 11(1–2), 58–83 (2010)

    Article  Google Scholar 

  61. Salas, E., Reyes, D.L., Woods, A.L.: The assessment of team performance: observations and needs. In: von Davier, A.A., Zhu, M., Kyllonen, P.C. (eds.) Innovative Assessment of Collaboration. MEMA, pp. 21–36. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-33261-1_2

    Chapter  Google Scholar 

  62. Hooey, B.L., et al.: Modeling pilot situation awareness. In: Cacciabue, P., Hjälmdahl, M., Luedtke, A., Riccioli, C. (eds.) Human modelling in assisted transportation, pp. 207–213. Springer, Milano (2011). https://doi.org/10.1007/978-88-470-1821-1_22

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. IMS - Cognitique, UMR 5218, ENSC-Bordeaux INP, Université de Bordeaux, Talence, France

    Baptiste Prébot & Bernard Claverie

  2. Human-System Engineering, Fraunhofer Institute for Communication, Information Processing and Ergonomics, Wachtberg, Germany

    Jessica Schwarz & Sven Fuchs

Authors
  1. Baptiste Prébot
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jessica Schwarz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sven Fuchs
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bernard Claverie
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Baptiste Prébot .

Editor information

Editors and Affiliations

  1. Soar Technology, Inc., Orlando, FL, USA

    Robert A. Sottilare

  2. Fraunhofer FKIE, Wachtberg, Germany

    Jessica Schwarz

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Prébot, B., Schwarz, J., Fuchs, S., Claverie, B. (2020). From “Knowing What” to “Knowing When”: Exploring a Concept of Situation Awareness Synchrony for Evaluating SA Dynamics in Teams. In: Sottilare, R.A., Schwarz, J. (eds) Adaptive Instructional Systems. HCII 2020. Lecture Notes in Computer Science(), vol 12214. Springer, Cham. https://doi.org/10.1007/978-3-030-50788-6_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-50788-6_37

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-50787-9

  • Online ISBN: 978-3-030-50788-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation