Skip to main content
Springer Nature Link
Log in

Creation and Use of Virtual Simulations for Measuring Situation Awareness of Incident Commanders

  • Conference paper
  • First Online:
Information Technology in Disaster Risk Reduction (ITDRR 2022)

Part of the book series: IFIP Advances in Information and Communication Technology ((IFIPAICT,volume 672))

  • 326 Accesses

Abstract

Training and measurement of situation awareness (SA) in a dynamic decision-making context is a complex task and depends on personal factors as well as time, space, and situation. Therefore, to measure first-level incident commanders’ SA several authentic and immersive virtual simulations of rescue incidents should be used. In this paper, we report on Effective Command and the dynamic decision-making assessment methodology as a theoretical framework for SA assessment and implementation of virtual reality software using sixteen different virtual simulations in an organization. First, we report four aspects needed to be implemented for virtual simulation-based assessment of SA. Next, we analysed the differences between three SA ascending levels: perception, comprehension, and prediction that might be influenced by the scenario storyline. According to prior research, we would expect the difficulty of the three SA levels to be in ascending order and we evaluated that by analysing N = 665 assessment results. We confirmed such an ascending order for most scenarios, and we also identified these scenarios for which this assumption was not met. Finally, we discuss the possibilities of analysing the scenario-based SA level differences in the future when assessing SA with more automated measures. We argue that by improving the assessment of SA, we can foster the training possibilities for incident commanders’ dynamic decision-making.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Polikarpus, S., Ley, T.: Collaborative authoring of virtual simulation scenarios for assessing situational awareness. In: Proceedings of the 18th ISCRAM Conference, pp. 229–237 (2021). http://idl.iscram.org/files/stellapolikarpus/2021/2328_StellaPolikarpus_etal2021.pdf

  2. Polikarpus, S., Bøhm, M., Ley, T.: Training incident commander’s situational awareness—a discussion of how simulation software facilitate learning. In: Väljataga, T., Laanpere, M. (Eds.) Digital Turn in Schools—Research, Policy, Practice. Lecture Notes in Educational Technology, pp. 219–234. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-7361-9_15

  3. Polikarpus, S., Ley, T., Poom-Valickis, K.: Developing the situational awareness of incident commanders: evaluating a training programme using a virtual simulation. In: Proceedings of the Estonian Academy of Sciences, vol. 19, pp. 195–226 (2020). https://digiriiul.sisekaitse.ee/bitstream/handle/123456789/2595/Proceedings_2020_WEB.PDF?sequence=5&isAllowed=y

  4. Lamb, K., Farrow, M., Olymbios, C., Launder, D., Greatbatch, I.: Systematic incident command training and organisational competence. Int. J. Emerg. Serv. 10(2), 222–234 (Jun.2021). https://doi.org/10.1108/IJES-05-2020-0029

    Article  Google Scholar 

  5. Launder, D., Perry, C.: A study identifying factors influencing decision making in dynamic emergencies like urban fire and rescue settings. Int. J. Emerg. Serv. 3(2), 144–161 (Oct.2014). https://doi.org/10.1108/IJES-06-2013-0016

    Article  Google Scholar 

  6. Jones, D.G.: A practical perspective on the utility of situation awareness. J. Cogn. Eng. Decis. Mak. 9(1), 98–100 (Mar.2015). https://doi.org/10.1177/1555343414554804

    Article  Google Scholar 

  7. Jenkins, D.P.D., Walker, G.H.D., Stanton, N.A.P.: What really is going on? situation awareness literature review. In: Distributed Situation Awareness: Theory, Measurement and Application to Teamwork, no. 2009, Ashgate Publishing Ltd., pp. 7–34 (2009)

    Google Scholar 

  8. Endsley, M.R.: Measurement of situation awareness in dynamic systems. Hum. Factors J. Hum. Factors Ergon. Soc. 37(1), 65–84 (Mar.1995). https://doi.org/10.1518/001872095779049499

    Article  Google Scholar 

  9. Endsley, M.R.: Theoretical underpinnings of situation awareness: a critical review. In: Endsley, M.R., Garland, D.J. (Eds.) Situation Awareness Analysis and Measurement. Lawrence Erlbaum Associates Publishers (2000)

    Google Scholar 

  10. Donovan, S.J., Güss, C.D., Naslund, D.: Improving dynamic decision making through training and self-reflection. Judgm. Decis. Mak. 10(4), 284–295 (2015). Accessed 07 June 2020. http://eds.b.ebscohost.com.ezproxy.tlu.ee/eds/pdfviewer/pdfviewer?vid=0&sid=84c5805a-a737-4197-873e-ab8edd1d60de%2540pdc-v-sessmgr03

  11. Polikarpus, S., et al.: Authoring virtual simulations to measure situation awareness and understanding. In: ISCRAM 2022 Conference Proceedings – 19th International Conference on Information Systems for Crisis Response and Management, pp. 428–433 (2022). https://idl.iscram.org/files/stellapolikarpus/2022/2430_StellaPolikarpus_etal2022.pdf

  12. Edgar, G., et al.: Quantitative Analysis of Situation Awareness (QASA): modelling and measuring situation awareness using signal detection theory. Ergonomics 61(6), 762–777 (Jun.2018). https://doi.org/10.1080/00140139.2017.1420238

    Article  Google Scholar 

  13. Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors J. Hum. Factors Ergon. Soc. 37(1), 32–64 (Mar.1995). https://doi.org/10.1518/001872095779049543

    Article  Google Scholar 

  14. Dalinger, I., Smurov, M., Sukhikh, N., Tsybova, E.: Pilot’s situational awareness and methods of its assessment. Indian J. Sci. Technol. 9(46), (Dec.2016). https://doi.org/10.17485/ijst/2016/v9i46/107534

  15. Gugliotta, A., et al.: Are situation awareness and decision-making in driving totally conscious processes? Results of a hazard prediction task. Transp. Res. Part F Traffic Psychol. Behav. 44, 168–179 (2017). https://doi.org/10.1016/j.trf.2016.11.005

    Article  Google Scholar 

  16. Crichton, M.T.: Improving team effectiveness using tactical decision games. Saf. Sci. 47(3), 330–336 (2009). https://doi.org/10.1016/j.ssci.2008.07.036

    Article  Google Scholar 

  17. Thoelen, F., et al.: FireFront: a new tool to support training in Fireground situation awareness, situation understanding and Bias. Int. Fire Prof. 34, 34–39 (2020)

    Google Scholar 

  18. Polikarpus, S., Danilas, K.: Olukorrateadlikkuse, olukorramõistmise ja kallutatuse mõõtmine siseturvalisuse valdkonnas. Turvalisuskompass 2(1), pp. 89–107 (2022). https://digiriiul.sisekaitse.ee/bitstream/handle/123456789/2876/Turvalisuskompass2022-1.pdf?sequence=6&isAllowed=y

  19. XVR Simulation: XVR Virtual Reality training software for safety and security (2022). http://www.xvrsim.com/. Accessed 29 March 2022

  20. Effective Command: Effective Command. Effective Command (2022). https://www.effectivecommand.org/. Accessed 29 March 2022

  21. Polikarpus, S., Danilas, K.: Eesti päästemeeskonna juhtide visiõppepõhise hindamise rakendamine ja tulemused. Turvalisuskompass 1, 204 (2021). https://digiriiul.sisekaitse.ee/handle/123456789/2844

  22. A. Field: Discovering Statistics Using SPSS, 3rd edn. SAGE Publications Inc. (2009)

    Google Scholar 

  23. George, D., Mallery, M.: SPSS for Windows Step by Step: A Simple Guide and Reference, 17.0 updat. Pearson, Boston (2010)

    Google Scholar 

  24. Goss-Sampson, M.A.: Statistical analysis in JASP a guide for Students (2020)

    Google Scholar 

  25. Endsley, M.R.: Situation awareness misconceptions and misunderstandings. J. Cogn. Eng. Decis. Mak. 9(1), 4–32 (Mar.2015). https://doi.org/10.1177/1555343415572631

    Article  Google Scholar 

  26. Graham, E., Catherwood, D., Sallis, G., Brookes, D., Medley, A.: ‘I always know what’s going on’. Assessing the relationship between perceived and actual situation awareness across different scenarios. World Acad. Sci. Eng. Technol. 6(11), 1433–1434 (2012)

    Google Scholar 

Download references

Acknowledgements

We would like to thank the Estonian Rescue Board and The Estonian Academy of Security Sciences for continues funding of rescue incidents training and SA assessments. We struggle to express our profound thankfulness for all the work of the assessors doing the assessments as well building new assessment scenarios using CAPM. Thank you, Katherine Lamb’s, for your yearly efforts in training and certifying assessors.

Author information

Authors and Affiliations

  1. Estonian Academy of Security Sciences, Tallinn, Estonia

    Stella Polikarpus

  2. Tallinn University, Tallinn, Estonia

    Edna Milena Sarmiento-Márquez & Tobias Ley

Authors
  1. Stella Polikarpus
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Edna Milena Sarmiento-Márquez
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tobias Ley
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stella Polikarpus .

Editor information

Editors and Affiliations

  1. University of Agder, Kristiansand, Norway

    Terje Gjøsæter

  2. University of Agder, Kristiansand, Norway

    Jaziar Radianti

  3. Tsuda University, Tokyo, Japan

    Yuko Murayama

Rights and permissions

Reprints and permissions

Copyright information

© 2023 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Polikarpus, S., Sarmiento-Márquez, E.M., Ley, T. (2023). Creation and Use of Virtual Simulations for Measuring Situation Awareness of Incident Commanders. In: Gjøsæter, T., Radianti, J., Murayama, Y. (eds) Information Technology in Disaster Risk Reduction. ITDRR 2022. IFIP Advances in Information and Communication Technology, vol 672. Springer, Cham. https://doi.org/10.1007/978-3-031-34207-3_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-34207-3_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-34206-6

  • Online ISBN: 978-3-031-34207-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships