Skip to main content
SpringerLink
Log in
Book cover

International Conference on Neural Information Processing

ICONIP 2019: Neural Information Processing pp 530–539Cite as

Encephalographic Assessment of Situation Awareness in Teleoperation of Human-Swarm Teaming

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1142))

Abstract

An important factor in the operational success of any teleoperated human-swarm system is situation awareness (SA). A loss of SA has been associated with poor human performance, which can lead to misjudgement, errors, and life-threatening situations. One of the major factors that causes loss of SA is the degradation of data transmission. It is imperative to assess the SA of an operator before the performance of a teleoperated system has declined, in particular in situations of delayed relay and/or loss of critical information. We use electroencephalography (EEG) to predict different levels of SA. A human-swarm simulation was used to obtain subjective scores from participants. Quality of information significantly affected the perception of SA of the participants. EEG data provided objective confirmation of the resultant SA level. Theta, Alpha, and Beta band exhibited an increase during loss of SA. Frontal and occipital areas were identified to reflect changes in SA. These preliminary results offer evidence for the potential use of EEG to offer real-time indicators for the objective assessment of SA.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Berka, C., Levendowski, D.J., Davis, G., Whitmoyer, M., Hale, K., Fuchs, K.: Objective measures of situational awareness using neurophysiology technology. Augment. Cogn.: Past, Present. Future 145–154 (2006)

    Google Scholar 

  2. Catherwood, D., et al.: Mapping brain activity during loss of situation awareness: an EEG investigation of a basis for top-down influence on perception. Hum. Factors 56(8), 1428–1452 (2014)

    Article  Google Scholar 

  3. Chao, L.L., Lenoci, M., Neylan, T.C.: Effects of post-traumatic stress disorder on occipital lobe function and structure. NeuroReport 23(7), 412–419 (2012)

    Google Scholar 

  4. Chen, S.I., Visser, T.A., Huf, S., Loft, S.: Optimizing the balance between task automation and human manual control in simulated submarine track management. J. Exp. Psychol.: Appl. 23(3), 240 (2017)

    Google Scholar 

  5. Debie, E., et al.: Multimodal fusion for objective assessment of cognitive workload: a review. IEEE Trans. Cybern. 1–14 (2019)

    Google Scholar 

  6. Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors 37(1), 32–64 (1995)

    Article  Google Scholar 

  7. French, H.T., Clarke, E., Pomeroy, D., Seymour, M., Clark, C.R.: Psycho-physiological measures of situation awareness. Decis. Mak. Complex Environ. 291 (2007)

    Google Scholar 

  8. Lingard, L., et al.: Communication failures in the operating room: an observational classification of recurrent types and effects. BMJ Qual. Saf. 13(5), 330–334 (2004)

    Article  Google Scholar 

  9. Mathewson, K.E., Lleras, A., Beck, D.M., Fabiani, M., Ro, T., Gratton, G.: Pulsed out of awareness: EEG alpha oscillations represent a pulsed-inhibition of ongoing cortical processing. Front. Psychol. 2, 99 (2011)

    Article  Google Scholar 

  10. Pope, A.T., Bogart, E.H., Bartolome, D.S.: Biocybernetic system evaluates indices of operator engagement in automated task. Biol. Psychol. 40(1–2), 187–195 (1995)

    Article  Google Scholar 

  11. Thornton, R.C.: The effects of automation and task difficulty on crew coordination, workload, and performance, 00019 (1992)

    Google Scholar 

  12. Wang, M., Hussein, A., Rojas, R.F., Shafi, K., Abbass, H.A.: EEG-based neural correlates of trust in human-autonomy interaction. In: 2018 IEEE Symposium Series on Computational Intelligence (SSCI), pp. 350–357. IEEE (2018)

    Google Scholar 

  13. Winkler, I., Brandl, S., Horn, F., Waldburger, E., Allefeld, C., Tangermann, M.: Robust artifactual independent component classification for BCI practitioners. J. Neural Eng. 11(3), 035013 (2014)

    Article  Google Scholar 

  14. Yeo, L.G., et al.: Mobile EEG-based situation awareness recognition for air traffic controllers. In: 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 3030–3035. IEEE (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Engineering and IT, University of New South Wales, Canberra, Australia

    Raul Fernandez Rojas, Essam Debie, Michael Barlow, Kathryn Kasmarik, Sreenatha Anavatti, Matthew Garratt & Hussein Abbass

  2. Defence Science and Technology Organisation, Adelaide, Australia

    Justin Fidock

Authors
  1. Raul Fernandez Rojas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Essam Debie
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Justin Fidock
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Michael Barlow
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kathryn Kasmarik
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sreenatha Anavatti
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Matthew Garratt
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Hussein Abbass
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Raul Fernandez Rojas .

Editor information

Editors and Affiliations

  1. Australian National University, Canberra, ACT, Australia

    Tom Gedeon

  2. Murdoch University, Murdoch, WA, Australia

    Kok Wai Wong

  3. Kyungpook National University, Daegu, Korea (Republic of)

    Minho Lee

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Fernandez Rojas, R. et al. (2019). Encephalographic Assessment of Situation Awareness in Teleoperation of Human-Swarm Teaming. In: Gedeon, T., Wong, K., Lee, M. (eds) Neural Information Processing. ICONIP 2019. Communications in Computer and Information Science, vol 1142. Springer, Cham. https://doi.org/10.1007/978-3-030-36808-1_58

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-36808-1_58

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-36807-4

  • Online ISBN: 978-3-030-36808-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation