Skip to main content

Gaze-Aware Cognitive Assistant for Multiscreen Surveillance

  • Conference paper
  • First Online:
Intelligent Human Systems Integration (IHSI 2018)

Abstract

Surveillance operators must scan multiple camera feeds to ensure timely detection of incidents; however, variability in scanning behavior can lead to untimely/failed detection of critical information in feeds that were neglected for a long period. Using an eye tracker to monitor screen fixations we can calculate (in real-time) the time elapsed since the last scan of each particular feed, allowing the setting-up of targeted countermeasures contingent on operator oculomotor behavior. One avenue is to provide operators with timely alerts to modulate the scan pattern to avoid attentional tunneling and inattentional blindness. We test such an adaptive solution within a major event surveillance simulation and preliminary results show that operator scan behavior can be modulated, although further investigation is required to determine warning frequency and modality to optimize the balance between saliency and workload increase. Future work will focus on adding a real-time vigilance detection and countermeasure capability.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Mack, A., Rock, I.: Inattentional Blindness. MIT Press, Cambridge (1998)

    Google Scholar 

  2. Imbert, J.P., Hodgetts, H.M., Parise, P.R., Vachon, F., Dehais, F., Tremblay, S.: Attentional costs and failures in air traffic control notifications. Ergonomics 57, 1817–1832 (2014)

    Article  Google Scholar 

  3. Vallières, B., Hodgetts, H.M., Vachon, F., Tremblay, S.: Supporting dynamic change detection: using the right tool for the task. Cogn. Res. Principles Implications 1, 32 (2016)

    Article  Google Scholar 

  4. Troscianko, T., Holmes, A., Stillman, J., Mirmehdi, M., Wright, D., Wilson, A.: What happens next? The predictability of natural behaviour viewed through CCTV cameras. Perception 33, 87–101 (2004)

    Article  Google Scholar 

  5. Monsell, S.: Task switching. Trends Cogn. Sci. 7, 134–140 (2003)

    Article  Google Scholar 

  6. Valera, M., Velastin, S.A.: Intelligent distributed surveillance systems: a review. IEEE Proc. Vis. Image Sign. Process. 152, 192–204 (2005)

    Article  Google Scholar 

  7. Dadashi, N., Stedmon, A.W., Pridmore, T.P.: Semi-automated CCTV surveillance: the effects of system confidence, system accuracy and task complexity on operator vigilance, reliance and workload. Appl. Erg. 44, 730–738 (2003)

    Article  Google Scholar 

  8. Vachon, F., Vallières, B.R., Suss, J., Thériault, J.-D., Tremblay, S.: The CSSS microworld: a gateway to understanding and improving CCTV security surveillance. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, pp. 265–269. SAGE publications (2016)

    Google Scholar 

  9. Atrey, P.K., El Saddick, A., Kankanhalli, M.S.: Effective multimedia surveillance using a human-centric approach. Multimedia Tools Appl. 51, 697–721 (2011)

    Article  Google Scholar 

  10. Blignaut, P.: Fixation identification: the optimum threshold for a dispersion algorithm. Attention Percept. Psychol. 71, 881–895 (2009)

    Article  Google Scholar 

  11. Vachon, F., Vallières, B.R., Jones, D.M., Tremblay, S.: Nonexplicit change detection in complex dynamic settings: what eye movements reveal. Hum. Factors 54, 996–1007 (2012)

    Article  Google Scholar 

  12. Steelman, K.S., McCarley, J.S., Wickens, C.D.: Modeling the control of attention in visual workspaces. Hum. Factors 53, 142–153 (2011)

    Article  Google Scholar 

  13. Taylor, P., Bilgrien, N., He, Z., Siegelmann, H.T.: EyeFrame: real-time memory aid improves human multitasking via domain-general eye tracking procedures. Front. ICT 2, 17 (2015)

    Google Scholar 

  14. Hodgetts, H.M., Tremblay, S., Vallieres, B., Vachon, F.: Decision support and vulnerability to interruption in a dynamic multitasking environment. Int. J. Hum. Comput. Stud. 79, 106–117 (2015)

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported by grants from the National Sciences and Engineering Research Council of Canada (NSERC), the Ministère de l’économie, des sciences et de l’innovation du Québec (MESI), and Prompt Information Technology R&D awarded to Sébastien Tremblay and François Vachon. We are also grateful to the financial and in-kind contributions of Thales Research and Technology Canada.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sébastien Tremblay .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tremblay, S., Lafond, D., Chamberland, C., Hodgetts, H.M., Vachon, F. (2018). Gaze-Aware Cognitive Assistant for Multiscreen Surveillance. In: Karwowski, W., Ahram, T. (eds) Intelligent Human Systems Integration. IHSI 2018. Advances in Intelligent Systems and Computing, vol 722. Springer, Cham. https://doi.org/10.1007/978-3-319-73888-8_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-73888-8_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-73887-1

  • Online ISBN: 978-3-319-73888-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics