Abstract
Operators monitoring closed-circuit television systems face many error-prone situations given the cognitive challenges they experience. The Scantracker is a prototype tool developed to support surveillance, relying on live oculometric data to trigger notifications that mitigate camera negligence, attention tunneling and vigilance decrement. To be robust and flexible, this tool must however collect valid gaze measures at a sufficient sampling rate and allow the display of surveillance-supportive visual notifications. This paper documents the integration of the Scantracker with the Microsoft HoloLens 2 augmented reality (AR) system embarked with eye tracking and reports a validity study performed in a high-fidelity surveillance simulation. The AR solution led to superior gaze validity than previous mobile or fixed oculometer integration. Implications of the solution integration are discussed and compared with the other implementations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wang, X.: Intelligent multi-camera video surveillance: a review. Pattern Recogn. Lett. 34, 3–19 (2013). https://doi.org/10.1016/j.patrec.2012.07.005
Hodgetts, H.M., Vachon, F., Chamberland, C., Tremblay, S.: See no evil: cognitive challenges of security surveillance and monitoring. J. Appl. Res. Mem. Cogn. 6, 230–243 (2017). https://doi.org/10.1016/j.jarmac.2017.05.001
Tremblay, S., Lafond, D., Chamberland, C., Hodgetts, H.M., Vachon, F.: Gaze-aware cognitive assistant for multiscreen surveillance. In: Karwowski, W., Ahram, T. (eds.) IHSI 2018. AISC, vol. 722, pp. 230–236. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-73888-8_36
Marois, A., Lafond, D., Williot, A., Vachon, F., Tremblay, S.: Real-time gaze-aware cognitive support system for security surveillance. Hum. Fac. Erg. Soc. P. 64, 1145–1149 (2020). https://doi.org/10.1177/1071181320641274
Marois, A., Lafond, D., Vachon, F., Harvey, E.R., Martin, B., Tremblay, S.: Mobile real-time eye-tracking for gaze-aware security surveillance support systems. In: Ahram, T., Karwowski, W., Vergnano, A., Leali, F., Taiar, R. (eds.) IHSI 2020. AISC, vol. 1131, pp. 201–207. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-39512-4_32
Carmigniani J., Furht B.: Augmented reality: an overview. In: Furht, B. (ed.) Handbook of Augmented Reality. Springer, New York (2011). https://doi.org/10.1007/978-1-4614-0064-6_1
Mascareñas, D., et al.: Augmented reality for enabling smart nuclear infrastructure. Front. Built Environ. 5, 82 (2019). https://doi.org/10.3389/fbuil.2019.00082
Amaguaña, F., Collaguazo, B., Tituaña, J., Aguilar, W.G.: Simulation system based on augmented reality for optimization of training tactics on military operations. In: De Paolis, L.T., Bourdot, P. (eds.) AVR 2018. LNCS, vol. 10850, pp. 394–403. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-95270-3_33
González Izard, S., Juanes Méndez, J.A., Ruisoto Palomera, P., García-Peñalvo, F.J.: Applications of virtual and augmented reality in biomedical imaging. J. Med. Syst. 43(4), 1–5 (2019). https://doi.org/10.1007/s10916-019-1239-z
Marois, A., Salvan, L., Lafond, D., Williot, A., Lemaire, N., Tremblay, S.: Improving usability of a gaze-based surveillance support tool through user-centered design. In: Ahram, T.Z., Falcão, C.S. (eds.) AHFE 2021. LNNS, vol. 275, pp. 732–740. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-80091-8_87
Funke, G., Greenlee, E., Carter, M., Dukes, A., Brown, R., Menke, L.: Which eye tracker is right for your research? Performance evaluation of several cost variant eye trackers. Hum. Fac. Erg. Soc. P. 60, 1240–1244 (2016). https://doi.org/10.1177/1541931213601289
Macinnes, J.J., Iqbal, S., Pearson, J., Johnson, E.N.: Wearable eye-tracking for research: automated dynamic gaze mapping and accuracy/precision comparisons across devices, 28 June 2018
Vachon, F., Vallières, B.R., Suss, J., Thériault, J.-D., Tremblay, S.: The CSSS microworld: a gateway to understanding and improving CCTV security surveillance. Hum. Fac. Erg. Soc. P. 60, 265–269 (2016). https://doi.org/10.1177/1541931213601061
Anderson, R., Nyström, M., Holmqvist, K.: Sampling frequency and eye-tracking measures: how speed affects durations, latencies, and more. J. Eye. Mov. Res. 3, 1–12 (2010). https://doi.org/10.16910/jemr.3.3.6
Acknowledgments
This project was supported by a grant from the Innovation for Defence Excellence and Security (IDEaS) program and by Mitacs Canada. We are grateful to all the participants involved in the workshops and data collection. Thanks are due to François Vachon, Vincent Poiré, Laura Salvan, Noémie Lemaire, to the Thales development team and to the research assistants from Université Laval.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Marois, A. et al. (2022). Adaptation of a Gaze-Aware Security Surveillance Support Tool for Augmented Reality. In: Ahram, T., Taiar, R. (eds) Human Interaction, Emerging Technologies and Future Systems V. IHIET 2021. Lecture Notes in Networks and Systems, vol 319. Springer, Cham. https://doi.org/10.1007/978-3-030-85540-6_99
Download citation
DOI: https://doi.org/10.1007/978-3-030-85540-6_99
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-85539-0
Online ISBN: 978-3-030-85540-6
eBook Packages: EngineeringEngineering (R0)