Abstract
Everyday life is driven by a wide range of mental processes organized in cognitive, emotional and executive functions. The assessment of these abilities could be improved thanks to the rising of Virtual Reality (VR) technologies, that show a more ecological validity in respect to the artificial laboratory settings. Moreover, mental processes can be investigated via electrophysiological measures, due to the modulation of deep structures controlling the autonomic system, and in turn peripheral organs activity. According to scientific literature, measurements could derive from sensors over periocular area, that is the same area covered by a typical VR headset.
The aim of this paper is to introduce the PERFORM prototype, a wearable mask with embedded sensors able to collect biomedical signals in a non-obtrusive way for the assessment of online cognitive abilities in VR scenarios. We show that PERFORM can collect data related to cardiac pulse, galvanic skin response, movements and face temperature during cognitive tasks in VR. Thanks to the specific electrode placement and the employment of VR scenario, PERFORM will be an ecological tool to assess psychophysiological correlates of online cognitive performances.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Neisser, U.: Cognitive Psychology. Prentice-Hall, Englewood Cliffs (1967)
Fuster, J.M.: The prefrontal cortex—an update: time is of the essence. Neuron 30(2), 319–333 (2001)
Anderson, P.: Assessment and development of executive function (EF) during childhood. Child Neuropsychol. 8(2), 71–82 (2002)
Gioia, G.A., Isquith, P.K., Guy, S.C., Kenworthy, L.: Test review behavior rating inventory of executive function. Child Neuropsychol. 6(3), 235–238 (2000)
Parsons, T.D., et al.: Sex differences in mental rotation and spatial rotation in a virtual environment. Neuropsychologia 42(4), 555–562 (2004)
Parsons, T.D., Bowerly, T., Buckwalter, J.G., Rizzo, A.A.: A controlled clinical comparison of attention performance in children with ADHD in a virtual reality classroom compared to standard neuropsychological methods. Child Neuropsychol. 13(4), 363–381 (2007)
Parsons, T.D., Rizzo, A.A.: Initial validation of a virtual environment for assessment of memory functioning: virtual reality cognitive performance assessment test. Cyber Psychol. Behav. 11(1), 17–25 (2008)
Neguț, A., Matu, S.A., Sava, F.A., David, D.: Virtual reality measures in neuropsychological assessment: a meta-analytic review. Clin. Neuropsychol. 30(2), 165–184 (2016)
Armstrong, C.M., Reger, G.M., Edwards, J., Rizzo, A.A., Courtney, C.G., Parsons, T.D.: Validity of the Virtual Reality Stroop Task (VRST) in active duty military. J. Clin. Exp. Neuropsychol. 35(2), 113–123 (2013)
Elkind, J.S., Rubin, E., Rosenthal, S., Skoff, B., Prather, P.: A simulated reality scenario compared with the computerized Wisconsin Card Sorting Test: an analysis of preliminary results. Cyber Psychol. Behav. 4(4), 489–496 (2001)
Lalonde, G., Henry, M., Drouin-Germain, A., Nolin, P., Beauchamp, M.H.: Assessment of executive function in adolescence: a comparison of traditional and virtual reality tools. J. Neurosci. Methods 219(1), 76–82 (2013)
Wolbers, T., Weiller, C., Büchel, C.: Neural foundations of emerging route knowledge in complex spatial environments. Cogn. Brain. Res. 21(3), 401–411 (2004)
Matheis, R.J., Schultheis, M.T., Tiersky, L.A., DeLuca, J., Millis, S.R., Rizzo, A.: Is learning and memory different in a virtual environment? Clin. Neuropsychologist. 21(1), 146–161 (2007)
Morganti, F.: Virtual interaction in cognitive neuropsychology. Stud. Health Technol. Inform. 99, 55–70 (2004)
Gould, N.F., et al.: Performance on a virtual reality spatial memory navigation task in depressed patients. Am. J. Psychiatry 164(3), 516–519 (2007)
Wilson, B.A.: Ecological validity of neuropsychological assessment: Do neuropsychological indexes predict performance in everyday activities? Appl. Prevent. Psychol. 2(4), 209–215 (1993)
Schultheis, M.T., Himelstein, J., Rizzo, A.A.: Virtual reality and neuropsychology: upgrading the current tools. J. Head Trauma Rehabil. 17(5), 378–394 (2002)
Hogervorst, M.A., Brouwer, A.M., Van Erp, J.B.: Combining and comparing EEG, peripheral physiology and eye-related measures for the assessment of mental workload. Front. Neurosci. 8, 322 (2014)
Reis, P., Hebenstreit, F., Gabsteiger, F., von Tscharner, V., Lochmann, M.: Methodological aspects of EEG and body dynamics measurements during motion. Front. Hum. Neurosci. 8, 156 (2014)
Benedek, M., Kaernbach, C.: A continuous measure of phasic electrodermal activity. J. Neurosci. Methods 190(1), 80–91 (2010)
St-Laurent, L., Prévost, D., and Maldague, X.: Fast and accurate calibration-based thermal/colour sensors registration. In: Quantitative Infrared Thermography (2010)
van Dooren, M., Janssen, J.H.: Emotional sweating across the body: comparing 16 different skin conductance measurement locations. Physiol. Behav. 106(2), 298–304 (2012)
Holz, C., Wang, E.J.: Glabella: continuously sensing blood pressure behavior using an unobtrusive wearable device. Proc. ACM Interact. Mob. Wearable Ubiquit. Technol. 1(3), 58 (2017)
Shastri, D., Merla, A., Tsiamyrtzis, P., Pavlidis, I.: Imaging facial signs of neurophysiological responses. IEEE Trans. Biomed. Eng. 56(2), 477–484 (2009)
Abdelrahman, Y., Velloso, E., Dingler, T., Schmidt, A., Vetere, F.: Cognitive heat: exploring the usage of thermal imaging to unobtrusively estimate cognitive load. Proc. ACM Interact. Mob. Wearable Ubiquit. Technol. 1(3), 33 (2017)
Mueller, S.T., Piper, B.J.: The psychology experiment building language (PEBL) and PEBL test battery. J. Neurosci. Methods 222, 250–259 (2014)
Acknowledgments
The research leading to these results was funded by the Project “Brain Machine Interface in space manned missions: amplifying Focused attention for error Counterbalancing” (BMI-FOCUS, Tuscany Region POR CREO 2014/2020). We also thank Davide Cini and Andrea Berton (both at the Institute of Clinical Physiology – CNR Pisa) for the technical assistance.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Menicucci, D., Laurino, M., Marinari, E., Cesari, V., Gemignani, A. (2020). The PERFORM Mask: A Psychophysiological sEnsoRs Mask FOr Real-Life Cognitive Monitoring. In: O'Hare, G., O'Grady, M., O’Donoghue, J., Henn, P. (eds) Wireless Mobile Communication and Healthcare. MobiHealth 2019. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 320. Springer, Cham. https://doi.org/10.1007/978-3-030-49289-2_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-49289-2_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49288-5
Online ISBN: 978-3-030-49289-2
eBook Packages: Computer ScienceComputer Science (R0)