Skip to main content
SpringerLink
Log in

Assessment of Attentional and Mnesic Processes Through Gaze Tracking Analysis: Inferences from Comparative Search Tasks Embedded in VR Serious Games

  • Conference paper
  • First Online:
ICTs for Improving Patients Rehabilitation Research Techniques (REHAB 2015)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 665))

  • 346 Accesses

Abstract

The impairment of basic cognitive functions such as attention and visual working memory can have a significant negative impact in our ability to adapt to the permanent changes in the environment. VR Serious Games are being used as a new tool for both assessment, stimulation and rehabilitation of such impaired functions. Even though the results of these novel applications seem to be promising, some of the assessments based in these solutions use indirect measures to evaluate attentional and mnesic performance (e.g. number of errors, task completion time). Gaze tracking (GT) can provide more accurate and direct indicators of these cognitive processes. On a sample of 46 non-clinical participants (33 Female; 71.7%), with an age average of 27.96 years old (SD = 11.92), ocular movements were recorded in two different comparative visual search tasks (CVSTs) that are an integrant part of the cognitive assessment protocol of the Systemic Lisbon Battery (SLB). Number of visits and total fixations differed based on the assessment with the Mini-mental state examination test (MMSE). These results highlight the possibility of combining both the data from the GT and the results of the “spot the differences” tasks in SLB, adding an unobtrusive and reliable solution for cognitive assessment in clinical and non-clinical settings.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Evans, J.: Cognitive rehabilitation: an integrative neuropsychological approach. Brain 126(1), 261–262 (2003). doi:http://dx.doi.org/10.1093/brain/awg003

  2. Gianutsos, R.: What is cognitive rehabilitation? J. Rehabil. 46(3), 36–40 (1980)

    Google Scholar 

  3. Negut, A.: Cognitive assessment and rehabilitation in virtual reality: theoretical review and practical implications. Rom. J. Appl. Psychol. 16, 1–7 (2014)

    Google Scholar 

  4. Alankus, G., Lazar, A., May, M., Kelleher, C.: Towards customizable games for stroke rehabilitation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Atlanta, USA, 10–15 April 2010, pp. 2113–2122. ACM Press, New York (2010)

    Google Scholar 

  5. Rego, P., Moreira, P.M., Reis, L.P.: Serious games for rehabilitation: a survey and a classification towards a taxonomy. In: Proceedings of the 5th Iberian Conference on Information Systems and Technologies (CISTI), Santiago de Compostela, Spain, 16–19 June 2010, pp. 1–6. IEEE press, New York (2010)

    Google Scholar 

  6. Parsey, C., Schmitter-Edgecombe, M.: Applications of technology in neuropsychological assessment. Clin. Neuropsychol. 27, 10 (2013) doi:10.1080/13854046.2013.834971

  7. Ortiz-Catalan, M., Nijenhuis, S., Ambrosch, K., Bovend’Eerdt, T., Koenig, S., Lange, B.: Virtual reality. In: Pons, J.L., Torricelli, D. (eds.) Emerging Therapies in Neurorehabilitation, Biosystems & Biorobotics, pp. 249–265. Springer, Heidelberg. doi:10.1007/978-3-642-38556-8_13

  8. St-Jacques, J., Bouchard, S., Belanger, C.: Is virtual reality effective to motivate and raise interest in phobic children toward therapy? A clinical trial study of in vivo with in virtuo versus in vivo only treatment exposure. J. Clin. Psychiatry 71(7), 924–931 (2010). doi:http://dx.doi.org/10.4088/JCP.08m04822blu

  9. Burke, J., McNeill, M.D.J., Charles, D.K., Morrow, P.J., Crosbie, J.H., McDonough, M.: Optimising engagement for stroke rehabilitation using serious games. Vis. Comput. 25(12), 1085–1099 (2009). doi:http://dx.doi.org/10.1007/s00371-009-0387-4

  10. Gamito, P., et al.: Virtual kitchen test. Assessing frontal lobe functions in patients with alcohol dependence syndrome. Methods Inf. Med. 54(2), 122–126 (2015). doi:http://dx.doi.org/10.3414/ME14-01-0003

    Article  Google Scholar 

  11. Lam, Y.S., Man, D.W., Tam, S.F., Weiss, P.L.: Virtual reality training for stroke rehabilitation. Neuro Rehabil. 21(3), 245–253 (2006)

    Google Scholar 

  12. Rosa, P.J., Gamito, P., Oliveira, J., Morais, D.: Attentional orienting to biologically fear-relevant stimuli: data from eye tracking using the continual alternation flicker paradigm. J. Eye Track. Vis. Emotion Cognit. 1, 22–29 (2011)

    Google Scholar 

  13. Gamito, P., Oliveira, J., Baptista, A., Morais, D., Lopes, P., Rosa, P., Santos, N., Brito, R.: Eliciting nicotine craving with virtual smoking cues. Cyberpsychol. Behav. Soc. Netw. 17(8), 556–561 (2014). doi:http://dx.doi.org/10.1089/cyber.2013.0329

  14. Cipresso, P., Serino, S., Gaggioli, A., Albani, G., Riva, G.: Contactless bio-behavioral technologies for virtual reality. Stud. Health Technol. Inform. 191, 149–153 (2013)

    Google Scholar 

  15. Rosa, P.J., Esteves, F., Arriaga, P.: Effects of fear-relevant stimuli on attention: integrating gaze data with subliminal exposure. In: Proceedings of the Medical Measurements and Applications (MeMeA), Lisbon, Portugal, June 12–14, pp. 8–14. doi:10.1109/MeMeA2014.6860021

  16. Rosa, P.J.: What do your eyes say? Bridging eye movements to consumer behavior. Int. J. Psychol. Res. 8(2), 91–104 (2015)

    Article  Google Scholar 

  17. Rosa, P.J., Esteves, F., Arriaga, P.: Beyond traditional clinical measurements for screening fears and phobias. IEEE Trans. Instrum. Measur. 64(12), 3396–3404 (2015). doi:http://dx.doi.org/10.1109/TIM.2015.2450292

  18. Banovic, M., Chrysochou, P., Grunert, K., Rosa, P.J., Gamito, P.: The effect of fat content on visual attention and choice of red meat and differences across gender. Food Qual. Prefer. 52, 42–51 (2016). doi:http://dx.doi.org/10.1016/j.foodqual.2016.03.017

  19. Mele, M., Federici, S.: A psychotechnological review on eye-tracking systems: towards user experience. Disabil. Rehabil. Assist. Technol. 7(4), 261–281 (2012). doi:http://dx.doi.org/10.3109/17483107.2011.635326

  20. Vidal, M., Turner, J., Bulling, A., Gellersen, H.: Wearable eye tracking for mental health monitoring. Comput. Commun. 35(11), 1306–1311 (2012). http://dx.doi.org/10.1016/j.comcom.2011.11.002

  21. Riby, D., Hancock, P.J.: Looking at movies and cartoons: eye-tracking evidence from Williams’s syndrome and autism. J. Intellect. Disabil. Res. 53(2), 169–181. doi:http://dx.doi.org/10.1111/j.1365-2788.2008.01142.x

  22. Deng, S., Kirkby, J., Chang, J., Zhang, J.: Multimodality with eye tracking and haptics: a new horizon for serious games? Int. J. Serious Games 1(4), 17–33 (2014)

    Article  Google Scholar 

  23. Frutos-Pascual, M., Garcia-Zapirain, B.: Assessing visual attention using eye tracking sensors in intelligent cognitive therapies based on serious games. Sensors 15(5), 11092 (2015). doi:10.3390/s150511092

    Article  Google Scholar 

  24. Galpin, A.J., Underwood, G.: Eye movements during search and detection in comparative visual search. Percept. Psychophys. 67(8), 1313–1331 (2005)

    Article  Google Scholar 

  25. Irwin, D.E., Zelinsky, G.J.: Eye movements and scene perception: memory for things observed. Percept. Psychophys. 64(6), 882–895 (2002)

    Article  Google Scholar 

  26. Pomplun, M., Sichelschmidt, L., Wagner, K., Clermont, T., Rickheit, G., Ritter, H.: Comparative visual search: a difference that makes a difference. Cognit. Sci. 25(1), 3–36 (2001). doi:http://dx.doi.org/10.1207/s15516709cog2501_2

    Article  Google Scholar 

  27. Rosa, P.J., Gamito, P., Oliveira, J., Morais, D., Pavlovic, M., Smyth, O.: Show me your eyes! The combined use of eye tracking and virtual reality applications for cognitive assessment. In: Proceedings of the 3rd 2015 Workshop on ICTs for Improving Patients Rehabilitation Research Techniques, Lisbon, Portugal, 1-2 October 2015, pp. 135–138. ACM Press, New York (2015). doi:10.1145/2838944.2838977

  28. Folstein, M., Folstein, S., McHugh, P.: Mini-mental state a practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 12(3), 189–198 (1975)

    Article  Google Scholar 

  29. American Psychological Association. Ethical principles of psychologists and code of conduct. http://apa.org/ethics/code/index.aspx. Accessed 11 Jan 2016

  30. Rosa, P.J., Gamito, P., Oliveira, J., Morais, D., Pavlovic, M., Smyth, O.: Uso de eye tracking em realidade virtual não imersiva para avaliação cognitiva. Psicologia Saúde Doenças 17(1), 23–31 (2016)

    Google Scholar 

  31. Gottlob, L.R.: Aging and comparative search for feature differences. Aging Neuropsychol. Cognit. 13(3-4) 435–457 (2006). doi:http://dx.doi.org/10.1080/138255890969564

  32. Mcafoose, J., Baune, B.T.: Exploring visual-spatial working memory: a critical review of concepts and models. Neuropsychol. Rev. 19(1), 130–142 (2009). doi:http://dx.doi.org/10.1007/s11065-008-9063-0

Download references

Author information

Authors and Affiliations

  1. ECPV, Universidade Lusófona de Humanidades e Tecnologias, Lisbon, Portugal

    Pedro J. Rosa, Diogo Morais, Jorge Oliveira & Pedro Gamito

  2. School of Psychology and Life Sciences, COPELABS–ULHT, Lisbon, Portugal

    Pedro J. Rosa, Diogo Morais, Jorge Oliveira & Pedro Gamito

  3. Instituto Universitário de Lisboa (ISCTE-IUL), Cis-IUL, Lisbon, Portugal

    Pedro J. Rosa

  4. Centro de Investigação em Psicologia do ISMAT, Portimão, Portugal

    Pedro J. Rosa

  5. University of Michigan, Michigan, USA

    Olivia Smyth & Matthew Pavlovic

Authors
  1. Pedro J. Rosa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Diogo Morais
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jorge Oliveira
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pedro Gamito
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Olivia Smyth
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Matthew Pavlovic
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pedro J. Rosa .

Editor information

Editors and Affiliations

  1. King Abdulaziz University, Jeddah, Saudi Arabia

    Habib M. Fardoun

  2. University of Castilla-La Mancha, Albacete, Spain

    Victor M. R. Penichet

  3. King Abdulaziz University, Jeddah, Saudi Arabia

    Daniyal M. Alghazzawi

  4. University of Castilla-La Mancha, Albacete, Spain

    M. Elena De la Guia

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rosa, P.J., Morais, D., Oliveira, J., Gamito, P., Smyth, O., Pavlovic, M. (2017). Assessment of Attentional and Mnesic Processes Through Gaze Tracking Analysis: Inferences from Comparative Search Tasks Embedded in VR Serious Games. In: Fardoun, H., R. Penichet, V., Alghazzawi, D., De la Guia, M. (eds) ICTs for Improving Patients Rehabilitation Research Techniques. REHAB 2015. Communications in Computer and Information Science, vol 665. Springer, Cham. https://doi.org/10.1007/978-3-319-69694-2_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-69694-2_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-69693-5

  • Online ISBN: 978-3-319-69694-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation