skip to main content
10.1145/3611659.3615704acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
research-article

Cognitive Load Measurement with Physiological Sensors in Virtual Reality during Physical Activity

Published:09 October 2023Publication History

ABSTRACT

Many Virtual Reality (VR) experiences, such as learning tools, would benefit from utilising mental states such as cognitive load. Increases in cognitive load (CL) are often reflected in the alteration of physiological responses, such as pupil dilation (PD), electrodermal cctivity (EDA), heart rate (HR), and electroencephalography (EEG). However, the relationship between these physiological responses and cognitive load are usually measured while participants sit in front of a computer screen, whereas VR environments often require a high degree of physical movement. This physical activity can affect the measured signals, making it unclear how suitable these measures are for use in interactive Virtual Reality (VR).

We investigate the suitability of four physiological measures as correlates of cognitive load in interactive VR. Suitable measures must be robust enough to allow the learner to move within VR and be temporally responsive enough to be a useful metric for adaptation. We recorded PD, EDA, HR, and EEG data from nineteen participants during a sequence memory task at varying levels of cognitive load using VR, while in the standing position and using their dominant arm to play a game. We observed significant linear relationships between cognitive load and PD, EDA, and EEG frequency band power, but not HR. PD showed the most reliable relationship but has a slower response rate than EEG. Our results suggest the potential for use of PD, EDA, and EEG in this type of interactive VR environment, but additional studies will be needed to assess feasibility under conditions of greater movement.

References

  1. Enobio 20. 2023. Enobio 20. https://www.neuroelectrics.com/solutions/enobio/20. [Online; accessed 14-Aug-2023].Google ScholarGoogle Scholar
  2. Mohammad Ahmadi, Huidong Bai, Alex Chatburn, Marzieh Ahmadi Najatabadi, Burkhard C Wünsche, and Mark Billinghurst. 2023. Comparison of Physiological Cues for Cognitive Load Measures in VR. In 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, 837–838.Google ScholarGoogle Scholar
  3. Mohammad Ahmadi, Huidong Bai, Alex Chatburn, Burkhard Wuensche, and Mark Billinghurst. 2022. PlayMeBack-Cognitive Load Measurement using Different Physiological Cues in a VR Game. In Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology. 1–2.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Ivon Arroyo and Beverly Park Woolf. 2005. Inferring learning and attitudes from a Bayesian Network of log file data.. In AIED. 33–40.Google ScholarGoogle Scholar
  5. Olivier Augereau, Gabriel Brocheton, and Pedro Paulo Do Prado Neto. 2022. An Open Platform for Research about Cognitive Load in Virtual Reality. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, 54–55.Google ScholarGoogle ScholarCross RefCross Ref
  6. Deger Ayata, Yusuf Yaslan, and Mustafa Kamaşak. 2017. Emotion recognition via galvanic skin response: Comparison of machine learning algorithms and feature extraction methods. IU-Journal of Electrical & Electronics Engineering 17, 1 (2017), 3147–3156.Google ScholarGoogle Scholar
  7. Paul Ayres. 2006. Impact of reducing intrinsic cognitive load on learning in a mathematical domain. Applied Cognitive Psychology: The Official Journal of the Society for Applied Research in Memory and Cognition 20, 3 (2006), 287–298.Google ScholarGoogle ScholarCross RefCross Ref
  8. Paul Ayres and John Sweller. 1990. Locus of difficulty in multistage mathematics problems. The American Journal of Psychology (1990), 167–193.Google ScholarGoogle Scholar
  9. Ebrahim Babaei, Benjamin Tag, Tilman Dingler, and Eduardo Velloso. 2021. A critique of electrodermal activity practices at chi. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Alan D Baddeley and Graham Hitch. 1974. Working memory. In Psychology of learning and motivation. Vol. 8. Elsevier, 47–89.Google ScholarGoogle ScholarCross RefCross Ref
  11. Ryan Shaun Baker, Albert T Corbett, and Kenneth R Koedinger. 2004. Detecting student misuse of intelligent tutoring systems. In International conference on intelligent tutoring systems. Springer, 531–540.Google ScholarGoogle ScholarCross RefCross Ref
  12. Jackson Beatty, Brennis Lucero-Wagoner, 2000. The pupillary system. Handbook of psychophysiology 2, 142-162 (2000).Google ScholarGoogle Scholar
  13. Joseph E Beck. 2004. Using response times to model student disengagement. In Proceedings of the ITS2004 Workshop on Social and Emotional Intelligence in Learning Environments, Vol. 20. Maceio, 88–95.Google ScholarGoogle Scholar
  14. Guillermo Bernal, Nelson Hidalgo, Conor Russomanno, and Pattie Maes. 2022. Galea: A physiological sensing system for behavioral research in Virtual Environments. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 66–76.Google ScholarGoogle ScholarCross RefCross Ref
  15. Pradipta Biswas and Gowdham Prabhakar. 2018. Detecting drivers’ cognitive load from saccadic intrusion. Transportation research part F: traffic psychology and behaviour 54 (2018), 63–78.Google ScholarGoogle Scholar
  16. Yati N Boutcher and Stephen H Boutcher. 2006. Cardiovascular response to Stroop: effect of verbal response and task difficulty. Biological psychology 73, 3 (2006), 235–241.Google ScholarGoogle Scholar
  17. Anne-Marie Brouwer, Maarten A Hogervorst, Jan BF Van Erp, Tobias Heffelaar, Patrick H Zimmerman, and Robert Oostenveld. 2012. Estimating workload using EEG spectral power and ERPs in the n-back task. Journal of neural engineering 9, 4 (2012), 045008.Google ScholarGoogle ScholarCross RefCross Ref
  18. Thomas G Brown, Attila Szabo, and Peter Seraganian. 1988. Physical versus psychological determinants of heart rate reactivity to mental arithmetic. Psychophysiology 25, 5 (1988), 532–537.Google ScholarGoogle ScholarCross RefCross Ref
  19. Aneta Brzezicka, Jan Kamiński, Chrystal M Reed, Jeffrey M Chung, Adam N Mamelak, and Ueli Rutishauser. 2019. Working memory load-related theta power decreases in dorsolateral prefrontal cortex predict individual differences in performance. Journal of cognitive neuroscience 31, 9 (2019), 1290–1307.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Thomas C Bulea, Saurabh Prasad, Atilla Kilicarslan, and Jose L Contreras-Vidal. 2014. Sitting and standing intention can be decoded from scalp EEG recorded prior to movement execution. Frontiers in neuroscience 8 (2014), 376.Google ScholarGoogle Scholar
  21. Paul Chandler and John Sweller. 1992. The split-attention effect as a factor in the design of instruction. British Journal of Educational Psychology 62, 2 (1992), 233–246.Google ScholarGoogle ScholarCross RefCross Ref
  22. Siyuan Chen, Julien Epps, and Fang Chen. 2011. A comparison of four methods for cognitive load measurement. In Proceedings of the 23rd Australian Computer-Human Interaction Conference. 76–79.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Youguo Chen and Xiting Huang. 2016. Modulation of alpha and beta oscillations during an n-back task with varying temporal memory load. Frontiers in psychology 6 (2016), 2031.Google ScholarGoogle Scholar
  24. Samy Chikhi, Nadine Matton, and Sophie Blanchet. 2022. EEG power spectral measures of cognitive workload: A meta-analysis. Psychophysiology 59, 6 (2022), e14009.Google ScholarGoogle ScholarCross RefCross Ref
  25. Francesco Chiossi, Changkun Ou, and Sven Mayer. 2023. Exploring Physiological Correlates of Visual Complexity Adaptation: Insights from EDA, ECG, and EEG Data for Adaptation Evaluation in VR Adaptive Systems. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–7.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Francesco Chiossi, Yagiz Turgut, Robin Welsch, and Sven Mayer. 2023. Adapting Visual Complexity Based on Electrodermal Activity Improves Working Memory Performance in Virtual Reality. Proc. ACM Hum.-Comput. Interact 7 (2023).Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Jonny Collins, Holger Regenbrecht, Tobias Langlotz, Yekta Said Can, Cem Ersoy, and Russell Butson. 2019. Measuring cognitive load and insight: A methodology exemplified in a virtual reality learning context. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 351–362.Google ScholarGoogle ScholarCross RefCross Ref
  28. Nelson Cowan. 2001. The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and brain sciences 24, 1 (2001), 87–114.Google ScholarGoogle Scholar
  29. Nelson Cowan. 2010. The magical mystery four: How is working memory capacity limited, and why?Current directions in psychological science 19, 1 (2010), 51–57.Google ScholarGoogle ScholarCross RefCross Ref
  30. Hugo D Critchley. 2002. Electrodermal responses: what happens in the brain. The Neuroscientist 8, 2 (2002), 132–142.Google ScholarGoogle ScholarCross RefCross Ref
  31. Marie-Pierre Deiber, Pascal Missonnier, Olivier Bertrand, Gabriel Gold, Lara Fazio-Costa, Vicente Ibanez, and Panteleimon Giannakopoulos. 2007. Distinction between perceptual and attentional processing in working memory tasks: a study of phase-locked and induced oscillatory brain dynamics. Journal of cognitive neuroscience 19, 1 (2007), 158–172.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Arnaud Delorme and Scott Makeig. 2004. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of neuroscience methods 134, 1 (2004), 9–21.Google ScholarGoogle ScholarCross RefCross Ref
  33. Arindam Dey, Alex Chatburn, and Mark Billinghurst. 2019. Exploration of an EEG-based cognitively adaptive training system in virtual reality. In 2019 ieee conference on virtual reality and 3d user interfaces (vr). IEEE, 220–226.Google ScholarGoogle Scholar
  34. Theekshana Dissanayake, Yasitha Rajapaksha, Roshan Ragel, and Isuru Nawinne. 2019. An ensemble learning approach for electrocardiogram sensor based human emotion recognition. Sensors 19, 20 (2019), 4495.Google ScholarGoogle ScholarCross RefCross Ref
  35. Eija Ferreira, Denzil Ferreira, SeungJun Kim, Pekka Siirtola, Juha Röning, Jodi F Forlizzi, and Anind K Dey. 2014. Assessing real-time cognitive load based on psycho-physiological measures for younger and older adults. In 2014 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB). IEEE, 39–48.Google ScholarGoogle ScholarCross RefCross Ref
  36. Matti Gärtner, Simone Grimm, and Malek Bajbouj. 2015. Frontal midline theta oscillations during mental arithmetic: effects of stress. Frontiers in behavioral neuroscience (2015), 96.Google ScholarGoogle Scholar
  37. Rahul Gavas, Rajat Das, Pratyusha Das, Debatri Chatterjee, and Aniruddha Sinha. 2016. Inactive-state recognition from EEG signals and its application in cognitive load computation. In 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 003606–003611.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Peter Gerjets, Carina Walter, Wolfgang Rosenstiel, Martin Bogdan, and Thorsten O Zander. 2014. Cognitive state monitoring and the design of adaptive instruction in digital environments: lessons learned from cognitive workload assessment using a passive brain-computer interface approach. Frontiers in neuroscience 8 (2014), 385.Google ScholarGoogle Scholar
  39. Lynda Gerry, Barrett Ens, Adam Drogemuller, Bruce Thomas, and Mark Billinghurst. 2018. Levity: A virtual reality system that responds to cognitive load. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 1–6.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Alan Gevins, Michael E Smith, Linda McEvoy, and Daphne Yu. 1997. High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice.Cerebral cortex (New York, NY: 1991) 7, 4 (1997), 374–385.Google ScholarGoogle Scholar
  41. David Grimes, Desney S Tan, Scott E Hudson, Pradeep Shenoy, and Rajesh PN Rao. 2008. Feasibility and pragmatics of classifying working memory load with an electroencephalograph. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 835–844.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Kunal Gupta, Ryo Hajika, Yun Suen Pai, Andreas Duenser, Martin Lochner, and Mark Billinghurst. 2019. In ai we trust: Investigating the relationship between biosignals, trust and cognitive load in vr. In 25th ACM Symposium on Virtual Reality Software and Technology. 1–10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Kunal Gupta, Ryo Hajika, Yun Suen Pai, Andreas Duenser, Martin Lochner, and Mark Billinghurst. 2020. Measuring human trust in a virtual assistant using physiological sensing in virtual reality. In 2020 IEEE Conference on virtual reality and 3D user interfaces (VR). IEEE, 756–765.Google ScholarGoogle ScholarCross RefCross Ref
  44. Andreas Haag, Silke Goronzy, Peter Schaich, and Jason Williams. 2004. Emotion recognition using bio-sensors: First steps towards an automatic system. In Tutorial and research workshop on affective dialogue systems. Springer, 36–48.Google ScholarGoogle Scholar
  45. Andreas Haag, Silke Goronzy, Peter Schaich, and Jason Williams. 2004. Emotion recognition using bio-sensors: First steps towards an automatic system. In Tutorial and research workshop on affective dialogue systems. Springer, 36–48.Google ScholarGoogle Scholar
  46. Eija Haapalainen, SeungJun Kim, Jodi F Forlizzi, and Anind K Dey. 2010. Psycho-physiological measures for assessing cognitive load. In Proceedings of the 12th ACM international conference on Ubiquitous computing. 301–310.Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Eckhard H Hess and James M Polt. 1964. Pupil size in relation to mental activity during simple problem-solving. Science 143, 3611 (1964), 1190–1192.Google ScholarGoogle Scholar
  48. HP-Omnicept. 2022. HP-Omnicept. https://www.hp.com/us-en/vr/reverb-g2-vr-headset-omnicept-edition.html. [Online; accessed 30-Jul-2022].Google ScholarGoogle Scholar
  49. Ole Jensen, Jack Gelfand, John Kounios, and John E Lisman. 2002. Oscillations in the alpha band (9–12 Hz) increase with memory load during retention in a short-term memory task. Cerebral cortex 12, 8 (2002), 877–882.Google ScholarGoogle Scholar
  50. Ole Jensen and Claudia D Tesche. 2002. Frontal theta activity in humans increases with memory load in a working memory task. European journal of Neuroscience 15, 8 (2002), 1395–1399.Google ScholarGoogle ScholarCross RefCross Ref
  51. Petar Jerčić, Charlotte Sennersten, and Craig Lindley. 2020. Modeling cognitive load and physiological arousal through pupil diameter and heart rate. Multimedia Tools and Applications 79, 5 (2020), 3145–3159.Google ScholarGoogle ScholarCross RefCross Ref
  52. Erika Johannessen, Adam Szulewski, Nada Radulovic, Matthew White, Heather Braund, Dan Howes, Dirk Rodenburg, and Claire Davies. 2020. Psychophysiologic measures of cognitive load in physician team leaders during trauma resuscitation. Computers in Human Behavior 111 (2020), 106393.Google ScholarGoogle ScholarCross RefCross Ref
  53. Jeffrey Johns and Beverly Woolf. 2006. A dynamic mixture model to detect student motivation and proficiency. In AAAI. 163–168.Google ScholarGoogle Scholar
  54. Ju-Yeon Jung, Hwi-Young Cho, and Chang-Ki Kang. 2020. Brain activity during a working memory task in different postures: An EEG study. Ergonomics 63, 11 (2020), 1359–1370.Google ScholarGoogle ScholarCross RefCross Ref
  55. Daniel Kahneman and Jackson Beatty. 1966. Pupil diameter and load on memory. Science 154, 3756 (1966), 1583–1585.Google ScholarGoogle Scholar
  56. Eric R Kandel, James H Schwartz, Thomas M Jessell, Steven Siegelbaum, A James Hudspeth, Sarah Mack, 2000. Principles of neural science. Vol. 4. McGraw-hill New York.Google ScholarGoogle Scholar
  57. Sam Kavanagh, Andrew Luxton-Reilly, Burkhard Claus Wünsche, and Beryl Plimmer. 2017. A systematic review of Virtual Reality in education. Themes in Science & Technology Education 10, 2 (2017), 85–119. https://doi.org/10.1002/bmb.20718Google ScholarGoogle ScholarCross RefCross Ref
  58. Wolfgang Klimesch. 1999. EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain research reviews 29, 2-3 (1999), 169–195.Google ScholarGoogle Scholar
  59. Wolfgang Klimesch. 2012. Alpha-band oscillations, attention, and controlled access to stored information. Trends in cognitive sciences 16, 12 (2012), 606–617.Google ScholarGoogle Scholar
  60. Simon Kornblith, Timothy J Buschman, and Earl K Miller. 2016. Stimulus load and oscillatory activity in higher cortex. Cerebral Cortex 26, 9 (2016), 3772–3784.Google ScholarGoogle ScholarCross RefCross Ref
  61. Daniël Lakens. 2013. Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Frontiers in psychology 4 (2013), 863.Google ScholarGoogle Scholar
  62. Chi Kin Lao, U Kin Che, Wei Chen, Sio Hang Pun, Peng Un Mak, Feng Wan, and Mang I Vai. 2012. Portable heart rate detector based on photoplethysmography with android programmable devices for ubiquitous health monitoring system. International Journal of Advances in Telecommunications, Electrotechnics, Signals and Systems 2, 1 (2012), 18–26.Google ScholarGoogle Scholar
  63. Hyunjeong Lee. 2014. Measuring cognitive load with electroencephalography and self-report: focus on the effect of English-medium learning for Korean students. Educational Psychology 34, 7 (2014), 838–848.Google ScholarGoogle ScholarCross RefCross Ref
  64. Eileen YL Lew, Ricardo Chavarriaga, Stefano Silvoni, and José del R Millán. 2014. Single trial prediction of self-paced reaching directions from EEG signals. Frontiers in neuroscience 8 (2014), 222.Google ScholarGoogle Scholar
  65. Lars Lidberg and B Gunnar Wallin. 1981. Sympathetic skin nerve discharges in relation to amplitude of skin resistance responses. Psychophysiology 18, 3 (1981), 268–270.Google ScholarGoogle ScholarCross RefCross Ref
  66. Kevin P Madore, Anna M Khazenzon, Cameron W Backes, Jiefeng Jiang, Melina R Uncapher, Anthony M Norcia, and Anthony D Wagner. 2020. Memory failure predicted by attention lapsing and media multitasking. Nature 587, 7832 (2020), 87–91.Google ScholarGoogle Scholar
  67. Bruce S McEwen and Robert M Sapolsky. 1995. Stress and cognitive function. Current opinion in neurobiology 5, 2 (1995), 205–216.Google ScholarGoogle Scholar
  68. Lars Michels, Kerstin Bucher, Rafael Lüchinger, Peter Klaver, Ernst Martin, Daniel Jeanmonod, and Daniel Brandeis. 2010. Simultaneous EEG-fMRI during a working memory task: modulations in low and high frequency bands. PloS one 5, 4 (2010), e10298.Google ScholarGoogle ScholarCross RefCross Ref
  69. George A Miller. 1956. The magical number seven, plus or minus two: Some limits on our capacity for processing information.Psychological review 63, 2 (1956), 81.Google ScholarGoogle Scholar
  70. Lyle H Miller and Barry M Shmavonian. 1965. Replicability of two GSR indices as a function of stress and cognitive activity.Journal of personality and social psychology 2, 5 (1965), 753.Google ScholarGoogle Scholar
  71. Caitlin Mills, Igor Fridman, Walid Soussou, Disha Waghray, Andrew M Olney, and Sidney K D’Mello. 2017. Put your thinking cap on: detecting cognitive load using EEG during learning. In Proceedings of the seventh international learning analytics & knowledge conference. 80–89.Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. Leap MotioN. 2023. Leap MotioN. https://www.ultraleap.com/leap-motion-controller-whats-included/. [Online; accessed 14-Aug-2023].Google ScholarGoogle Scholar
  73. Julie Onton, Arnaud Delorme, and Scott Makeig. 2005. Frontal midline EEG dynamics during working memory. Neuroimage 27, 2 (2005), 341–356.Google ScholarGoogle ScholarCross RefCross Ref
  74. Fred Paas, Juhani E Tuovinen, Huib Tabbers, and Pascal WM Van Gerven. 2003. Cognitive load measurement as a means to advance cognitive load theory. Educational psychologist 38, 1 (2003), 63–71.Google ScholarGoogle Scholar
  75. Fred Paas, Juhani E Tuovinen, Huib Tabbers, and Pascal WM Van Gerven. 2003. Cognitive load measurement as a means to advance cognitive load theory. Educational psychologist 38, 1 (2003), 63–71.Google ScholarGoogle Scholar
  76. Satu Palva and J Matias Palva. 2007. New vistas for α -frequency band oscillations. Trends in neurosciences 30, 4 (2007), 150–158.Google ScholarGoogle Scholar
  77. W Scott Peavler. 1974. Pupil size, information overload, and performance differences. Psychophysiology 11, 5 (1974), 559–566.Google ScholarGoogle ScholarCross RefCross Ref
  78. Amy L Proskovec, Elizabeth Heinrichs-Graham, and Tony W Wilson. 2019. Load modulates the alpha and beta oscillatory dynamics serving verbal working memory. NeuroImage 184 (2019), 256–265.Google ScholarGoogle ScholarCross RefCross Ref
  79. William L Romine, Noah L Schroeder, Josephine Graft, Fan Yang, Reza Sadeghi, Mahdieh Zabihimayvan, Dipesh Kadariya, and Tanvi Banerjee. 2020. Using Machine Learning to Train a Wearable Device for Measuring Students’ Cognitive Load during Problem-Solving Activities Based on Electrodermal Activity, Body Temperature, and Heart Rate: Development of a Cognitive Load Tracker for Both Personal and Classroom Use. Sensors 20, 17 (2020), 4833.Google ScholarGoogle ScholarCross RefCross Ref
  80. Frédéric Roux and Peter J Uhlhaas. 2014. Working memory and neural oscillations: alpha–gamma versus theta–gamma codes for distinct WM information?Trends in cognitive sciences 18, 1 (2014), 16–25.Google ScholarGoogle Scholar
  81. Joanna EM Scanlon, Nadine Svenja Josée Jacobsen, Marike C Maack, and Stefan Debener. 2021. Does the electrode amplification style matter? A comparison of active and passive EEG system configurations during standing and walking. European Journal of Neuroscience 54, 12 (2021), 8381–8395.Google ScholarGoogle ScholarCross RefCross Ref
  82. Cornelia Setz, Bert Arnrich, Johannes Schumm, Roberto La Marca, Gerhard Tröster, and Ulrike Ehlert. 2009. Discriminating stress from cognitive load using a wearable EDA device. IEEE Transactions on information technology in biomedicine 14, 2 (2009), 410–417.Google ScholarGoogle ScholarDigital LibraryDigital Library
  83. Yu Shi, Natalie Ruiz, Ronnie Taib, Eric Choi, and Fang Chen. 2007. Galvanic skin response (GSR) as an index of cognitive load. In CHI’07 extended abstracts on Human factors in computing systems. 2651–2656.Google ScholarGoogle Scholar
  84. Shimmer. 2023. Leap MotioN. https://shimmersensing.com/product/consensys-gsr-development-kits. [Online; accessed 14-Aug-2023].Google ScholarGoogle Scholar
  85. shimmer api. 2023. shimmer-api. https://shimmersensing.com/product/shimmercapture-shimmer-c-api/. [Online; accessed 14-Aug-2023].Google ScholarGoogle Scholar
  86. EH Siegel, J Wei, A Gomes, M Oliviera, P Sundaramoorthy, K Smathers, M Vankipuram, S Ghosh, H Horii, J Bailenson, 2021. HP Omnicept cognitive load database (HPO-CLD)–developing a multimodal inference engine for detecting real-time mental workload in VR. Technical Report. Technical Report.Google ScholarGoogle Scholar
  87. Tytus Sosnowski, Beata Krzywosz-Rynkiewicz, and Joanna Roguska. 2004. Program running versus problem solving: Mental task effect on tonic heart rate. Psychophysiology 41, 3 (2004), 467–475.Google ScholarGoogle ScholarCross RefCross Ref
  88. Alexis D Souchet, Stéphanie Philippe, Domitile Lourdeaux, and Laure Leroy. 2022. Measuring visual fatigue and cognitive load via eye tracking while learning with virtual reality head-mounted displays: A review. International Journal of Human–Computer Interaction 38, 9 (2022), 801–824.Google ScholarGoogle ScholarCross RefCross Ref
  89. John Sweller. 1994. Cognitive load theory, learning difficulty, and instructional design. Learning and instruction 4, 4 (1994), 295–312.Google ScholarGoogle Scholar
  90. John Sweller. 2011. Cognitive load theory. In Psychology of learning and motivation. Vol. 55. Elsevier, 37–76.Google ScholarGoogle Scholar
  91. John Sweller, Paul Ayres, and Slava Kalyuga. 2011. Measuring cognitive load. In Cognitive load theory. Springer, 71–85.Google ScholarGoogle Scholar
  92. John Sweller and Paul Chandler. 1991. Evidence for cognitive load theory. Cognition and instruction 8, 4 (1991), 351–362.Google ScholarGoogle Scholar
  93. Pascal WM Van Gerven, Fred Paas, Jeroen JG Van Merriënboer, and Henk G Schmidt. 2004. Memory load and the cognitive pupillary response in aging. Psychophysiology 41, 2 (2004), 167–174.Google ScholarGoogle ScholarCross RefCross Ref
  94. Robert M Yerkes, John D Dodson, 1908. The relation of strength of stimulus to rapidity of habit-formation. Punishment: Issues and experiments (1908), 27–41.Google ScholarGoogle Scholar
  95. Hong Zeng, Yuanzi Sun, Guozheng Xu, Changcheng Wu, Aiguo Song, Baoguo Xu, Huijun Li, and Cong Hu. 2019. The advantage of low-delta electroencephalogram phase feature for reconstructing the center-out reaching hand movements. Frontiers in Neuroscience 13 (2019), 480.Google ScholarGoogle ScholarCross RefCross Ref
  96. Xiao Zhang, Yongqiang Lyu, Xin Hu, Ziyue Hu, Yuanchun Shi, and Hao Yin. 2018. Evaluating photoplethysmogram as a real-time cognitive load assessment during game playing. International Journal of Human–Computer Interaction 34, 8 (2018), 695–706.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Cognitive Load Measurement with Physiological Sensors in Virtual Reality during Physical Activity

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      VRST '23: Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology
      October 2023
      542 pages
      ISBN:9798400703287
      DOI:10.1145/3611659

      Copyright © 2023 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 9 October 2023

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate66of254submissions,26%

      Upcoming Conference

      VRST '24
    • Article Metrics

      • Downloads (Last 12 months)278
      • Downloads (Last 6 weeks)41

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format