Abstract
Virtual Reality (VR) has gained popularity in educational fields enabling new learning possibilities. In the implementation process, VR could improve learning by increasing positive affective and cognitive processing, whereas VR also could hurt learning by increasing distraction and leading to poorer learning outcomes. Thus, understanding the cognitive processes that occur during the learning process using VR can provide sufficient information to unlock the learning potential. This research aims to determine cognitive processes through brain waves when participants perform VR learning and reading activity. Cognitive processing during VR learning was compared to the reading process because reading was a fundamental activity of the learning process and one of the most common ways of accessing knowledge. Brain Wave data on attention and meditation were collected using the Mindset EEG headset developed by Neurosky Inc., in which participants read the material and experienced VR simulation regarding the weightlessness concept. The results show that reading activity has a higher attention level than VR learning due to the many learning modalities in VR learning causing cognitive overload. Regarding the level of meditation, the brain activities indicate that the reading activity and VR learning activities have the same level of meditation. One of the most plausible explanations is the absence of cybersickness in VR learning. Moreover, according to the trend analysis of the brain wave activity, VR learning can possibly enhance the learning process in specific scenarios, such as when participants complete their mission in the VR simulation and start free exploration and when participants see something that they thought was extraordinarily embodied in VR. Besides that, VR learning can also distort the learning process, such as when participants are confused during instruction about which path to take and what the next step is, then cause distraction in learning.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The authors confirm that the data supporting the findings of this study are available within https://doi.org/10.17605/osf.io/9fa75. Derived data supporting the findings of this study are available from the corresponding author Dr. Chih-Hung Lin on request.
References
Alameh, A. (2019). Uniform circular motion of a spaceship and its relation to free fall. The Physics Teacher, 57(7), 478–479. https://doi.org/10.1119/1.5126829
Albus, P., Vogt, A., & Seufert, T. (2021). Signaling in virtual reality influences learning outcome and cognitive load. Computers and Education, 166, 104154. https://doi.org/10.1016/j.compedu.2021.104154
Baceviciute, S., Terkildsen, T., & Makransky, G. (2021). Remediating learning from non-immersive to immersive media: Using EEG to investigate the effects of environmental embeddedness on reading in virtual reality. Computers & Education, 164, 104122. https://doi.org/10.1016/j.compedu.2020.104122
Baceviciute, S., Lucas, G., Terkildsen, T., & Makransky, G. (2022). Investigating the redundancy principle in immersive virtual reality environments: An eye-tracking and EEG study. Journal of Computer Assisted Learning, 38(1), 120–136. https://doi.org/10.1111/jcal.12595
Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191. https://doi.org/10.1037/0033-295X.84.2.191
Behrendt, M., & Franklin, T. (2014). A review of research on school field trips and their value in education. International Journal of Environmental and Science Education, 9(3), 235–245.
Bennett, J. A., & Saunders, C. P. (2019). A virtual tour of the cell: Impact of virtual reality on student learning and engagement in the STEM classroom. Journal of Microbiology & Biology Education, 20(2), 20. https://doi.org/10.1128/jmbe.v20i2.1658
Broadbent, D. E. (1958). Perception and communication. Pergamon.
Buchin, Z. L., & Mulligan, N. W. (2019). The testing effect under divided attention: Educational application. Journal of Experimental Psychology: Applied, 25(4), 558. https://doi.org/10.1037/xap0000230
Cao, L., Lin, J., & Li, N. (2019). A virtual reality based study of indoor fire evacuation after active or passive spatial exploration. Computers in Human Behavior, 90, 37–45. https://doi.org/10.1016/j.chb.2018.08.041
Cardoso-Leite, P., & Bavelier, D. (2014). Video game play, attention, and learning: How to shape the development of attention and influence learning? Current Opinion in Neurology, 27(2), 185–191. https://doi.org/10.1097/wco.0000000000000077
Chen, C. M., & Lin, Y. J. (2016). Effects of different text display types on reading comprehension, sustained attention and cognitive load in mobile reading contexts. Interactive Learning Environments, 24(3), 553–571. https://doi.org/10.1080/10494820.2014.891526
Chen, C. M., & Wu, C. H. (2015). Effects of different video lecture types on sustained attention, emotion, cognitive load, and learning performance. Computers and Education, 80, 108–121. https://doi.org/10.1016/j.compedu.2014.08.015
Cheng, K.-H. (2022). Teachers’ perceptions of exploiting immersive virtual field trips for learning in primary education. Journal of Research on Technology in Education, 54(3), 438–455. https://doi.org/10.1080/15391523.2021.1876576
Cheng, L. K., Chieng, M. H., & Chieng, W. H. (2014). Measuring virtual experience in a three-dimensional virtual reality interactive simulator environment: A structural equation modeling approach. Virtual Reality, 18(3), 173–188. https://doi.org/10.1007/s10055-014-0244-2
Chun, M. M., & Turk-Browne, N. B. (2007). Interactions between attention and memory. Current Opinion in Neurobiology, 17(2), 177–184. https://doi.org/10.1016/j.conb.2007.03.005
Dale, E. (1969). Audiovisual methods in teaching. Dryden Press.
Diels, C., & Howarth, P. A. (2013). Frequency characteristics of visually induced motion sickness. Human Factors, 55(3), 595–604. https://doi.org/10.1177/0018720812469046
Driver, J. (2001). A selective review of selective attention research from the past century. British Journal of Psychology, 92(1), 53–78. https://doi.org/10.1348/000712601162103
Duval, E. (2011). Attention please! Learning analytics for visualization and recommendation. International Conference on Learning Analytics and Knowledge, 9–17. https://doi.org/10.1145/2090116.2090118
Gao, K.-P., Yang, H.-J., Wang, X.-L., Yang, B., & Liu, J.-Q. (2018). Soft pin-shaped dry electrode with bristles for EEG signal measurements. Sensors and Actuators a: Physical, 283, 348–361. https://doi.org/10.1016/j.sna.2018.09.045
Georgiou, H., & Sharma, M. D. (2014). Does using active learning in thermodynamics lectures improve students’ conceptual understanding and learning experiences? European Journal of Physics, 36(1), 15020. https://doi.org/10.1088/0143-0807/36/1/015020
Goncharova, I. I., McFarland, D. J., Vaughan, T. M., & Wolpaw, J. R. (2003). EMG contamination of EEG: Spectral and topographical characteristics. Clinical Neurophysiology, 114(9), 1580–1593. https://doi.org/10.1016/s1388-2457(03)00093-2
Hedberg, J., & Alexander, S. (1994). Virtual reality in education: Defining researchable issues. Educational Media International, 31(4), 214–220. https://doi.org/10.1080/0952398940310402
Höller, Y. (2021). Quantitative EEG in cognitive neuroscience. Brain Sciences, 11(4), 10–12. https://doi.org/10.3390/brainsci11040517
James, K. H., Humphrey, G. K., Vilis, T., Corrie, B., Baddour, R., & Goodale, M. A. (2002). “Active” and “passive” learning of three-dimensional object structure within an immersive virtual reality environment. Behavior Research Methods, Instruments, & Computers, 34(3), 383–390. https://doi.org/10.3758/bf03195466
Jin, K. S., Lim, J. J., Byeon, J. G., Kim, E., & Park, J. (2013). Active dry sensor module for measurement of bioelectricity (Patent No. US8548555B2). NeuroSky. https://patents.google.com/patent/US8548555B2/en
Ko, L.-W., Komarov, O., Hairston, W. D., Jung, T.-P., & Lin, C.-T. (2017). Sustained attention in real classroom settings: An EEG study. Frontiers in Human Neuroscience, 11, 388. https://doi.org/10.3389/fnhum.2017.00388
Krakowka, A. R. (2012). Field trips as valuable learning experiences in geography courses. Journal of Geography, 111(6), 236–244. https://doi.org/10.1080/00221341.2012.707674
Lai, C. H., Liu, M. C., Liu, C. J., & Huang, Y. M. (2016). Using positive visual stimuli to lighten the online learning experience through in class questioning. International Review of Research in Open and Distance Learning, 17(1), 23–41. https://doi.org/10.19173/irrodl.v17i1.2114
LaRocco, J., Le, M. D., & Paeng, D. G. (2020). A systemic review of available low-cost EEG headsets used for drowsiness detection. Frontiers in Neuroinformatics, 14, 1–14. https://doi.org/10.3389/fninf.2020.553352
Lau-Zhu, A., Lau, M. P. H., & McLoughlin, G. (2019). Mobile EEG in research on neurodevelopmental disorders: Opportunities and challenges. Developmental Cognitive Neuroscience, 36, 100635.
Liao, C.-Y., Chen, R.-C., & Liu, Q.-E. (2018). Detecting attention and meditation EEG utilized deep learning. In Recent Advances in Intelligent Information Hiding and Multimedia Signal Processing (pp. 204–211). Springer. https://doi.org/10.1007/978-3-030-03748-2_25
Lin, C.-H., Wu, W.-H., & Lee, T.-N. (2022). Using an online learning platform to show students’ achievements and attention in the video lecture and online practice learning environments. Educational Technology & Society, 25(1), 155–165.
Liou, W.-K., & Chang, C.-Y. (2018). Virtual reality classroom applied to science education. International Scientific-Professional Conference on Information Technology, 1–4. https://doi.org/10.1109/SPIT.2018.8350861
Liu, N.-H., Chiang, C.-Y., & Chu, H.-C. (2013). Recognizing the degree of human attention using EEG signals from mobile sensors. Sensors, 13(8), 10273–10286. https://doi.org/10.3390/s130810273
Magnopus. (2019). Mission: ISS. Oculus. http://missioniss.magnopus.com/
Makransky, G., Terkildsen, T. S., & Mayer, R. E. (2019). Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learning and Instruction, 60, 225–236. https://doi.org/10.1016/j.learninstruc.2017.12.007
Mnguni, L. E. (2014). The theoretical cognitive process of visualization for science education. Springerplus, 3, 1–9. https://doi.org/10.1186/2193-1801-3-184
Mouratidis, K., & Hassan, R. (2020). Contemporary versus traditional styles in architecture and public space: A virtual reality study with 360-degree videos. Cities, 97, 102499. https://doi.org/10.1016/j.cities.2019.102499
Napoli, M. (2004). Mindfulness training for teachers: A pilot program. Complementary Health Practice Review, 9(1), 31–42. https://doi.org/10.1177/1076167503253435
NASA. (2017). What is microgravity? National Aeronautics and Space Administration. https://www.nasa.gov/audience/forstudents/5-8/features/nasa-knows/what-is-microgravity-58.html
NASA. (2022). What is the international space station? National Aeronautics and Space Administration. https://www.nasa.gov/audience/forstudents/5-8/features/nasa-knows/what-is-the-iss-58.html
NeuroSky. (n.d.). Biosensors or EEG Headsets. NeuroSky: Body and Mind. Quantified. http://neurosky.com/biosensors/eeg-sensor/biosensors/
NeuroSky. (2009). Brain wave signal (EEG) of NeuroSky Inc. NeuroSky: Brain-Computer Interface Technologies.
Nissim, Y., & Weissblueth, E. (2017). Virtual reality (VR) as a source for self-efficacy in teacher training. International Education Studies, 10(8), 52–59.
Parong, J., & Mayer, R. E. (2021). Cognitive and affective processes for learning science in immersive virtual reality. Journal of Computer Assisted Learning, 37(1), 226–241. https://doi.org/10.1111/jcal.12482
Pirker, J., Lesjak, I., Parger, M., & Gütl, C. (2018). An educational physics laboratory in mobile versus room scale virtual reality - A comparative study. Lecture Notes in Networks and Systems, 22, 1029–1043. https://doi.org/10.1007/978-3-319-64352-6_95
Rebolledo-Mendez, G., Dunwell, I., Martínez-Mirón, E. A., Vargas-Cerdán, M. D., Freitas, S. de, Liarokapis, F., & García-Gaona, A. R. (2009). Assessing Neurosky’s usability to detect attention levels in an assessment exercise. In Human-computer interaction. New trends. HCI 2009. Lecture notes in computer science (pp. 149–158). Springer. https://doi.org/10.1007/978-3-642-02574-7_17
Rieiro, H., Diaz-Piedra, C., Morales, J. M., Catena, A., Romero, S., Gonzalez, J. R., Fuentes, L. J., & Di Stasi, L. L. (2019). Validation of electroencephalographic recordings obtained with a consumer-grade, single dry electrode, low-cost device: A comparative study. Sensors (switzerland), 19(12), 1–18. https://doi.org/10.3390/s19122808
Sagnier, C., Loup-Escande, E., Lourdeaux, D., Thouvenin, I., & Valléry, G. (2020). User acceptance of virtual reality: An extended technology acceptance model. International Journal of Human-Computer Interaction, 36(11), 993–1007. https://doi.org/10.1080/10447318.2019.1708612
Sarter, M., Givens, B., & Bruno, J. P. (2001). The cognitive neuroscience of sustained attention: Where top-down meets bottom-up. Brain Research Reviews, 35(2), 146–160. https://doi.org/10.1016/s0165-0173(01)00044-3
Smith, S. P., & Burd, E. L. (2019). Response activation and inhibition after exposure to virtual reality. Array, 3, 100010. https://doi.org/10.1016/j.array.2019.100010
Smith-Walters, C., Hargrove, K., & Ervin, B. (2014). Extending the classroom: Tips for planning successful field trips. Science and Children, 51(9), 74.
Stanney, K. M., Kingdon, K. S., & Kennedy, R. S. (2002). Dropouts and aftereffects: Examining general accessibility to virtual environment technology. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 46(26), 2114–2118.
Stockman, C. (2020). Can a technology teach meditation? Experiencing the EEG headband interaxon muse as a meditation guide. International Journal of Emerging Technologies in Learning (IJET), 15(8), 83–99.
Sun, J. C. Y. (2014). Influence of polling technologies on student engagement: An analysis of student motivation, academic performance, and brainwave data. Computers and Education, 72, 80–89. https://doi.org/10.1016/j.compedu.2013.10.010
Ülker, B., Tabakcıoğlu, M. B., Çizmeci, H., & Ayberkin, D. (2017). Relations of attention and meditation level with learning in engineering education. International Conference on Electronics, Computers and Artificial Intelligence, 1–4. https://doi.org/10.1109/ecai.2017.8166407
Villena-Taranilla, R., Tirado-Olivares, S., Cózar-Gutiérrez, R., & González-Calero, J. A. (2022). Effects of virtual reality on learning outcomes in K-6 education: A meta-analysis. Educational Research Review, 35, 100434. https://doi.org/10.1016/j.edurev.2022.100434
Wager, T. D., Jonides, J., & Reading, S. (2004). Neuroimaging studies of shifting attention: A meta-analysis. NeuroImage, 22(4), 1679–1693. https://doi.org/10.1016/j.neuroimage.2004.03.052
Wang, C. C., & Hsu, M. C. (2014). An exploratory study using inexpensive electroencephalography (EEG) to understand flow experience in computer-based instruction. Information and Management, 51(7), 912–923. https://doi.org/10.1016/j.im.2014.05.010
Weech, S., Kenny, S., & Barnett-Cowan, M. (2019). Presence and cybersickness in virtual reality are negatively related: A review. Frontiers in Psychology, 10, 1–19. https://doi.org/10.3389/fpsyg.2019.00158
Wei, C. C., & Ma, M. Y. (2017). Influences of visual attention and reading time on children and adults. Reading and Writing Quarterly, 33(2), 97–108. https://doi.org/10.1080/10573569.2015.1092100
Xu, J., & Zhong, B. (2018). Review on portable EEG technology in educational research. Computers in Human Behavior, 81, 340–349. https://doi.org/10.1016/j.chb.2017.12.037
Yang, F., & Goh, Y. M. (2022). VR and MR technology for safety management education: An authentic learning approach. Safety Science, 148, 1–12. https://doi.org/10.1016/j.ssci.2021.105645
Funding
This work is supported by the National Science and Technology Council of Taiwan under grant 110-2511-H-415-002 and 109-2511-H-415-004.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethics approval
Human rights statements and informed consent: All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1964 and its later amendments.
• All participants in the research were purely voluntary and understood the process in which they were to be engaged. The participants’ data were anonymized and kept confidential in the research.
• All quantitative data sets of this research, which are anonymized, can be made available by individual application directly to the authors. The applicant should clearly describe where and how they will use the data sets in their contact letter. The applicant should also cite the source of the data sets in their ongoing papers.
• As an expert scientist and along with co-authors of the concerned field, the paper has been submitted with full responsibility, following the due ethical procedure, and there is no duplicate publication, fraud, plagiarism, or concerns about animal or human experimentation.
Consent to participate
Additional informed consent was obtained from all individual participants for whom identifying information is included in this article.
Consent for publication
The Author warrants that the Work has not been published before in any form except as a preprint, that the Work is not being concurrently submitted to and is not under consideration by another publisher, that the persons listed above are listed in the proper order and that no author entitled to credit has been omitted, and generally that the Author has the right to make the grants made to the Publisher complete and unencumbered. The Author also warrants that the Work does not libel anyone, infringe anyone’s copyright, or otherwise violate anyone’s statutory or common law rights.
Conflicts of interest/Competing interests
We wish to confirm that there are no known conflicts of interest associated with this publication and there has been no significant financial support for this work that could have influenced its outcome.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Sumardani, D., Lin, CH. Cognitive processes during virtual reality learning: A study of brain wave. Educ Inf Technol 28, 14877–14896 (2023). https://doi.org/10.1007/s10639-023-11788-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-023-11788-4