Abstract
Recent studies are increasingly using brain-imaging techniques in the technology-enhanced learning (TEL) context to understand students' cognitive processes during technology-assisted learning, with the ultimate goal to improve students' outcomes in these environments. Given the importance of the promising impact of brain-imaging techniques in the technology-enhanced learning context, it is of utmost importance to analyze and investigate studies published in the intersection of these research areas. However, despite the growing interest in this promising research field, there is a lack of systematic literature review investigating how brain-imaging techniques have been applied in technology-enhanced learning environments. Therefore, this article presents a systematic literature review (SLR) using a well-accepted guideline to perform a rigorous study of the current literature to investigate, analyze, and understand how brain-imaging techniques have been applied in technology-enhanced learning contexts. This SLR considered studies published in nine academic databases that resulted in a total of 3910 studies that, after the selection process, were reduced to 37 studies (published during 2001–2019) for the final analysis. The studies' content analysis was used to classify the studies according to their objectives, brain-imaging techniques and devices used, educational levels, study domains, and studies outcomes. The main results indicate that i) most studies aim to use brain-imaging methods to measure/detect students' psychological processes while using educational technology to provide a personalized experience, ii) the most used brain-imaging technique in the studies is electroencephalogram, and iii) the most investigated study domain was Mathematics and Biology. Moreover, this article highlights some gaps found in the state-of-the-art and provides insights that can be used for future research.
Similar content being viewed by others
References
Aiello, N. C., Wolfle, L. M. (1980). A Meta-Analysis of Individualized Instruction in Science. Distributed by ERIC Clearinghouse, [Washington, D.C.].
Alhasan, K., Chen, L., & Chen, F. (2018). Mining Learning Styles for Personalised eLearning. In: IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation, 1175–1180. https://doi.org/10.1109/SmartWorld.2018.00204
Antonenko, P. D., van Gog, T., Paas, F. (2014). Implications of Neuroimaging for Educational Research. In: Handbook of Research on Educational Communications and Technology, Springer New York, New York, NY, pp 51–63. https://doi.org/10.1007/978-1-4614-3185-5
Arana-Llanes, J. Y., Gonzlez-Serna, G., Pineda-Tapia, R., Olivares-Peregrino, V., Ricarte-Trives, J. J., & Latorre-Postigo, J. M. (2018). Eeg lecture on recommended activities for the induction of attention and concentration mental states on e-learning students. Journal of Intelligent & Fuzzy Systems, 34(5), 3359-3371. https://doi.org/10.3233/JIFS-169517
Azcarraga, J., & Suarez, M. T. (2013). Recognizing Student Emotions Using Brainwaves and Mouse Behavior Data. Int J Distance Educ Technol, 11(2), 1–15. https://doi.org/10.4018/jdet.2013040101
Bamatraf, S., Hussain, M., Aboalsamh, H., Qazi, E. U. H., Malik, A. S., Amin, H. U., Mathkour, H., Muhammad, G., & Imran, H. M. (2016). A system for true and false memory prediction based on 2d and 3d educational contents and EEG brain signals. Computational Intelligence and Neuroscience, 2016, 1–11. https://doi.org/10.1155/2016/8491046
Bano, M., Zowghi, D., Kearney, M., Schuck, S., & Aubusson, P. (2018). Mobile learning for science and mathematics school education: A systematic review of empirical evidence. Computers and Education, 121, 30–58. https://doi.org/10.1016/j.compedu.2018.02.006
Basar, E. (1999). Brain Function and Oscillations. Springer Series in Synergetics, Springer Berlin Heidelberg, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-59893-7
Bauer, M., Bräuer, C., Schuldt, J., Niemann, M., & Krömker, H. (2019). Application of Wearable Technology for the Acquisition of Learning Motivation in an Adaptive E-Learning Platform. In T. Z. Ahram (Ed.), Advances in Human Factors in Wearable Technologies and Game Design (pp. 29–40). Springer International Publishing.
Çakır, M. P., Çakır, N. A., Ayaz, H., & Lee, F. J. (2015). An Optical Brain Imaging Study on the Improvements in Mathematical Fluency from Game-based Learning. In: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play, ACM, New York, NY, USA, CHI PLAY ’15, pp 209– 219. https://doi.org/10.1145/2793107.2793133
Çakır, M. P., Çakır, N. A., Ayaz, H., & Lee, F. J. (2016). Behavioral and neural effects of game-based learning on improving computational fluency with numbers: An optical brain imaging study. Zeitschrift Für Psychologie, 224(4), 297–302. https://doi.org/10.1027/2151-2604/a000267
Chaouachi, M., Jraidi, I., & Frasson, C. (2011). Modeling Mental Workload Using EEG Features for Intelligent Systems. In: Konstan J.A., Conejo R., Marzo J.L., Oliver N. (eds) User Modeling, Adaption and Personalization. UMAP 2011. Lecture Notes in Computer Science, 6787. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22362-4_5
Connolly, T. M., Boyle, E. A., MacArthur, E., Hainey, T., & Boyle, J. M. (2012). A systematic literature review of empirical evidence on computer games and serious games. Computers and Education, 59, 661–686. https://doi.org/10.1016/j.compedu.2012.03.004
Conrad, C., Bliemel, M. (2016). Psychophysiological measures of cognitive absorption and cognitive load in e-learning applications. In: International Conference on Information Systems, Dublin, Ireland
Corsi-Bunker, A. (2000). Guide to the Education System in United States. University of Minnesota, Minnesota.
Dalgarno, B., Kennedy, G., Bennett, S. (2006). Using fMRI to explore interactivity and cognition: A methodological case study. In: ASCILITE 2006 - The Australasian Society for Computers in Learning in Tertiary Education, 1, 189–198
Daucé, E., Proix, T., Ralaivola, L. (2015). Reward-based online learning in nonstationary environments: Adapting a P300-speller with a backspace key. In: 2015 International Joint Conference on Neural Networks (IJCNN), 1–8. https://doi.org/10.1109/IJCNN.2015.7280686
Elbaum, B., Vaughn, S., Tejero Hughes, M., & Watson Moody, S. (2000). How effective are one-to-one tutoring programs in reading for elementary students at risk for reading failure? A meta-analysis of the intervention research. Journal of Educational Psychology, 92(4), 605–619. https://doi.org/10.1037/0022-0663.92.4.605
Fincham, J. M., Anderson, J. R., Betts, S., Ferris, J. L. (2010). Using Neural Imaging and Cognitive Modeling to Infer Mental States while Using an Intelligent Tutoring System. In: Educational Data Mining 2010 - 3rd International Conference on Educational Data Mining, 51–60.
Ghiani, G., Manca, M., Patern`o, F. (2015). Dynamic User Interface Adaptation Driven by Physiological Parameters to Support Learning. In: Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, ACM, New York, NY, USA, EICS, 15, 158–163. https://doi.org/10.1145/2774225.2775081
Grand, K. F., Bruzi, A. T., Dyke, F. B., Godwin, M. M., Leiker, A. M., Thompson, A. G., Buchanan, T. L., Miller, M. W. (2015). Why self-controlled feedback enhances motor learning: Answers from electroencephalography and indices of motivation. Human Movement Science, 43, 23–32, https://doi.org/10.1016/j.humov.2015.06.013
Gruenewald, A., Kroenert, D., Poehler, J., Brueck, R,. Li, F., Littau, J., Schnieber, K., Piet, A., Grzegorzek, M., Kampling, H., Niehaves, B. (2018). Biomedical Data Acquisition and Processing to Recognize Emotions for Affective Learning. In: 2018 IEEE 18th International Conference on Bioinformatics and Bioengineering (BIBE), 126–132, https://doi.org/10.1109/BIBE.2018.00031
Gulko, E., Oleksk, M., Gomes, W., Ali, S., Mehta, H., Overby, P., Al-Mufti, F., & Rozenshtein, A. (2020). Mri brain findings in 126 patients with covid-19: initial observations from a descriptive literature review. American Journal of Neuroradiology, 41(12), 2199–2203.
Hatta, T. (2007). Handedness and the brain: a review of brain-imaging techniques. Magnetic Resonance in Medical Sciences, 6(2), 99–112.
Hew, K. F., & Cheung, W. S. (2014). Students’ and instructors’ use of massive open online courses (moocs): Motivations and challenges. Educational Research Review, 12, 45–58. https://doi.org/10.1016/j.edurev.2014.05.001
Horak, V. M. (1981) A Meta-Analysis of Research Findings on Individualized Instruction in Mathematics. The Journal of Educational Research, 74(4), 249– 253. https://doi.org/10.1080/00220671.1981.10885318
Hu, B., Li, X., Sun, S., & Ratcliffe, M. (2018). Attention Recognition in EEG-Based Affective Learning Research Using CFS+KNN Algorithm. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 15(1), 38–45. https://doi.org/10.1109/TCBB.2016.2616395
Indriasari, T. D., Luxton-Reilly, A., & Denny, P. (2020). Gamification of student peer review in education: A systematic literature review. Education and Information Technologies, 25(6), 5205–5234. https://doi.org/10.1007/s10639-020-10228-x
Jausovec, N. (2001). Differences in EEG Power and Coherence Measures Related to the Type of Presentation: Text versus Multimedia. Journal of Educational Computing Research, 25, 177–195. https://doi.org/10.2190/YDWY-U3FJ-4LY4-LYND
Kalagi, S., Machado, J., Carvalho, V., Soares, F., Matos, D. (2018). Brain computer interface systems using non-invasive electroencephalogram signal: A literature review. In: 2017 International Conference on Engineering, Technology and Innovation: Engineering, Technology and Innovation Management Beyond 2020: New Challenges, New Approaches, ICE/ITMC 2017 - Proceedings, Institute of Electrical and Electronics Engineers Inc 2018-January, 1578–1583. https://doi.org/10.1109/ICE.2017.8280071
Kang, J. S., Ojha, A., Lee, M. (2015). Development of Intelligent Learning Tool for Improving Foreign Language Skills Based on EEG and Eye Tracker. In: Proceedings of the 3rd International Conference on Human-Agent Interaction, ACM, New York, NY, USA, HAI ’15, 121–126. https://doi.org/10.1145/2814940
Kaszuba, K., Kostek, B. (2012). Employing a Biofeedback Method Based on Hemispheric Synchronization in Effective Learning. In: Hippe ZS, Kulikowski JL, Mroczek T (eds) Human Computer Systems Interaction: Backgrounds and Applications 2: Part 2, Springer Berlin Heidelberg, Berlin, Heidelberg, 295–309. https://doi.org/10.1007/978-3-642-23172-8
Keppell, M., Suddaby, G., Hard N. (2015). Assuring best practice in technology enhanced learning environments Research in Learning Technology, 23 https://doi.org/10.3402/rlt.v23.25728
Keum, N., Lee T, Lee, J., In, H. P. (2018). Measuring the Degree of Content Immersion in a Non-experimental Environment Using a Portable EEG Device. Journal of Information Processing Systems, 14(4), 1049–1061
Kitchenham, B., & Charters, S. (2007). Guidelines for performing Systematic Literature Reviews in Software Engineering. Keele University and Durham University Joint Report.
Kulik, J. A., & Fletcher, J. D. (2016). Effectiveness of intelligent tutoring systems. Review of Educational Research, 86(1), 42–78. https://doi.org/10.3102/0034654315581420
Kumar, B. A., & Chand, S. S. (2019). Mobile learning adoption: A systematic review. Education and Information Technologies, 24(1), 471–487. https://doi.org/10.1007/s10639-018-9783-6
Kumar, B. A., & Sharma, B. (2020). Context aware mobile learning application development: A systematic literature review. Education and Information Technologies, 25(3), 2221–2239. https://doi.org/10.1007/s10639-019-10045-x
Landowska, A. (2014). Affective learning manifesto - 10 years later. In: Proceedings of the European Conference on e-Learning (ECEL), 281–288.
Law, N., Niederhauser, D., Christensen, R., & Shear, L. (2016). A multilevel system of quality technology-enhanced learning and teaching indicators. Journal of Educational Technology & Society, 19(3), 72–83.
Li, X., Zhao, Q., Hu, B., Liu, L., Peng, H., Qi, Y., Mao, C., Fang, Z., & Liu, Q. (2010). Improve Affective Learning with EEG Approach. Computing and Informatics, 29, 557–570.
Li, Y., Li, X., Ratcliffe, M., Liu, L., Qi, Y., Liu, Q. (2011). A Real-time EEG-based BCI System for Attention Recognition in Ubiquitous Environment. In: Proceedings of 2011 International Workshop on Ubiquitous Affective Awareness and Intelligent Interaction, ACM, New York, NY, USA, UAAII ’11, pp 33–40, https://doi.org/10.1145/2030092.2030099
Lin, F. R, Kao, C. M. (2018). Mental effort detection using EEG data in E-learning contexts. Computers & Education, 122, 63–79, https://doi.org/10.1016/j.compedu.2018.03.020
Lu, W., Dong, K., Cui, D., Jiao, Q., & Qiu, J. (2019). Quality assurance of human functional magnetic resonance imaging: a literature review. Quantitative Imaging in Medicine and Surgery, 9(6):1147-1162. https://doi.org/10.21037/qims.2019.04.18
Macaulay, M., & Edmonds, E. (2004). Does Frontal EEG Beta Have Application in Anxiety Monitoring during Computer-Based Learning? Journal of Educational Computing Research, 30(3), 229–241. https://doi.org/10.2190/UVLG-BKX0-J9GA-J3H4
Mailhot, T., Lavoie, P., Maheu-Cadotte, M. A., Fontaine, G., Cournoyer, A., Côté, J., Dupuis, F., Karsenti, T., & Cossette, S. (2018). Using a Wireless Electroencephalography Device to Evaluate E-Health and E-Learning Interventions. Nursing Research, 67, 43–48. https://doi.org/10.1097/NNR.0000000000000260
Mikropoulos, T. (2001). Brain Activity on Navigation in Virtual Environments. Journal of Educational Computing Research, 24(1), 1–12. https://doi.org/10.2190/D1W3-Y15D-4UDW-L6C9
Muhammad, G., Hussain, M., Al-Hammadi, M., Aboalsamh, H., Mathkour, H., Malik, A. (2016). Short-term and long-term memory analysis of learning using 2D and 3D educational contents. Behaviour & Information Technology. 1–10. https://doi.org/10.1080/0144929X.2016.1212094
Ng, B., Ong, A. K. K. (2018). Neuroscience and digital learning environment in universities: What do current research tell us? Journal of the Scholarship of Teaching and Learning, 18(3). https://doi.org/10.14434/josotl.v18i3.22651
Ni, Z., Yuksel, A. C., Ni, X., Mandel, M. I,, Xie, L. (2017). Confused or Not Confused?: Disentangling Brain Activity from EEG Data Using Bidirectional LSTM Recurrent Neural Networks. In: Proceedings of the 8th ACM International Conference on Bioinformatics, Computational Biology,and Health Informatics, ACM, New York, NY, USA, ACM-BCB ’17, 241–246. https://doi.org/10.1145/3107411.3107513
Oliveira, W. (2019). Towards automatic flow experience identification in educational systems. In: Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts - CHI PLAY '19 Extended Abstracts, ACM Press, 41–46. https://doi.org/10.1145/3341215.3356336
Oliveira, W., & Bittencourt, I. I. (2019). Tailored Gamification to Educational Technologies. Springer Singapore. https://doi.org/10.1007/978-981-32-9812-5
Oliveira, W., Toda, A., Toledo, P., Shi, L., Vassileva, J., Bittencourt, I. I., Isotani, S. (2020) Does tailoring gamified educational systems matter? the impact on students' flow experience. In: Proceedings of the 53rd Hawaii International Conference on System Sciences, Hawaii International Conference on System Sciences, 1226–1235. https://doi.org/10.24251/hicss.2020.152
Pan, C. T., Chang, W. H., Kumar, A., Singh, S. P., Kaushik, A. C., Sharma, J., Long, Z. J., Wen, Z. H., Mishra, S. K., Yen, C. K., Chaudhary, R. K., & Shiue, Y. L. (2019). Nanoparticles-mediated Brain Imaging and Disease Prognosis by Conventional as well as Modern Modal Imaging Techniques: a Comparison. Current Pharmaceutical Design, 25(24), 2637–2649. https://doi.org/10.2174/1381612825666190709220139
Racine, E., Bar-Ilan, O., Illes, J. (2006). Brain imaging: A decade of coverage in the print media. Science Communication, 28(1), 122–143. https://doi.org/10.1177/1075547006291990
Samah, N., Shámeri, A. Z., Daliman, S., Safri, N., Zalihah, Qusai, S. (2018). Using Electroencephalogram Signals to Determine Differences in Brain Functional Connectivity During Game-Based Problem Solving Task. In: International Conference on BioSignal Analysis, Processing and Systems, Sarawak, Malaysia, 7–12. https://doi.org/10.1109/ICBAPS.2018.8527422
She, H. C., Jung, T. P., Chou, W. C., Huang, L. Y., Wang, C. Y., & Lin, G. Y. (2012). EEG Dynamics Reflect the Distinct Cognitive Process of Optic Problem Solving. PLoS ONE, 7(7), e40731. https://doi.org/10.1371/journal.pone.0040731
Shen, F. X., Wolf, S. M., Gonzalez, R. G., Garwood, M. (2020). Ethical issues posed by field research using highly portable and cloud-enabled neuroimaging. Neuron, 105, 771–775, https://doi.org/10.1016/j.neuron.2020.01.041
Soltanlou, M., Jung, S., Roesch, S., Ninaus, M., Brandelik, K., Heller, J., Grust, T., Nuerk, H. C, Moeller. K. (2017) Behavioral and neurocognitive evaluation of a web-platform for game-based learning of orthography and numeracy. In: Informational Environments: Effects of use, Effective Designs, Springer International Publishing, 149–176. https://doi.org/10.1007/978-3-319-64274-1
Soltanlou, M., Sitnikova, M. A., Nuerk, H. C, Dresler, T. (2018). Applications of Functional Near-Infrared Spectroscopy (fNIRS) in Studying Cognitive Development: The Case of Mathematics and Language. Frontiers in Psychology, 9, 277. https://doi.org/10.3389/fpsyg.2018.00277
Sood, S Singh, D. K. (2018). An Optical-Fog assisted EEG-based virtual reality framework for enhancing E-learning through educational games. Computer Applications in Engineering Education, 26 https://doi.org/10.1002/cae.21965
Spüler, M., Walter, C., Rosenstiel, W., Gerjets, P., Moeller, K., & Klein, E. (2016). EEG based prediction of cognitive workload induced by arithmetic: a step towards online adaptation in numerical learning. ZDM, 48(3), 267–278. https://doi.org/10.1007/s11858-015-0754-8
Subhash, S., & Cudney, E. A. (2018). Gamified learning in higher education: A systematic review of the literature. Computers in Human Behavior, 87, 192–206. https://doi.org/10.1016/j.chb.2018.05.028
Sung, Y. T., Yang, J. M., & Lee, H. Y. (2017). The effects of mobile-computer-supported collaborative learning: Meta-analysis and critical synthesis. Review of Educational Research, 87(4), 768–805. https://doi.org/10.3102/0034654317704307
Tahmassebi, A., Gandomi, A., Meyer-Base, A. (2018). An Evolutionary Online Framework for MOOC Performance Using EEG Data. In: IEEE Congress on Evolutionary Computation, 1–8. https://doi.org/10.1109/CEC.2018.8477862
Tenório, T., Bittencourt, I. I., Isotani, S., Pedro, A., & Ospina, P. (2016). A gamified peer assessment model for on-line learning environments in a competitive context. Computers in Human Behavior, 64, 247–263. https://doi.org/10.1016/j.chb.2016.06.049
Umezawa, K., Saito, T., Ishida, T., Nakazawa, M., & Hirasawa, S. (2018). Learning State Estimation Method by Browsing History and Brain Waves During Programming Language Learning. In H. Adeli, L. P. Reis, & S. Costanzo (Eds.), Rocha (pp. 1307–1316). Trends and Advances in Information Systems and Technologies.
Wang, C. C., Hsu, M. C. (2014). An exploratory study using inexpensive electroencephalography (EEG) to understand flow experience in computer-based instruction. Information & Management, 51(7), 912–923. https://doi.org/10.1016/j.im.2014.05.010
Wang, H., Li, Y., Hu, X., Yang, Y., Meng, Z., & Chang, K. M. (2013). Using EEG to improve massive open online courses feedback interaction. CEUR Workshop Proceedings, 1009, 59–66.
White, T., Blok, E., & Calhoun, V. D. (2020). Data sharing and privacy issues in neuroimaging research: Opportunities, obstacles, challenges, and monsters under the bed. Human Brain Mapping. https://doi.org/10.1002/hbm.25120
Schanzenbach, D. W., (2012). Limitations of Experiments in Education Research. Education Finance and Policy, 7, 1–14. https://doi.org/10.1162/EDFP_a_00063
Wohlin, C., Runeson, P., Hst, M., Ohlsson, M. C., Regnell, B., & Wessln, A. (2012). Experimentation in Software Engineering. Springer Publishing Company.
Xue, G., Chen, C., Lu, Z. L., Dong, Q. (2010). Brain Imaging Techniques and Their Applications in Decision-Making Research. Acta Psychologica Sinica, 42(1), 120–137. https://doi.org/10.3724/SP.J.1041.2010.00120
Zydney, J. M., & Warner, Z. (2016). Mobile apps for science learning: Review of research. Computers and Education, 94, 1–17. https://doi.org/10.1016/j.compedu.2015.11.001
Acknowledgements
This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior—Brasil (CAPES)—Finance Code 001. This study was also financed in part by São Paulo Research Foundation (FAPESP), Project: 2018/07688-1.
Author information
Authors and Affiliations
Contributions
Kamilla Tenório: Conceptualization, Methodology, Formal analysis, Investigation, Data Curation, Writing, Visualization. Emanuel Pereira: Formal analysis, Data Curation. Sterfanno Remigio: Formal analysis, Data Curation. Derecky Costa: Formal analysis, Data Curation. Wilk Oliveira: Conceptualization, Methodology, Writing—Review and Editing, Visualization. Alan Pedro da Silva: Conceptualization, Methodology, Writing—Review and Editing, Supervision, Project administration. Diego Dermeval: Validation, Investigation, Writing—Review and Editing. Ig Ibert Bittencourt: Validation, Investigation, Writing—Review and Editing. Leonardo Brandão Marques: Conceptualization, Methodology, Writing—Review and Editing.
Corresponding author
Ethics declarations
Conflict of interest
This manuscript has not been submitted to, nor is under review at, another journal or other publishing venue. The authors have no affiliation with any organization with a direct or indirect financial interest in the subject matter discussed in the manuscript.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Tenório, K., Pereira, E., Remigio, S. et al. Brain-imaging techniques in educational technologies: A systematic literature review. Educ Inf Technol 27, 1183–1212 (2022). https://doi.org/10.1007/s10639-021-10608-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-021-10608-x