Skip to main content

Advertisement

Log in

Neurophysiological Measurements in Higher Education: A Systematic Literature Review

  • ARTICLE
  • Published:
International Journal of Artificial Intelligence in Education Aims and scope Submit manuscript

Abstract

The use of neurophysiological measurements to advance the design, development, use, acceptance, influence and adaptivity of information systems is receiving increasing attention. Within the field of education, neurophysiological measurements have commonly been used to capture a learner’s psychological constructs such as cognitive load, attention and emotion, which play an important role in student learning. This paper systematically examines the literature on the use of neurophysiological measurements in higher education. In particular, using a well-established Systematic Literature Review (SLR) method, we identified 83 papers reporting empirical evidence about the outcome of employing neurophysiological measurements within educational technologies in higher education. The findings of the SLR are divided into three main themes discussing the employed measurements, experimental settings and constructs and outcomes. Our findings identify that (1) electroencephalography and facial expression recognition are the dominantly employed types of measurement, (2) the majority of the experiments used a pre-experimental design, (3) attention and emotion are the two foremost cognitive and non-cognitive constructs under investigation, while less emphasis is paid to meta-cognitive constructs and (4) the reported results mostly focus on monitoring learners’ states, which are not always the same as the intended purpose, such as developing an adaptive system. On a broader term, the review of the literature provides evidence of the effective use of neurophysiological measurements by educational technologies to enhance learning; however, a number of challenges and concerns related to the accuracy and validity of the captured construct, the intrusiveness of the employed instruments as well as ethical and privacy considerations have surfaced, that need to be addressed before such technologies can be employed and adopted at scale.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. References marked with an asterisk (*) are from the final articles retained for this SLR.

References

  • Alemdag, E., & Cagiltay, K. (2018). A systematic review of eye tracking research on multimedia learning. Computers & Education, 125, 413–428.

    Article  Google Scholar 

  • Aleven, V., McLaughlin, E.A., Glenn, R.A., & Koedinger, K.R. (2016). Instruction based on adaptive learning technologies. Handbook of Research on Learning and Instruction 522–560.

  • Ali, L., Hatala, M., Gašević D., & Jovanović, J. (2012). A qualitative evaluation of evolution of a learning analytics tool. Computers & Education, 58(1), 470–489.

    Article  Google Scholar 

  • Alotaiby, T., Abd El-Samie, F.E., Alshebeili, S.A., & Ahmad, I. (2015). A review of channel selection algorithms for eeg signal processing. EURASIP Journal on Advances in Signal Processing, 2015(1), 66.

    Article  Google Scholar 

  • Andreassi, JL. (2010). Psychophysiology: Human behavior and physiological response. Psychology Press.

  • Artífice, A., Sarraipa, J., Jardim-Goncalves, R., Guevara, J.C., & Kadar, M. (2017). Ethical issues of a smart system to enhance students’ attention. In 2017 International Conference on Engineering, Technology and Innovation, ICE/ITMC, IEEE, pp. 1564–1571.

  • Ashraf, H., Sodergren, M.H., Merali, N., Mylonas, G., Singh, H., & Darzi, A. (2018). Eye-tracking technology in medical education: A systematic review. Medical Teacher, 40(1), 62–69.

    Article  Google Scholar 

  • Banaee, H., Ahmed, M.U., & Loutfi, A. (2013). Data mining for wearable sensors in health monitoring systems: a review of recent trends and challenges. Sensors, 13(12), 17472–17500.

    Article  Google Scholar 

  • Barber, W., King, S., & Buchanan, S. (2015). Problem based learning and authentic assessment in digital pedagogy: Embracing the role of collaborative communities. Electronic Journal of E-Learning, 13(2), 59–67.

    Google Scholar 

  • Barr, L., & et al. (2009). An evaluation of emerging driver fatigue detection measures and technologies. Tech. rep., United States. Federal Motor Carrier Safety Administration.

  • *Batterink, L., & Neville, H. (2014). ERPs recorded during early second language exposure predict syntactic learning. Journal of Cognitive Neuroscience, 26(9), 2005–2020. https://doi.org/10.1162/jocn_a_00618.

  • Beg, M.S. (2005). A subjective measure of web search quality. Information Sciences, 169(3-4), 365–381.

    Article  MathSciNet  Google Scholar 

  • Beldarrain, Y. (2006). Distance education trends: Integrating new technologies to foster student interaction and collaboration. Distance education, 27(2), 139–153.

    Article  Google Scholar 

  • *Bian, C., Zhang, Y., Wang, D., Liang, Y., Wu, B., & Lu, W. (2018). An academic emotion database and the baseline evaluation. In 2018 13th International Conference on Computer Science & Education, ICCSE, IEEE, pp. 1–6.

  • *Bin Abdul Rashid, N., bin Taib, M.N., bin Lias, S., bin Sulaiman, N., & et al. (2015). Appraisal of eeg beta summative power towards learning style classification. In 2015 2nd International Conference on Biomedical Engineering, ICoBE, IEEE (pp. 1–5).

  • *Blanchard, N., Bixler, R., Joyce, T., & D’Mello, S. (2014). Automated physiological-based detection of mind wandering during learning. In Trausan-Matu, S., Boyer, K.E., Crosby, M., & Panourgia, K. (Eds.) Intelligent Tutoring Systems, Springer International Publishing, Lecture Notes in Computer Science, pp. 55–60.

  • Bogarín, A., Cerezo, R., & Romero, C. (2018). A survey on educational process mining. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 8(1), e1230.

    Google Scholar 

  • Boud, D., Cohen, R., & Sampson, J. (2014). Peer learning in higher education, Learning from and with each other. Routledge.

  • *Bridge, D., Cohen, N., & Voss, J. (2017). Distinct hippocampal versus frontoparietal network contributions to retrieval and memory-guided exploration. Journal of Cognitive Neuroscience, 29(8), 1324–1338. https://doi.org/10.1162/jocn_a_01143.

  • Brocke, J.V., Riedl, R., & Léger, P.M. (2013). Application strategies for neuroscience in information systems design science research. Journal of Computer Information Systems, 53(3), 1–13.

    Article  Google Scholar 

  • *Bueno-Palomeque, F., Lema-Condo, E., Castro-Villalobos, S., Serpa-Andrade, L., & Ordoñez-Morales, E. (2018). Variation of the EEG-energy in a second language class. In NEUROTECHNIX 2018-Proceedings of the 6th International Congress on Neurotechnology, Electronics and Informatics, pp 41–45.

  • Byong-Hoon, J. (2008). Preventive terminal device and internet system from drowsy and distracted driving on motorways using facial recognition technology. US Patent Application, 12(/021), 120.

    Google Scholar 

  • Campbell, D.T., & Stanley, J.C. (2015). Experimental and quasi-experimental designs for research. Ravenio Books.

  • *Chen, C.M., & Wu, C.H. (2015). Effects of different video lecture types on sustained attention, emotion, cognitive load, and learning performance. Computers & Education, 80, 108–121. https://doi.org/10.1016/j.compedu.2014.08.015.

  • *Chen, C.M., Wang, J.Y., & Yu, C.M. (2017). Assessing the Attention Levels of Students by Using a Novel Attention Aware System Based on Brainwave Signals. British Journal of Educational Technology, 48(2), 348–369. https://doi.org/10.1111/bjet.12359.

  • Chen, F., Zhou, J., Wang, Y., Yu, K., Arshad, S.Z., Khawaji, A., & Conway, D. (2016). Robust multimodal cognitive load measurement. Cham: Springer International Publishing.

    Book  Google Scholar 

  • *Chen, J., Luo, N., Liu, Y., Liu, L., Zhang, K., & Kolodziej, J. (2016). A hybrid intelligence-aided approach to affect-sensitive e-learning. Computing, 98(1-2), 215–233. https://doi.org/10.1007/s00607-014-0430-9.

  • Chen, O.T.C., Chen, P.C., & Tsai, YT. (2017). Attention estimation system via smart glasses. In 2017 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology, CIBCB, IEEE, pp. 1–5.

  • Cruz-Cunha, M.M. (2016). Encyclopedia of E-health and Telemedicine. IGI global.

  • *Dan, A., & Reiner, M. (2018). Reduced mental load in learning a motor visual task with virtual 3d method. Journal of Computer Assisted Learning Oxford, 34(1), 84–93. https://doi.org/10.1111/jcal.12216.

  • Darvishi, A., Khosravi, H., & Sadiq, S. (2020). Utilising learnersourcing to inform design loop adaptivity. In European Conference on Technology Enhanced Learning, Springer, pp. 332–346.

  • De Witte, N.A., Buyck, I., & Van Daele, T. (2019). Combining biofeedback with stress management interventions: A systematic review of physiological and psychological effects. Applied Psychophysiology and Biofeedback, 44(2), 71–82.

    Article  Google Scholar 

  • *Derosière, G., Dalhoumi, S., Perrey, S., Dray, G., & Ward, T. (2014). Towards a near infrared spectroscopy-based estimation of operator attentional state. PLoS ONE, 9(3). https://doi.org/10.1371/journal.pone.0092045.

  • Dicheva, D., Dichev, C., Agre, G., & Angelova, G. (2015). Gamification in education: A systematic mapping study. Educational Technology & Society, 18(3), 75–88.

    Google Scholar 

  • *Dimililer, K. (2018). Use of Intelligent Student Mood Classification System (ISMCS) to achieve high quality in education. Quality & Quantity, 52, 651–662. https://doi.org/10.1007/s11135-017-0644-y.

  • Dunn, T.J., & Kennedy, M. (2019). Technology enhanced learning in higher education; motivations, engagement and academic achievement. Computers & Education, 137, 104–113.

    Article  Google Scholar 

  • *Durall, E., & Leinonen, T. (2015). Feeler: Supporting awareness and reflection about learning through EEG data. Awareness and Reflection in Technology-Enhanced Learning, 1465, 67–73.

  • *Edwards, A., Massicci, A., Sridharan, S., Geigel, J., Wang, L., Bailey, R., & Alm, C. (2017). Sensor-based methodological observations for studying online learning. In Proceedings of the 2017 ACM Workshop on Intelligent Interfaces for Ubiquitous and Smart Learning, pp 25–30. https://doi.org/10.1145/3038535.3038536.

  • *El-Abbasy, K., Angelopoulou, A., & Towell, T. (2018). Measuring the engagement of the learner in a controlled environment using three different biosensors. In 10th International Conference on Computer Supported Education, (Vol. 2 pp. 278–284).

  • *Enegi, I., Hamada, M., & Adeshina, S. (2018). Adaptive multimedia learning framework with facial recognition system.. In 2017 13th International Conference on Electronics, Computer and Computation (ICECCO), vol 2018-January, pp. 1–6. https://doi.org/10.1109/ICECCO.2017.8333315.

  • Fischer, T., Davis, F.D., & Riedl, R. (2019). Neurois: A survey on the status of the field. In Information Systems and Neuroscience, Springer, pp. 1–10.

  • Fleureau, J., Guillotel, P., & Huynh-Thu, Q. (2012). Physiological-based affect event detector for entertainment video applications. IEEE Transactions on Affective Computing, 3(3), 379–385.

    Article  Google Scholar 

  • Fluck, A.E. (2019). An international review of eExam technologies and impact. Computers & Education, 132, 1–15.

    Article  Google Scholar 

  • Fredricks, J.A., Blumenfeld, P.C., & Paris, A.H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109.

    Article  Google Scholar 

  • Fried, E.I. (2017). What are psychological constructs? On the nature and statistical modelling of emotions, intelligence, personality traits and mental disorders. Health Psychology Review, 11(2), 130–134.

    Article  Google Scholar 

  • Furtado, H., & Trobec, R. (2011). Applications of wireless sensors in medicine. In 2011 Proceedings of the 34th International Convention MIPRO, IEEE, pp 257–261.

  • Gašević, D., Dawson, S., & Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64–71.

    Article  Google Scholar 

  • Garcia, R., Falkner, K., & Vivian, R. (2018). Systematic literature review: Self-Regulated Learning strategies using e-learning tools for computer science. Computers & Education, 123, 150–163.

    Article  Google Scholar 

  • *Gazdi, L., Pomazi, K., Radostyan, B., Szabo, M., Szegletes, L., & Forstner, B. (2017). Experimenting with classifiers in biofeedback-based mental effort measurement. In 2016 7th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), pp. 331–335. https://doi.org/10.1109/CogInfoCom.2016.7804571.

  • *Gershman, S., Zhou, J., & Kommers, C. (2017). Imaginative reinforcement learning: Computational principles and neural mechanisms. Journal of Cognitive Neuroscience, 29(12), 2103–2113. https://doi.org/10.1162/jocn_a_01170.

  • *Grafsgaard, J.F., Wiggins, J.B., Vail, A.K., Boyer, K.E., Wiebe, E.N., & Lester, J.C. (2014). The additive value of multimodal features for predicting engagement, frustration, and learning during tutoring. In Proceedings of the 16th International Conference on Multimodal Interaction, ACM, New York, NY, USA, ICMI ’14, pp 42–49. https://doi.org/10.1145/2663204.2663264.

  • Greene, B.A. (2015). Measuring cognitive engagement with self-report scales: Reflections from over 20 years of research. Educational Psychologist, 50 (1), 14–30.

    Article  Google Scholar 

  • Gröschl, M. (2008). Current status of salivary hormone analysis. Clinical Chemistry, 54(11), 1759–1769.

    Article  Google Scholar 

  • Hardeman, W., Houghton, J., Lane, K., Jones, A., & Naughton, F. (2019). A systematic review of just-in-time adaptive interventions (jitais) to promote physical activity. International Journal of Behavioral Nutrition and Physical Activity, 16(1), 31.

    Article  Google Scholar 

  • *Harrison, J., Izzetoǧlu, K., Ayaz, H., Willems, B., Hah, S., Ahlstrom, U., Woo, H., Shewokis, P., Bunce, S., & Onaral, B. (2014). Cognitive workload and learning assessment during the implementation of a next-generation air traffic control technology using functional near-infrared spectroscopy. IEEE Transactions on Human-Machine Systems, 44(4), 429–440. https://doi.org/10.1109/THMS.2014.2319822.

  • Hawkins, J., & Collins, A. (1992). Design-experiments for infusing technology into learning. Educational Technology, 32(9), 63–67.

    Google Scholar 

  • Henrie, C.R., Halverson, L.R., & Graham, C.R. (2015). Measuring student engagement in technology-mediated learning: A review. Computers & Education, 90, 36–53.

    Article  Google Scholar 

  • Higgins, J.P. (2011). Cochrane handbook for systematic reviews of interventions. Version 5 1 1.(0).

  • Hill, J.R., & Hannafin, M.J. (2001). Teaching and learning in digital environments: The resurgence of resource-based learning. Educational Technology Research and Development, 49(3), 37–52.

    Article  Google Scholar 

  • Hofkens, T.L., & Ruzek, E. (2019). Measuring student engagement to inform effective interventions in schools. In Handbook of Student Engagement Interventions, Elsevier, pp 309–324.

  • *Hu, P.C., & Kuo, P.C. (2017). Adaptive learning system for E-learning based on EEG brain signals. In 2017 IEEE 6th Global Conference on Consumer Electronics (GCCE), vol 2017-January, pp 1–2, https://doi.org/10.1109/GCCE.2017.8229382.

  • *Hubbard, R., Sipolins, A., & Zhou, L. (2017). Enhancing learning through virtual reality and neurofeedback: A first step. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference, pp 398–403. https://doi.org/10.1145/3027385.3027390.

  • Jahedi, S., & Méndez, F. (2014). On the advantages and disadvantages of subjective measures. Journal of Economic Behavior & Organization, 98, 97–114.

    Article  Google Scholar 

  • *Kanimozhi, A., & Raj, V. (2017). An adaptive e-learning environment centred on learner’s emotional behaviour. In 2017 International Conference on Algorithms, Methodology, Models and Applications in Emerging Technologies (ICAMMAET), vol 2017-January, pp 1–5, https://doi.org/10.1109/ICAMMAET.2017.8186752.

  • *Katona, J., & Kovari, A. (2016). A brain-computer interface project applied in computer engineering. IEEE Transactions on Education, 59(4), 319–326. https://doi.org/10.1109/TE.2016.2558163.

  • *Kepinska, O., Pereda, E., Caspers, J., & Schiller, N. (2017). Neural oscillatory mechanisms during novel grammar learning underlying language analytical abilities. Brain and Language, 175, 99–110. https://doi.org/10.1016/j.bandl.2017.10.003.

  • Khosravi, H., Kitto, K., & Williams, J.J. (2019). Ripple: A crowdsourced adaptive platform for recommendation of learning activities. arXiv:1910.05522.

  • Kim, J., Campbell, A.S., de Ávila, B.E.F., & Wang, J. (2019). Wearable biosensors for healthcare monitoring. Nature biotechnology 1.

  • Kirkwood, A., & Price, L. (2014). Technology-enhanced learning and teaching in higher education: what is ‘enhanced’ and how do we know? a critical literature review. Learning, media and technology, 39(1), 6–36.

    Article  Google Scholar 

  • *Kise, K. (2017). Deeply sensing learners for better assistance: Towards distribution of learning experiences. In Positive Learning in the Age of Information: A Blessing or a Curse?, Springer, pp 373–385, https://doi.org/10.1007/978-3-658-19567-0_22.

  • Kitchenham, B., & Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering. Citeseer.

  • *Kong, Y., & Li, W. (2018). Research on recognition method of learning concentration based on face feature. In 2017 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM), vol 2018-January, pp 334–338, https://doi.org/10.1109/ICCIS.2017.8274797.

  • Kramer, A.F. (1991). Physiological metrics of mental workload: A review of recent progress. Multiple-task performance 279–328.

  • *Kublanov, V., Petrenko, A., & Nabiullina, A. (2017). Correction of attention in a learning ability task with using non-invasive neurostimulation of peripheral nervous system. In BIOSIGNALS, (Vol. 4 pp. 269–275).

  • *Kuo, Y.C., Chu, H.C., & Tsai, M.C. (2017). Effects of an integrated physiological signal-based attention-promoting and English listening system on students’ learning performance and behavioral patterns. Computers in Human Behavior, 75, 218–227. https://doi.org/10.1016/j.chb.2017.05.017.

  • *Landowska, A., & Miler, J. (2016). Limitations of Emotion Recognition in Software User Experience Evaluation Context. In 2016 Federated Conference on Computer Science and Information Systems (FedCSIS), pp 1631–1640, https://doi.org/10.15439/2016F535.

  • *Landowska, A., Brodny, G., & Wrobel, M. (2017). Limitations of emotion recognition from facial expressions in e-learning context. In CSEDU, (Vol. 2 pp. 383–389).

  • Lane, H.C., & D’Mello, S.K. (2019). Uses of physiological monitoring in intelligent learning environments: A review of research, evidence, and technologies. In Mind, Brain and Technology, Springer. pp 67–86.

  • Latif, M.M.A. (2019). Eye-tracking in recent l2 learner process research: A review of areas, issues, and methodological approaches. System, 83, 25–35.

    Article  Google Scholar 

  • Leggette, H.R., Rice, A.H., Carraway, C., Baker, M.A., & Conner, N. (2018). Applying eye-tracking research in education and communication to agricultural education and communication: A review of literature. Journal of Agricultural Education, 59(2), 79–108.

    Article  Google Scholar 

  • *Lin, F.R., & Kao, C.M. (2018). Mental effort detection using EEG data in E-learning contexts. Computers and Education, 122, 63–79. https://doi.org/10.1016/j.compedu.2018.03.020.

  • *Lin, H.C., Wu, C.H., & Hsueh, Y.P. (2014). The influence of using affective tutoring system in accounting remedial instruction on learning performance and usability. Computers in Human Behavior, 41, 514–522. https://doi.org/10.1016/j.chb.2014.09.052.

  • Lipnevich, A.A., MacCann, C., & Roberts, R.D. (2013). Assessing noncognitive constructs in education. A review of traditional and innovative approaches. Oxford handbook of child psychological assessment.

  • *Liu, C.J., Huang, C.F., Liu, M.C., Chien, Y.C., Lai, C.H., & Huang, Y.M. (2015). Does gender influence emotions resulting from positive applause feedback in self-assessment testing? evidence from neuroscience. Educational Technology & Society, 18(1), 337–350.

  • *Liu, S., Chen, Y., Huang, H., Xiao, L., & Hei, X. (2018a). Towards smart educational recommendations with reinforcement learning in classroom. In 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE), pp 1079–1084, https://doi.org/10.1109/TALE.2018.8615217.

  • *Liu, Y., Chen, J., Zhang, M., & Rao, C. (2018b). Student engagement study based on multi-cue detection and recognition in an intelligent learning environment. Multimedia Tools and Applications, 77(21), 28749–28775.

  • Lodge, J.M., & Harrison, W.J. (2019). Focus: Attention science: The role of attention in learning in the digital age. The Yale Journal of Biology and Medicine, 92(1), 21.

    Google Scholar 

  • Luo, L., Kiewra, K.A., Peteranetz, M.S., & Flanigan, A.E. (2017). Using eye-tracking technology to understand how graphic organizers aid student learning. In Eye-tracking Technology Applications in Educational Research, IGI Global, pp 220–238.

  • Lux, E., Adam, M.T., Dorner, V., Helming, S., Knierim, M.T., & Weinhardt, C. (2018). Live biofeedback as a user interface design element: A review of the literature. Communications of the Association for Information Systems, 43(1), 18.

    Google Scholar 

  • MacKay, J.R. (2019). Show and ‘tool’: How lecture recording transforms staff and student perspectives on lectures in higher education. Computers & Education.

  • *Mannaru, P., Balasingam, B., Pattipati, K., Sibley, C., & Coyne, J. (2016). Cognitive context detection using pupillary measurements. In Next-Generation Analyst IV, International Society for Optics and Photonics, vol 9851, p 98510Q, https://doi.org/10.1117/12.2224176.

  • *Manseras, R., Eugenio, F., & Palaoag, T. (2018). Millennial filipino student engagement analyzer using facial feature classification. In IOP Conference Series: Materials Science and Engineering, vol 325, https://doi.org/10.1088/1757-899X/325/1/012006.

  • Mavrikis, M., & et al. (2016). A study on eye fixation patterns of students in higher education using an online learning system. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, ACM, pp 408–416.

  • McLoughlin, C., & Luca, J. (2002). A learner–centred approach to developing team skills through web–based learning and assessment. British Journal of Educational Technology, 33(5), 571–582.

    Article  Google Scholar 

  • *Medina, R., Carpenter, D., Geigel, J., Bailey, R., Wang, L., & Alm, C.O. (2018). Sensing behaviors of students in online vs. face-to-face lecturing contexts. In 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), pp 77–82. https://doi.org/10.1109/PERCOMW.2018.8480398.

  • *Menekse Dalveren, G., & Cagiltay, N. (2018). Insights from surgeons’ eye-movement data in a virtual simulation surgical training environment: effect of experience level and hand conditions. Behaviour and Information Technology, 37(5), 517–537. https://doi.org/10.1080/0144929X.2018.1460399.

  • Messick, S. (1979). Potential uses of noncognitive measurement in education. Journal of Educational Psychology, 71(3), 281.

    Article  Google Scholar 

  • Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L.A. (2015). Preferred reporting items for systematic review and meta-analysis protocols (prisma-p) 2015 statement. Systematic Reviews, 4(1), 1.

    Article  Google Scholar 

  • Money, W.H., & Dean, B.P. (2019). Incorporating student population differences for effective online education: A content-based review and integrative model. Computers & Education, 138, 57–82.

    Article  Google Scholar 

  • *Monkaresi, H., Bosch, N., Calvo, R.A., & D’Mello, S.K. (2017). Automated detection of engagement using video-based estimation of facial expressions and heart rate. IEEE Transactions on Affective Computing, 8(1), 15–28. https://doi.org/10.1109/TAFFC.2016.2515084.

  • *Muldner, K., & Burleson, W. (2015). Utilizing sensor data to model students’ creativity in a digital environment. Computers in Human Behavior, 42, 127–137. https://doi.org/10.1016/j.chb.2013.10.060.

  • Munafò, M R, Nosek, B.A., Bishop, D.V., Button, K.S., Chambers, C.D., Du Sert, N.P., Simonsohn, U., Wagenmakers, E.J., Ware, J.J., & Ioannidis, J.P. (2017). A manifesto for reproducible science. Nature Human Behaviour, 1(1), 0021.

    Article  Google Scholar 

  • Nacke, L.E. (2011). Directions in physiological game evaluation and interaction. In In CHI 2011 BBI Workshop Proceedings, Citeseer.

  • Ng, B., & Ong, A.K.K. (2018). Neuroscience and digital learning environment in universities: what does current research tell us?. Journal of the Scholarship of Teaching and Learning, 18(3), 116–131.

    Article  Google Scholar 

  • *Nor, N., & Salleh, S. (2015). Correlation between precursor emotion and human stress by using EEG signals. ARPN Journal of Engineering and Applied Sciences, 10(23), 17881–17889.

  • *Nye, B., Karumbaiah, S., Tokel, S., Core, M., Stratou, G., Auerbach, D., & Georgila, K. (2018). Engaging with the scenario: Affect and facial patterns from a scenario-based intelligent tutoring system Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 10947 LNAI:352–366, https://doi.org/10.1007/978-3-319-93843-1_26.

  • O’Meara, P., Munro, G., Williams, B., Cooper, S., Bogossian, F., Ross, L., Sparkes, L., Browning, M., & McClounan, M. (2015). Developing situation awareness amongst nursing and paramedicine students utilizing eye tracking technology and video debriefing techniques: A proof of concept paper. International emergency nursing, 23(2), 94–99.

    Article  Google Scholar 

  • *Özek, M.B. (2018). The effects of merging student emotion recognition with learning management systems on learners’ motivation and academic achievements. Computer Applications in Engineering Education, 26(5), 1862–1872. https://doi.org/10.1002/cae.22000.

  • Paas, F., Tuovinen, J.E., Tabbers, H., Gerven, V., & W, P. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38(1), 63–71.

    Article  Google Scholar 

  • *Pantazos, K., & Vatrapu, R. (2016). Enhancing the professional vision of teachers: A physiological study of teaching analytics dashboards of students’ repertory grid exercises in business education. In 2016 49th Hawaii international conference on System sciences (HICSS), vol 2016-March, pp. 41–50. https://doi.org/10.1109/HICSS.2016.14.

  • Pardo, A., Jovanovic, J., Dawson, S., Gašević, D., & Mirriahi, N. (2019). Using learning analytics to scale the provision of personalised feedback. British Journal of Educational Technology, 50(1), 128–138.

    Article  Google Scholar 

  • *Peng, S., & Nagao, K. (2018). Automatic evaluation of presenters’ discussion performance based on their heart rate. In CSEDU, (Vol. 2 pp. 27–34).

  • *Pham, P., & Wang, J. (2015). AttentiveLearner: Improving mobile MOOC learning via implicit heart rate tracking. In Conati, C., Heffernan, N., Mitrovic, A., & Verdejo, M.F. (Eds.) Artificial Intelligence in Education. https://doi.org/10.1007/978-3-319-19773-9_37, (Vol. 9112 pp. 367–376). Cham: Springer International Publishing.

  • *Pi, Z., & Hong, J. (2016). Learning process and learning outcomes of video podcasts including the instructor and PPT slides: a Chinese case. Innovations in Education and Teaching International, 53(2), 135–144. https://doi.org/10.1080/14703297.2015.1060133.

  • Picard, R.W. (2000). Affective computing. MIT press.

  • Pintrich, P.R. (1999). The role of motivation in promoting and sustaining self-regulated learning. International journal of educational research, 31 (6), 459–470.

    Article  Google Scholar 

  • *Poulsen, A.T., Kamronn, S., Dmochowski, J., Parra, L.C., & Hansen, L.K. (2017). EEG in the classroom: Synchronised neural recordings during video presentation. Scientific Reports 7. https://doi.org/10.1038/srep43916.

  • *Prat, C., Yamasaki, B., & Peterson, E. (2018). Individual differences in resting-state brain rhythms uniquely predict second language learning rate and willingness to communicate in adults. Journal of Cognitive Neuroscience, 31(1), 78–94. https://doi.org/10.1162/jocn_a_01337.

  • Prichard, C., & Atkins, A. (2016). Evaluating l2 readers’ previewing strategies using eye tracking. The Reading Matrix: An International Online Journal, 16(2), 110–130.

    Google Scholar 

  • *Prieto, L.P., Sharma, K., Kidzinski, L., & Dillenbourg, P. (2018). Orchestration load indicators and patterns: In-the-wild studies using mobile eye-tracking. IEEE Transactions on Learning Technologies, 11(2), 216–229. https://doi.org/10.1109/TLT.2017.2690687.

  • *Qi, Z., Beach, S.D., Finn, A.S., Minas, J., Goetz, C., Chan, B., & Gabrieli, J.D.E. (2017). Native-language N400 and P600 predict dissociable language-learning abilities in adults. Neuropsychologia, 98, 177–191. https://doi.org/10.1016/j.neuropsychologia.2016.10.005.

  • *Qu, X., Hall, M., Sun, Y., Sekuler, R., & Hickey, T. (2018a). A personalized reading coach using wearable EEG sensors: A pilot study of brainwave learning analytics. In CSEDU, (Vol. 2 pp. 501–507).

  • *Qu, X., Sun, Y., Sekuler, R., & Hickey, T. (2018b). EEG markers of STEM learning. In 2018 IEEE Frontiers in Education Conference (FIE), pp. 1–9. https://doi.org/10.1109/FIE.2018.8659031.

  • Rajeswari, J., & Jagannath, M. (2017). Advances in biomedical signal and image processing–a systematic review. Informatics in Medicine Unlocked, 8, 13–19.

    Article  Google Scholar 

  • *Ray, A., & Chakrabarti, A. (2016). Design and implementation of technology enabled affective learning using fusion of bio-physical and facial expression. Journal of Educational Technology & Society; Palmerston North, 19(4), 112–125.

  • Riedl, R., & Léger, P.M. (2016). Fundamentals of NeuroIS. Studies in Neuroscience, Psychology and Behavioral Economics.

  • Riedl, R., Fischer, T., & Léger, P M. (2017). A decade of NeuroIS research: status quo, challenges and future directions. Thirty Eighth International Conference on Information Systems, South Korea.

  • Robins, A.V., Margulieux, L., & Morrison, B.B. (2019). Cognitive sciences for computing education. Learning Sciences Faculty Publications 22.

  • Rosenbaum, P.R., & Rubin, D.B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1), 41–55.

    Article  MathSciNet  MATH  Google Scholar 

  • Rubio, S., Díaz, E., Martín, J., & Puente, J.M. (2004). Evaluation of subjective mental workload: A comparison of SWAT, NASA-tlx, and workload profile methods. Applied Psychology, 53(1), 61–86.

    Article  Google Scholar 

  • *Rusák, Z., Van De Water, N., De Smit, B., Horváth, I., & Van Der Vegte, W. (2016). Smart reading aid for detecting problems with reading fluency and comprehension. In ASME 2016 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, vol 1B-2016,https://doi.org/10.1115/DETC2016-59130.

  • *Samah, N., Sha’Ameri, A., Daliman, S., Safri, N., & Qusai, S. (2018). Using electroencephalogram signals to determine differences in brain functional connectivity during game-based problem solving task. In 2018 2nd International Conference on BioSignal Analysis, Processing and Systems (ICBAPS), pp. 7–12,https://doi.org/10.1109/ICBAPS.2018.8527422.

  • Saw, A.E., Main, L.C., & Gastin, P.B. (2016). Monitoring the athlete training response: subjective self-reported measures trump commonly used objective measures: a systematic review. British Journal of Sports Medicine, 50(5), 281–291.

    Article  Google Scholar 

  • *Sawyer, R., Mudrick, N., Azevedo, R., & Lester, J. (2018). Impact of learner-centered affective dynamics on metacognitive judgements and performance in advanced learning technologies. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 10948 LNAI:312–316, https://doi.org/10.1007/978-3-319-93846-2_58.

  • Scherer, R., Siddiq, F., & Tondeur, J. (2019). The technology acceptance model (TAM): A meta-analytic structural equation modeling approach to explaining teachers’ adoption of digital technology in education. Computers & Education, 128, 13–35.

    Article  Google Scholar 

  • Schoenberg, P.L., & David, A.S. (2014). Biofeedback for psychiatric disorders: a systematic review. Applied Psychophysiology and Biofeedback, 39(2), 109–135.

    Article  Google Scholar 

  • *Serrhini, M., & Dargham, A. (2017). Toward incorporating bio-signals in online education case of assessing student attention with BCI. Advances in Intelligent Systems and Computing, 520, 135–146. https://doi.org/10.1007/978-3-319-46568-5_14.

  • *Sethi, C., Dabas, H., Dua, C., Dalawat, M., & Sethia, D. (2018). EEG-based attention feedback to improve focus in e-learning. In Proceedings of the 2018 2Nd International Conference on Computer Science and Artificial Intelligence, ACM, New York, NY, USA, CSAI ’18, pp 321–326.

  • *Seugnet Blignaut, A., & Matthew, G. (2017). Part II: Survive with vuvu on the vaal electroencephalography results of a gameplay experience evaluation of a mobile serious game for statistics education. In Proceedings of the 16th World Conference on Mobile and Contextual Learning. https://doi.org/10.1145/3136907.3136911.

  • *Sezer, A., İnel, Y., Seçkin, A., & Uluçınar, U. (2015). An investigation of university students’ attention levels in real classroom settings with Neurosky’s MindWave mobile (EEG) device 2. Turkish Online Journal of Educational Technology 2015:61–69.

  • Sinatra, G.M., Heddy, B.C., & Lombardi, D. (2015). The challenges of defining and measuring student engagement in science. Taylor & Francis.

  • *Siqueira, J., Da Silva, L., Coutinho, A., & Rodrigues, R. (2017). Analysis of air temperature changes on blood pressure and heart rate and performance of undergraduate students. Work, 57(1), 43–54. https://doi.org/10.3233/WOR-172533.

  • So, H.J., & Brush, T.A. (2008). Student perceptions of collaborative learning, social presence and satisfaction in a blended learning environment: Relationships and critical factors. Computers & Education, 51(1), 318–336.

    Article  Google Scholar 

  • Sperling, R.A., Howard, B.C., Staley, R., & DuBois, N. (2004). Metacognition and self-regulated learning constructs. Educational Research and Evaluation, 10(2), 117–139.

    Article  Google Scholar 

  • *Spüler, M., Krumpe, T., Walter, C., Scharinger, C., Rosenstiel, W., & Gerjets, P. (2017). Brain-computer interfaces for educational applications. In Informational Environments: Effects of use, Effective Designs, Springer, pp 177–201. https://doi.org/10.1007/978-3-319-64274-1_8.

  • *Stuijfzand, B.G., Van Der Schaaf, M.F., Kirschner, F.C., Ravesloot, C.J., Van Der Gijp, A., & Vincken, K.L. (2016). Medical students’ cognitive load in volumetric image interpretation: Insights from human-computer interaction and eye movements. Computers in Human Behavior, 62, 394–403.

  • Sullivan, G.M. (2011). Getting off the “gold standard”: randomized controlled trials and education research. Journal of graduate medical education, 3 (3), 285–289.

    Article  Google Scholar 

  • Sung, Y.T., Chang, K.E., Chiou, S.K., & Hou, H.T. (2005). The design and application of a web-based self-and peer-assessment system. Computers & Education, 45(2), 187–202.

    Article  Google Scholar 

  • Tempelaar, D.T., Rienties, B., & Giesbers, B. (2015). In search for the most informative data for feedback generation: Learning Analytics in a data-rich context. Computers in Human Behavior, 47, 157–167.

    Article  Google Scholar 

  • Teo, T. (2009). Modelling technology acceptance in education: A study of pre-service teachers. Computers & Education, 52(2), 302–312.

    Article  Google Scholar 

  • Teo, T. (2011). Technology acceptance in education. Berlin: Springer Science & Business Media.

    Book  Google Scholar 

  • Thomas, P.A., Kern, D.E., Hughes, M.T., & Chen, B.Y. (2016). Curriculum development for medical education: a six-step approach. JHU Press.

  • *Thompson, N., & McGill, T. (2017). Genetics with Jean: the design, development and evaluation of an affective tutoring system. Educational Technology Research and Development, 65(2), 279–299. https://doi.org/10.1007/s11423-016-9470-5.

  • *Tobita, R. (2017). Development of effective ESP course design integrating analysis with near-infrared spectroscopy. In Proceedings of The 8th International Conference on Society and Information Technologies (ICSIT 2017), vol 2017-March, pp 183–186.

  • *Vail, A.K., Grafsgaard, J.F., Boyer, K.E., Wiebe, E., & Lester, J.C. (2016). Predicting learning from student affective response to tutor questions. In International Conference on Intelligent Tutoring Systems, pp 154–164. https://doi.org/10.1007/978-3-319-39583-8_15.

  • *Varga, N., & Bauer, P. (2017). Using event-related potentials to inform the neurocognitive processes underlying knowledge extension through memory integration. Journal of Cognitive Neuroscience, 29(11), 1932–1949. https://doi.org/10.1162/jocn_a_01168.

  • *Wang, C.C., & Hsu, M.C. (2014). An exploratory study using inexpensive electroencephalography (EEG) to understand flow experience in computer-based instruction. Information & Management, 51(7), 912–923. https://doi.org/10.1016/j.im.2014.05.010.

  • *Wang, J.X., & Voss, J.L. (2014). Brain networks for exploration decisions utilizing distinct modeled information types during contextual learning. Neuron, 82(5), 1171–1182. https://doi.org/10.1016/j.neuron.2014.04.028.

  • Wang, L., & Miller, L.C. (2020). Just-in-the-moment adaptive interventions (jitai): a meta-analytical review. Health Communication, 35(12), 1531–1544.

    Article  Google Scholar 

  • *Wei, Q., Sun, B., He, J., & Yu, L. (2017). BNU-LSVED 2.0: Spontaneous multimodal student affect database with multi-dimensional labels. Signal Processing: Image Communication, 59, 168–181. https://doi.org/10.1016/j.image.2017.08.012.

  • *Whitehill, J., Serpell, Z., Lin, Y., Foster, A., & Movellan, J.R. (2014). The faces of engagement: Automatic recognition of student engagementfrom facial expressions. IEEE Transactions on Affective Computing, 5(1), 86–98. https://doi.org/10.1109/TAFFC.2014.2316163.

  • Wohlin, C. (2014). Guidelines for snowballing in systematic literature studies and a replication in software engineering.

  • *Wong, A., Moss, J., & Schunn, C. (2016). Tracking reading strategy utilisation through pupillometry. Australasian Journal of Educational Technology, 32(6), 45–57. https://doi.org/10.14742/ajet.3096.

  • *Wu, C.H. (2017). New technology for developing facial expression recognition in e-learning. In 2016 Portland International Conference on Management of Engineering and Technology (PICMET), pp 1719–1722. https://doi.org/10.1109/PICMET.2016.7806648.

  • *Wu, C.H., Tzeng, Y.L., & Huang, Y.M. (2014). Understanding the relationship between physiological signals and digital game-based learning outcome. Journal of Computers in Education, 1(1), 81–97.

  • Wu, C.I. (2012). Hci and eye tracking technology for learning effect. Procedia-Social and Behavioral Sciences, 64, 626–632.

    Article  Google Scholar 

  • Xie, H., Chu, H.C., Hwang, G.J., & Wang, C.C. (2019). Trends and development in technology-enhanced adaptive/personalized learning: A systematic review of journal publications from 2007 to 2017. Computers & Education 103599.

  • Yang, F.Y., Tsai, M.J., Chiou, G.L., Lee, S.W.Y., Chang, C.C., & Chen, L.L. (2018). Instructional suggestions supporting science learning in digital environments based on a review of eye tracking studies. Journal of Educational Technology & Society, 21(2), 28–45.

    Google Scholar 

  • *Yang, X., Lin, L., Cheng, P.Y., Yang, X., Ren, Y., & Huang, Y.M. (2018). Examining creativity through a virtual reality support system. Educational Technology Research and Development, 66(5), 1231–1254. https://doi.org/10.1007/s11423-018-9604-z.

  • *Yuksel, B.F., Oleson, K.B., Harrison, L., Peck, E.M., Afergan, D., Chang, R., & Jacob, R.J. (2016). Learn Piano with BACh: An adaptive learning interface that adjusts task difficulty based on brain state. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI ’16, pp 5372–5384.

  • *Zhai, X., Fang, Q., Dong, Y., Wei, Z., Yuan, J., Cacciolatti, L., & Yang, Y. (2018). The effects of biofeedback-based stimulated recall on self-regulated online learning: A gender and cognitive taxonomy perspective. Journal of Computer Assisted Learning; Oxford, 34(6), 775–786. https://doi.org/10.1111/jcal.12284.

  • *Zhang, C., & Shen, R. (2017). Automatic detection of mind wandering using mobile device in the scenario of online and mobile education. In Computer Science and Technology, WORLD SCIENTIFIC, Shenzhen, China, pp 153–162. https://doi.org/10.1142/9789813146426_0018.

  • *Zhang, Z. (2018). A cognitive study of college students’ english vocabulary based on electroencephalogram. NeuroQuantology, 16(5), 363–368. https://doi.org/10.14704/nq.2018.16.5.1299.

  • Zhou, M., & Zhang, X. (2019). Online social networking and subjective well-being: Mediating effects of envy and fatigue. Computers & Education 103598.

  • *Zlokazov, K., Voroshilova, M., Pirozhkova, I., & Lapenok, M. (2017). Eye tracking technology for assessment of electronic hybrid text perception by students. Smart Innovation, Systems and Technologies 75:245–252, https://doi.org/10.1007/978-3-319-59451-4_24.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ali Darvishi.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Darvishi, A., Khosravi, H., Sadiq, S. et al. Neurophysiological Measurements in Higher Education: A Systematic Literature Review. Int J Artif Intell Educ 32, 413–453 (2022). https://doi.org/10.1007/s40593-021-00256-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40593-021-00256-0

Keywords

Navigation