skip to main content
10.1145/3610419.3610422acmotherconferencesArticle/Chapter ViewAbstractPublication PagesairConference Proceedingsconference-collections
research-article

OnE: An EEG-based Passive BCI framework for Monitoring Cognitive States During online learning

Published: 02 November 2023 Publication History

Abstract

Brain fog, characterized by confusion, lack of attention, and mental clarity, is one of the main reasons that lead to the downgrading of performance in the learning process. In recent years, online education has gained quite popularity. Analysis of the cognitive states of the students in real-time during online classes is challenging as immediate and prompt feedback from students in online education is less feasible as compared to that of classroom education. This paper presents an EEG-based Passive Brain-Computer Interface (pBCI) framework for identifying the cognitive states of students during online video learning. The framework detects three cognitive states: confusion, attention, and mediation while watching online course videos using EEG data. The paper first presents rigorous experimental analysis to identify the confusion levels, followed by proposing a methodology based on kernel partial least square algorithm to predict the attention and mediation levels. The paper also explores the dominant features associated with confusion levels and the correlation between the three cognitive states.

References

[1]
Hashim Abu-gellban, Yu Zhuang, Long Nguyen, Zhenkai Zhang, and Essa Imhmed. 2022. CSDLEEG: Identifying Confused Students Based on EEG Using Multi-View Deep Learning. In 2022 IEEE 46th Annual Computers, Software, and Applications Conference (COMPSAC). 1217–1222. https://doi.org/10.1109/COMPSAC54236.2022.00192
[2]
Çiğdem İnan Acı, Murat Kaya, and Yuriy Mishchenko. 2019. Distinguishing mental attention states of humans via an EEG-based passive BCI using machine learning methods. Expert Systems with Applications 134 (2019), 153–166.
[3]
Abeer Al-Nafjan and Mashael Aldayel. 2022. Predict Students’ Attention in Online Learning Using EEG Data. Sustainability 14, 11 (2022), 6553.
[4]
Talal Daghriri, Furqan Rustam, Wajdi Aljedaani, Abdullateef H Bashiri, and Imran Ashraf. 2022. Electroencephalogram Signals for Detecting Confused Students in Online Education Platforms with Probability-Based Features. Electronics 11, 18 (2022), 2855.
[5]
B Kumar, D Gupta, and S Goswami Rajat. 2019. Classification of Student’s Confusion Level in E-Learning using Machine Learning. International Journal of Innovative Technology and Exploring Engineering 9, 2S (2019).
[6]
Nitin Kumar, Kaushikee Khaund, and Shyamanta M Hazarika. 2016. Bispectral analysis of EEG for emotion recognition. Procedia Computer Science 84 (2016), 31–35.
[7]
Gen Li and Jason J Jung. 2020. Maximum marginal approach on eeg signal preprocessing for emotion detection. Applied Sciences 10, 21 (2020), 7677.
[8]
Zhaoheng Ni, Ahmet Cem Yuksel, Xiuyan Ni, Michael I Mandel, and Lei Xie. 2017. Confused or not confused? Disentangling brain activity from EEG data using bidirectional LSTM recurrent neural networks. In Proceedings of the 8th acm international conference on bioinformatics, computational biology, and health informatics. 241–246.
[9]
Rosalind W. Picard, Elias Vyzas, and Jennifer Healey. 2001. Toward machine emotional intelligence: analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 10 (2001), 1175–1191.
[10]
Claire Receli M Reñosa, Argel A Bandala, and Ryan Rhay P Vicerra. 2019. Classification of Confusion Level Using EEG Data and Artificial Neural Networks. In 2019 IEEE 11th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management (HNICEM). IEEE, 1–6.
[11]
Roman Rosipal and Leonard J Trejo. 2001. Kernel partial least squares regression in reproducing kernel hilbert space. Journal of Machine Learning Research 2, Dec (2001), 97–123.
[12]
Amirhessam Tahmassebi, Amir H Gandomi, and Anke Meyer-Baese. 2018. An evolutionary online framework for MOOC performance using EEG data. In 2018 IEEE Congress on Evolutionary Computation (CEC). IEEE, 1–8.
[13]
Theoharis C Theoharides, Julia M Stewart, Erifili Hatziagelaki, and Gerasimos Kolaitis. 2015. Brain “fog,” inflammation and obesity: key aspects of neuropsychiatric disorders improved by luteolin. Frontiers in neuroscience 9 (2015), 225.
[14]
Zaib Unnisa, Sultan Zia, Umair Muneer Butt, Sukumar Letchmunan, and Sadaf Ilyas. 2020. Ensemble usage for classification of EEG signals a review with comparison. In International Conference on Human-Computer Interaction. Springer, 189–208.
[15]
Laurent Vézard, Pierrick Legrand, Marie Chavent, Frédérique Faïta-Aïnseba, and Leonardo Trujillo. 2015. EEG classification for the detection of mental states. Applied Soft Computing 32 (2015), 113–131.
[16]
Haohan Wang, Yiwei Li, Xiaobo Hu, Yucong Yang, Zhu Meng, and Kai-min Chang. 2013. Using EEG to Improve Massive Open Online Courses Feedback Interaction. In AIED Workshops.
[17]
Haohan Wang, Zhenglin Wu, and Eric P Xing. 2018. Removing confounding factors associated weights in deep neural networks improves the prediction accuracy for healthcare applications. In BIOCOMPUTING 2019: Proceedings of the Pacific Symposium. World Scientific, 54–65.
[18]
Yun Zhou, Tao Xu, Shiqian Li, and Shaoqi Li. 2018. Confusion State Induction and EEG-based Detection in Learning. In 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 3290–3293. https://doi.org/10.1109/EMBC.2018.8512943

Index Terms

  1. OnE: An EEG-based Passive BCI framework for Monitoring Cognitive States During online learning

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    AIR '23: Proceedings of the 2023 6th International Conference on Advances in Robotics
    July 2023
    583 pages
    ISBN:9781450399807
    DOI:10.1145/3610419
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 November 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    AIR 2023

    Acceptance Rates

    Overall Acceptance Rate 69 of 140 submissions, 49%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 44
      Total Downloads
    • Downloads (Last 12 months)38
    • Downloads (Last 6 weeks)11
    Reflects downloads up to 15 Jan 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media