skip to main content
10.1145/3460418.3479323acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
research-article

Towards Automatic Recognition of Perceived Level of Understanding on Online Lectures using Earables

Published: 24 September 2021 Publication History

Abstract

The COVID-19 pandemic has seriously impacted education and forced the whole education system to shift to online learning. Such a transition has been readily made by virtue of today’s Internet technology and infrastructure, but online learning also has limitations compared to traditional face-to-face lectures. One of the biggest hurdles is that it is challenging for teachers to instantly keep track of students’ learning status. In this paper, we envision earables as an opportunity to automatically estimate learner’s understanding of learning material for effective learning and teaching, e.g., to pinpoint the part for which learners need to put more effort to understand. To this end, we conduct a small-scale exploratory study with 8 participants for 24 lectures in total and investigate learner’s behavioral characteristics that indicate the level of understanding. We demonstrate that those behaviors can be captured from a motion signal on earables. We discuss challenges that need to be further addressed to realize our vision.

References

[1]
[n.d.]. The COVID-19 pandemic has changed education forever. This is how. Retrieved June 14, 2021 from https://www.weforum.org/agenda/2020/04/coronavirus-education-global-covid19-online-digital-learning/
[2]
[n.d.]. Education during COVID-19; moving towards e-learning. Retrieved June 14, 2021 from https://www.europeandataportal.eu/en/impact-studies/covid-19/education-during-covid-19-moving-towards-e-learning
[3]
Nigel Bosch and Sidney D’Mello. 2019. Automatic detection of mind wandering from video in the lab and in the classroom. IEEE Transactions on Affective Computing(2019).
[4]
Patricia A Eber and Trent S Parker. 2007. Assessing Student Learning: Applying Bloom’s Taxonomy.Human Service Education 27, 1 (2007).
[5]
Davide Figo, Pedro C Diniz, Diogo R Ferreira, and Joao MP Cardoso. 2010. Preprocessing techniques for context recognition from accelerometer data. Personal and Ubiquitous Computing 14, 7 (2010), 645–662.
[6]
Nan Gao, Wei Shao, Mohammad Saiedur Rahaman, and Flora D Salim. 2020. n-Gage: Predicting in-class Emotional, Behavioural and Cognitive Engagement in the Wild. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 3 (2020), 1–26.
[7]
Joseph Grafsgaard, Joseph B Wiggins, Kristy Elizabeth Boyer, Eric N Wiebe, and James Lester. 2013. Automatically recognizing facial expression: Predicting engagement and frustration. In Educational Data Mining 2013.
[8]
Fahim Kawsar, Chulhong Min, Akhil Mathur, and Alesandro Montanari. 2018. Earables for personal-scale behavior analytics. IEEE Pervasive Computing 17, 3 (2018), 83–89.
[9]
Dongwoo Kim, Chulhong Min, and Seungwoo Kang. 2020. Towards recognizing perceived level of understanding for online lectures using earables. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 739–740.
[10]
David R Krathwohl. 2002. A revision of Bloom’s taxonomy: An overview. Theory into practice 41, 4 (2002), 212–218.
[11]
Ann Lehman. 2005. JMP for basic univariate and multivariate statistics: a step-by-step guide. SAS Institute.
[12]
Chulhong Min, Akhil Mathur, and Fahim Kawsar. 2018. Exploring audio and kinetic sensing on earable devices. In Proceedings of the 4th ACM Workshop on Wearable Systems and Applications. ACM, 5–10.
[13]
Selene Mota and Rosalind W Picard. 2003. Automated posture analysis for detecting learner’s interest level. In 2003 Conference on Computer Vision and Pattern Recognition Workshop, Vol. 5. IEEE, 49–49.
[14]
Phuong Pham and Jingtao Wang. 2017. AttentiveLearner 2: a multimodal approach for improving MOOC learning on mobile devices. In International Conference on Artificial Intelligence in Education. Springer, 561–564.
[15]
Tarmo Robal, Yue Zhao, Christoph Lofi, and Claudia Hauff. 2018. IntelliEye: Enhancing MOOC Learners’ Video Watching Experience through Real-Time Attention Tracking. In Proceedings of the 29th on Hypertext and Social Media. ACM, 106–114.
[16]
Aras Yurtman. 2019. Activity recognition invariant to position and orientation of wearable motion sensor units. Ph.D. Dissertation. bilkent university.

Cited By

View all
  • (2024)Exploring Earables to Monitor Temporal Lack of Focus during Online Meetings to Identify Onset of Neurological DisordersProceedings of the 8th ACM/IEEE International Conference on Connected Health: Applications, Systems and Engineering Technologies10.1145/3580252.3586981(126-137)Online publication date: 22-Jan-2024
  • (2024)Acoustic-based Alphanumeric Input Interface for Earables2024 33rd International Conference on Computer Communications and Networks (ICCCN)10.1109/ICCCN61486.2024.10637602(1-9)Online publication date: 29-Jul-2024
  • (2023)A multimodal approach to mitigate cheating in online assessments2023 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE)10.1109/TALE56641.2023.10398295(1-4)Online publication date: 28-Nov-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
UbiComp/ISWC '21 Adjunct: Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers
September 2021
711 pages
ISBN:9781450384612
DOI:10.1145/3460418
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 September 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Automatic Recognition
  2. Earable
  3. Online Learning
  4. Understanding Level

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • The Ministry of Science and ICT, Korea

Conference

UbiComp '21

Acceptance Rates

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)1
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Exploring Earables to Monitor Temporal Lack of Focus during Online Meetings to Identify Onset of Neurological DisordersProceedings of the 8th ACM/IEEE International Conference on Connected Health: Applications, Systems and Engineering Technologies10.1145/3580252.3586981(126-137)Online publication date: 22-Jan-2024
  • (2024)Acoustic-based Alphanumeric Input Interface for Earables2024 33rd International Conference on Computer Communications and Networks (ICCCN)10.1109/ICCCN61486.2024.10637602(1-9)Online publication date: 29-Jul-2024
  • (2023)A multimodal approach to mitigate cheating in online assessments2023 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE)10.1109/TALE56641.2023.10398295(1-4)Online publication date: 28-Nov-2023
  • (2022)Sensing with EarablesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503146:3(1-57)Online publication date: 7-Sep-2022
  • (2022)Survey of Online Exam Proctoring Model to Detect Cheating Behavior based on Face Recognition2022 8th International Conference on Systems and Informatics (ICSAI)10.1109/ICSAI57119.2022.10005488(1-7)Online publication date: 10-Dec-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media