Kevin T. Gapi
ABSTRACT
Nowadays, virtual classrooms are highly encouraged due to the COVID-19 pandemic. This could be a disadvantage because some students might not really be engaged with this kind of setup. This study presents a system for classifying level of attentiveness on virtual classrooms using deep learning for computer vision. The study confined in the development of the technology for classifying attentiveness itself, the integration of the system to virtual classrooms is not included in the scope. The criteria for the classification include the prediction of droopy corners of mouth facial cue, hanging eyelid facial cue, eye state, and eye gaze. The software of the system used the combinations of Convolutional Neural Network (CNN) models, Dlib, and OpenCV library. After evaluation, the system was able to successfully classify attentiveness of three classes with an overall accuracy of 83.33%.
- E. Hechtel, “How Smartphones and Mobile Internet Have Changed Our Lives,” 2016.Google Scholar
- A. Rucki, “Average smartphone user checks device 221 times a day, according to research,” Evening Standard, p. 1, 07-Oct-2014.Google Scholar
- P. David, J. H. Kim, J. S. Brickman, W. Ran, and C. M. Curtis, “Mobile phone distraction while studying,” New Media Soc., vol. 17, no. 10, pp. 1661–1679, 2015.Google ScholarCross Ref
- D. M. Bunce, E. A. Flens, and K. Y. Neiles, “How long can students pay attention in class? A study of student attention decline using clickers,” J. Chem. Educ., vol. 87, no. 12, pp. 1438–1443, 2010.Google ScholarCross Ref
- B. G. Adams, E. E. Daniel, A. Herxheimer, and M. Weatherall, “The value of emphasis in eliminating errors. A controlled study in teaching.,” Br. Med. J., vol. 2, no. 5204, pp. 1007–1011, 1960.Google ScholarCross Ref
- H. M. Lahaderne, “Attitudinal and Intellectual Correlates of Attention: a Study of Four Sixth-Grade Classrooms,” J. Educ. Psychol., vol. 59, no. 5, pp. 320–324, 1968.Google ScholarCross Ref
- E. F. Barkley and C. H. Major, Student Engagement Techniques: A Handbook for College Faculty. Sons, John Wiley &, 2020.Google Scholar
- M. Ross, C. A. Graves, J. W. Campbell, and J. H. Kim, “Using support vector machines to classify student attentiveness for the development of personalized learning systems,” Proc. - 2013 12th Int. Conf. Mach. Learn. Appl. ICMLA 2013, vol. 1, pp. 325–328, 2013.Google ScholarDigital Library
- T. Tabassum, A. A. Allen, and P. De, “Non-intrusive identification of student attentiveness and finding their correlation with detectable facial emotions,” ACMSE 2020 - Proc. 2020 ACM Southeast Conf., pp. 127–134, 2020.Google ScholarDigital Library
- A. Dubbaka and A. Gopalan, “Detecting Learner Engagement in MOOCs using Automatic Facial Expression Recognition,” IEEE Glob. Eng. Educ. Conf. EDUCON, vol. 2020-April, pp. 447–456, 2020.Google ScholarCross Ref
- C. Thomas, N. Nair, and D. B. Jayagopi, “Predicting Engagement Intensity in the Wild Using Temporal Convolutional Network,” pp. 604–610, 2018.Google Scholar
- R. Ghoddoosian, M. Galib, and V. Athitsos, “A realistic dataset and baseline temporal model for early drowsiness detection,” IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Work., vol. 2019-June, pp. 178–187, 2019.Google ScholarCross Ref
- P. J. F. Festin, R. S. Cortez, and J. F. Villaverde, “Non-Invasive Detection of Diabetes Mellitus by Tongue Diagnosis Using Convolutional Neural Network,” ACM Int. Conf. Proceeding Ser., pp. 135–139, 2020.Google ScholarDigital Library
- E. R. Carillo , “Gum Disease Detection in the Front Part of the Mouth Using Convolutional Neural Network Through the Use of Keras with TensorFlow as Backend,” ACM Int. Conf. Proceeding Ser., pp. 144–150, 2020.Google ScholarDigital Library
- D. Padilla, A. Yumang, A. L. Diaz, and G. Inlong, “Differentiating Atopic Dermatitis and Psoriasis Chronic Plaque using Convolutional Neural Network MobileNet Architecture,” 2019 IEEE 11th Int. Conf. Humanoid, Nanotechnology, Inf. Technol. Commun. Control. Environ. Manag. HNICEM 2019, pp. 0–5, 2019.Google ScholarCross Ref
- T. Sundelin, M. Lekander, G. Kecklund, E. J. W. Van Someren, A. Olsson, and J. Axelsson, “Cues of fatigue: Effects of sleep deprivation on facial appearance,” Sleep, vol. 36, no. 9, pp. 1355–1360, 2013.Google ScholarCross Ref
Recommendations
Computer Vision based Attentiveness Detection Methods in E-Learning
ICONIAAC '14: Proceedings of the 2014 International Conference on Interdisciplinary Advances in Applied ComputingIn this paper, we have reviewed the current state of the art about attentiveness detection methods used in e-learning. Classification of the prior works is done based on features measured, affective states considered, affect classification method and e-...
Deep Learning for Computer Vision: A Brief Review
Over the last years deep learning methods have been shown to outperform previous state-of-the-art machine learning techniques in several fields, with computer vision being one of the most prominent cases. This review paper provides a brief overview ...
Augmented reflective learning and knowledge retention perceived among students in classrooms involving virtual laboratories
Learning theories converge on the principles of reflective learning processes and perceive them as fundamental to effective learning. Traditional laboratory education in science and engineering often happens in highly resource-constrained environments ...
Comments