skip to main content
10.1145/3641343.3641433acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiceitsaConference Proceedingsconference-collections
research-article

Real-Time Student Classroom Action Recognition: Based on Improved YOLOv8n

Authors Info & Claims
Published:29 April 2024Publication History

ABSTRACT

Real-time student classroom action recognition allows the creation of a closed-loop teaching system and efficient teaching methods. To address the issue of a lack of open dataset in the SCAR re- search field, we proposed a challenging dataset SCAR-dataset with a total of 7194 samples, which was collected in college classrooms and after exploratory experiments. The dataset were defined into six categories: focused, head_drop, bored_distraction, looking_around, sleeping, and stand_up. We benchmarked the SCAR dataset for real-time deployment using YOLOv5, YOLOv7, and YOLOv8 algorithms, which served as the foundation for subsequent classroom concentration analysis research. By combining depth-separable convolution, a lightweight asymmetric detector head LADH was proposed. Experiments show that improving the Yolov8n model increases the map value by 2.5 points while don't in- creasing the number of parameters and Gflops.

References

  1. W. Fan, 2021. A realtime action detection frame work based on pytorchvideo.Google ScholarGoogle Scholar
  2. R. Fu, T. Wu, Z. Luo, F. Duan, X. Qiao, and P. Guo. 2021. Learning behavior analysis in classroom based on deep learning in 2019 Tenth International Conference on Intelligent Control and Information Processing (ICICIP). IEEE, pp. 206– 212.Google ScholarGoogle Scholar
  3. D. Maji, S. Nagori, M. Mathew, and D. Poddar, 2022. Yolo-pose: Enhancing yolo for multi person pose estimation using object keypoint similarity loss. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2637–2646.Google ScholarGoogle Scholar
  4. E. Murphy-Chutorian and M. M. Trivedi. 2008. Head pose estimation in computer vision: A survey. IEEE transactions on pattern analysis and machine intelligence, vol. 31, no. 4, pp. 607–626.Google ScholarGoogle Scholar
  5. W. Chen, H. Huang, S. Peng, C. Zhou, and C. Zhang. 2021.Yolo-face: a real-time face detector, The Visual Computer, vol. 37, pp. 805–813,Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. S. Li and W. Deng. 2020. Deep facial expression recognition: A survey. IEEE transactions on affective computing, vol. 13, no. 3, pp. 1195–1215Google ScholarGoogle Scholar
  7. C. Li, R. Wang, J. Li, and L. Fei. 2020. Face detection based on yolov3 in Recent Trends in Intelligent Computing, Communication and Devices: Proceedings of ICCD 2018. Springer, pp. 277–284.Google ScholarGoogle Scholar
  8. W. Xu, B. Li, Y. Du, and S. Dong. 2023. Study on facial recognition method based on yolov5 in Journal of Physics: Conference Series, vol. 2560, no. 1. IOP Publishing, p. 012020Google ScholarGoogle Scholar
  9. K. Li, Y. Wang, and Z. Hu. 2023. Improved yolov7 for small object detection algorithm based on attention and dynamic convolution. Applied Sciences, vol. 13, no. 16, p. 9316Google ScholarGoogle ScholarCross RefCross Ref
  10. F. Yang and T. Wang, 2023, Scb-dataset3: A benchmark for detecting student classroom behavior. arXiv preprint arXiv:2310.02522Google ScholarGoogle Scholar
  11. J. Zhang, Z. Chen, G. Yan, Y. Wang, and B. Hu. 2023. Faster and lightweight: An im- proved yolov5 object detector for remote sensing images. Remote Sensing, vol. 15, no. 20, p. 4974Google ScholarGoogle ScholarCross RefCross Ref
  12. R. Li and Y. Wu. 2022. Improved yolo v5 wheat ear detection algorithm based on attention mechanism. Electronics, vol. 11, no. 11, p. 1673Google ScholarGoogle ScholarCross RefCross Ref

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    ICEITSA '23: Proceedings of the 3rd International Conference on Electronic Information Technology and Smart Agriculture
    December 2023
    541 pages
    ISBN:9798400716775
    DOI:10.1145/3641343

    Copyright © 2023 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 29 April 2024

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited
  • Article Metrics

    • Downloads (Last 12 months)3
    • Downloads (Last 6 weeks)3

    Other Metrics

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format