skip to main content
10.1145/3606094.3606112acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicdelConference Proceedingsconference-collections
research-article

Research on a Framework for Analyzing Interactive Behaviors in Smart Classroom Based on Multimodal Data and Its Application

Published:29 August 2023Publication History

ABSTRACT

The analysis of interactive behaviors in the classroom has been a hot topic since the proposal of the Flanders Interaction Analysis System. With the continuous development of information technology and intelligent educational environments, the types of classrooms are constantly changing. In order to deal with the popular smart classroom environment and explore its inherent nature, it is necessary to study the framework for analyzing interactive behaviors in smart classrooms. In smart classrooms, teachers and students generate a large amount of multimodal data not only in the physical environment but also in the virtual environment of the network. These data provide rich sources for researchers. Therefore, from the initial study of speech modal data analysis in the classroom to the current more accurate analysis of teacher-student interactions in smart classrooms through observing gestures, expressions, actions, and network platform data, it gradually becomes possible. This paper uses literature research methods and a multimodal perspective to observe high-quality smart classroom videos and summarize the interactive behaviors in smart classrooms. Based on this, a framework for analyzing interactive behaviors in smart classrooms based on multimodal data is designed, which is necessary.

References

  1. Wang,W.F.Mao,M.J.Yan,H.B.(2022).Jingzhun jiaoyan shiyu xiade jiaoshi pingke fankui fenxi moxing yanjiu[Research on the feedback analysis model of teachers’ evaluation of lessons from the perspective of precise teaching research ]. Dianhua jiaoyu yanjiu,43 (01),122-128.Google ScholarGoogle Scholar
  2. Hu,X.Y. Lin,Z.R.(2019).Jingzhun jiaoyan shiyu xiade jiaoshi huaxiang yanjiu[Research on teacher portraits in the perspective of precision teaching and research]. Dianhua jiaoyu yanjiu,40 (07) ,84-91.Google ScholarGoogle Scholar
  3. Wang,X.C. Jiang,S.X. Huang,R.H.(2015).Mianxiang zhihui jiaoshi dezhong xiaoxue ketang hudong guancha gongju yanjiu[Research on classroom interaction observation tools for smarts classrooms in primary and secondary schools]. Dianhua jiaoyu yanjiu,36 (09),49-53.Google ScholarGoogle Scholar
  4. Giannakos,M.N., Sharma, K., Pappas, I. O., Kostakos, V., & Velloso, E.(2019). Multimoda data as a means to understand the learning experience. International Journal of Information Management, 48, 108-119.Google ScholarGoogle Scholar
  5. Wang,W.F. Mao,M.J.(2021).Duomo taixue xifen xi: lijie yuping jiazhen shixue xide xinlu xiang[Multimodal learning analysis: understanding and evaluating the new direction of real learning]. Dianhua jiaoyu yanjiu,42 (02), 25-32.Google ScholarGoogle Scholar
  6. Blikstein,P.Worsley M. Multimodal Learning Analytics and Education Data Mining: Using Computational Technologies to Measure Complex Learning Tasks[J]. Journal of Learning Analytics, 2016,3 (2),220-238.Google ScholarGoogle ScholarCross RefCross Ref
  7. Chen,K.Q. Zhang,C.X. Wu,Y.Y.(2019).Jiaoyu rengong zhineng(EAI) zhongde duomo taixue xifen xi、shiying xingfan kuiji renji xietong [Multimodal learning analysis, adaptive feedback and human-machine collaboration in educational artificial intelligence(EAI)]. Yuancheng jiaoyu zazhi, 37 (05), 24-34.Google ScholarGoogle Scholar
  8. Li,S.N.(2019).Jiyu rengong zhineng jishu deke tangjiao xuexing weide fenxi kuangjia goujian yanjiu[Research on the construction of analytical framework of classroom teaching behavior based on AI technology]. Beijing youdian daxue.Google ScholarGoogle Scholar
  9. xAPI Base Standard Overview.md · main · xAPI / xapi-base-standard-documentation · GitLabGoogle ScholarGoogle Scholar
  10. Fang,H.G.Hu,Y.Y. Du,Z.(2015).Jiyu xAPI xuexi jilu de LMS wangluo xitong jiagou yanjiu[Research on LMS network system architecture based on xAPI learning records]. Zhongguo dianhua jiaoyu, 337 (02), 65-69.Google ScholarGoogle Scholar
  11. Ye,H.S.(2015).Shenti yuxue xi: jushen renzhi jiqi duichuan tongjiao yuguan detiao zhan[Body and learning: embodied cognition and its challenge to traditional education].JiaoyuJ yanjiu,36 (04), 104-114.Google ScholarGoogle Scholar
  12. Zhao,X.M. Zhong,S.C.(2021).Jushen renzhi shiyu xiacu jingao jiesi weifa zhande duomo taijiao huji zhiyan jiu[Research on multimodal interaction mechanism to promote the development of higher-order thinking from thet perspective of embodied cognition]. Dianhua jiaoyu yanjiu,42 (08),65-71+87.Google ScholarGoogle Scholar
  13. Li,H.M. Wang,L.L.Bian,P.Ji,H.L.Li,Qi.(2022).Mianxiang jiaoxue xingwei dashu jude ketang hudong shuangbian matong yongfen xikuang jiaji qibian shiying yong[A universal analytical framework for classroom interaction and double coding for big data of teaching behavior and its variant application]. Yuancheng jiaoyu zazhi,40 (03).Google ScholarGoogle Scholar
  14. Hu,Q.T.(2010).Lunxin xishi daide jiaoyu chuanbo yanjiu fanshi[On the Research Paradigm of Educational Communication in the Information Age]. Dianhua jiaoyu yanjiu,(12), 5-8.Google ScholarGoogle Scholar
  15. Ma,Y.F. Zheng,X.D. Zhao,R.Liu,H.(2022).Shengdu xuexi defa shengji zhiyu duomo taishu juping ceyan jiu[Research on the mechanism of deep learning and multimodal data evaluation]. Yuancheng jiaoyu zazhi,40 (01), 50-60.Google ScholarGoogle Scholar
  16. Yang,Y.J.Xu,G.Tong,H.(2022).Zhineng xuexi huanjing zhongji yuduo motai deshen duxue xijian ceyan jiu[Research on deep learning monitoring based on multimodal data in intelligent learning environment]. Dianhua jiaoyu yanjiu,43 (06),68-76.Google ScholarGoogle Scholar
  17. Liu,X. Liu,G.P. Liao,J.(2023).Zhihui jiaoshi jiegou moxing goujian yanjiu-”gongneng-jiegou” guanxi shijiao[Research on the construction of smart classroom structure model – “function-structure” relationship perspective]. Zhongguo yuancheng jiaoyu,43 (02),45-53.Google ScholarGoogle Scholar
  18. Wang,D.(2020).Jiyu xueqing dezhi huike tangjiao humo xingshe jiyu yingyong[Design and application of smart classroom interaction model based on learning situation annalysis]. Yunnan shifan daxue.Google ScholarGoogle Scholar

Index Terms

  1. Research on a Framework for Analyzing Interactive Behaviors in Smart Classroom Based on Multimodal Data and Its Application
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Other conferences
            ICDEL '23: Proceedings of the 2023 8th International Conference on Distance Education and Learning
            June 2023
            353 pages
            ISBN:9798400700422
            DOI:10.1145/3606094

            Copyright © 2023 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 29 August 2023

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed limited

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format .

          View HTML Format