Work in Progress

Toward the Evaluation of Educational Videos using Bayesian Knowledge Tracing and Big Data

Authors:

Zachary MacHardy,

Zachary A. PardosAuthors Info & Claims

L@S '15: Proceedings of the Second (2015) ACM Conference on Learning @ Scale

Pages 347 - 350

https://doi.org/10.1145/2724660.2728690

Published: 14 March 2015 Publication History

Get Access

Abstract

Along with the advent of MOOCs and other online learning platforms such as Khan Academy, the role of online education has continued to grow in relation to that of traditional on-campus instruction. Rather than tackle the problem of evaluating large educational units such as entire online courses, this paper approaches a smaller problem: exploring a framework for evaluating more granular educational units, in this case, short educational videos. We have chosen to leverage an adaptation of traditional Bayesian Knowledge Tracing (BKT), intended to incorporate the usage of video content in addition to assessment activity. By exploring the change in predictive error when alternately including or omitting video activity, we suggest a metric for determining the relevance of videos to associated assessments. To validate our hypothesis and demonstrate the application of our proposed methods we use data obtained from the popular Khan Academy website.

References

[1]

Achtemeier, S. D., Morris, L. V., and Finnegan, C. L. Considerations for developing evaluations of online courses. Journal of Asynchronous Learning Networks 7, 1 (2003), 1--13.

Google Scholar

[2]

Corbett, A. T., and Anderson, J. R. Knowledge tracing: Modeling the acquisition of procedural knowledge. User Modeling and User-Adapted Interaction 4, 4 (Dec. 1994), 253--278.

Google Scholar

[3]

Lindsey, R. V., Khajah, M., and Mozer, M. C. Automatic discovery of cognitive skills to improve the prediction of student learning.

Google Scholar

[4]

Linn, M. C., Davis, E. A., Bell, P., and Bell, A. P. D. o. M. C. P. Internet Environments for Science Education. Routledge, July 2013.

Crossref

Google Scholar

[5]

Oncu, S., and Cakir, H. Research in online learning environments: Priorities and methodologies. Computers & Education 57, 1 (Aug. 2011), 1098--1108.

Digital Library

Google Scholar

[6]

Pardos, Z. A., Bergner, Y., Seaton, D. T., and Pritchard, D. E. Adapting bayesian knowledge tracing to a massive open online course in edX. Proceedings of EDM 2013 (2013), 137--144.

Google Scholar

[7]

Song, L., Singleton, E. S., Hill, J. R., and Koh, M. H. Improving online learning: Student perceptions of useful and challenging characteristics. The internet and higher education 7, 1 (2004), 59--70.

Google Scholar

Cited By

View all

Dol SJawandhiya P(2024)Systematic Review and Analysis of EDM for Predicting the Academic Performance of StudentsJournal of The Institution of Engineers (India): Series B10.1007/s40031-024-00998-0105:4(1021-1071)Online publication date: 4-Feb-2024
https://doi.org/10.1007/s40031-024-00998-0
Šarić-Grgić IGrubišić AGašpar A(2024)Twenty-five years of Bayesian knowledge tracing: a systematic reviewUser Modeling and User-Adapted Interaction10.1007/s11257-023-09389-434:4(1127-1173)Online publication date: 27-Jan-2024
https://dl.acm.org/doi/10.1007/s11257-023-09389-4
Olayiwola JAkanmu AGao XMurzi HAfsari K(2023)Design and Usability Evaluation of an Annotated Video–Based Learning Environment for Construction Engineering EducationJournal of Computing in Civil Engineering10.1061/JCCEE5.CPENG-520637:6Online publication date: Nov-2023
https://doi.org/10.1061/JCCEE5.CPENG-5206
Show More Cited By

Index Terms

Toward the Evaluation of Educational Videos using Bayesian Knowledge Tracing and Big Data
1. Applied computing
  1. Education
    1. Computer-assisted instruction

Recommendations

Structured Knowledge Tracing Models for Student Assessment on Coursera
L@S '16: Proceedings of the Third (2016) ACM Conference on Learning @ Scale

Massive Open Online Courses (MOOCs) provide an effective learning platform with various high-quality educational materials accessible to learners from all over the world. However, current MOOCs lack personalized learning guidance and intelligent ...
Towards an educational design pattern language to support the development of open educational resources in videos for the MOOC context
PLoP '19: Proceedings of the 26th Conference on Pattern Languages of Programs

The creation and adoption of Massive Open Online Courses (MOOCs) can bring many benefits and impact on education, such as put forward diversity in education; enhance student's learning by encouraging and engaging them for lifelong learning; connect with ...
RIMES: Embedding Interactive Multimedia Exercises in Lecture Videos
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Teachers in conventional classrooms often ask learners to express themselves and show their thought processes by speaking out loud, drawing on a whiteboard, or even using physical objects. Despite the pedagogical value of such activities, interactive ...

Comments

Information & Contributors

Information

Published In

L@S '15: Proceedings of the Second (2015) ACM Conference on Learning @ Scale

March 2015

438 pages

ISBN:9781450334112

DOI:10.1145/2724660

General Chair:
Gregor Kiczales
University of British Columbia
,
Program Chairs:
Daniel M. Russell
Google
,
Beverly Woolf
University of Massachusets, Amherst

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 March 2015

Check for updates

Author Tags

Qualifiers

Work in progress

Conference

L@S 2015

Sponsor:

ACM Ed Board

L@S 2015: Second (2015) ACM Conference on Learning @ Scale

March 14 - 18, 2015

BC, Vancouver, Canada

Acceptance Rates

L@S '15 Paper Acceptance Rate 23 of 90 submissions, 26%;

Overall Acceptance Rate 117 of 440 submissions, 27%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
280
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Dol SJawandhiya P(2024)Systematic Review and Analysis of EDM for Predicting the Academic Performance of StudentsJournal of The Institution of Engineers (India): Series B10.1007/s40031-024-00998-0105:4(1021-1071)Online publication date: 4-Feb-2024
https://doi.org/10.1007/s40031-024-00998-0
Šarić-Grgić IGrubišić AGašpar A(2024)Twenty-five years of Bayesian knowledge tracing: a systematic reviewUser Modeling and User-Adapted Interaction10.1007/s11257-023-09389-434:4(1127-1173)Online publication date: 27-Jan-2024
https://dl.acm.org/doi/10.1007/s11257-023-09389-4
Olayiwola JAkanmu AGao XMurzi HAfsari K(2023)Design and Usability Evaluation of an Annotated Video–Based Learning Environment for Construction Engineering EducationJournal of Computing in Civil Engineering10.1061/JCCEE5.CPENG-520637:6Online publication date: Nov-2023
https://doi.org/10.1061/JCCEE5.CPENG-5206
Alexandron GYoo LRuipérez-Valiente JLee SPritchard D(2019)Are MOOC Learning Analytics Results Trustworthy? With Fake Learners, They Might Not Be!International Journal of Artificial Intelligence in Education10.1007/s40593-019-00183-129:4(484-506)Online publication date: 2-Jul-2019
https://doi.org/10.1007/s40593-019-00183-1
Alexandron GRuipérez-Valiente JLee SPritchard D(2018)Evaluating the Robustness of Learning Analytics Results Against Fake LearnersLifelong Technology-Enhanced Learning10.1007/978-3-319-98572-5_6(74-87)Online publication date: 14-Aug-2018
https://doi.org/10.1007/978-3-319-98572-5_6

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Structured Knowledge Tracing Models for Student Assessment on Coursera

Towards an educational design pattern language to support the development of open educational resources in videos for the MOOC context

RIMES: Embedding Interactive Multimedia Exercises in Lecture Videos

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations