skip to main content
10.1145/3478431.3499368acmconferencesArticle/Chapter ViewAbstractPublication PagessigcseConference Proceedingsconference-collections
research-article
Open access

Cheating Detection in Online Assessments via Timeline Analysis

Published: 22 February 2022 Publication History

Abstract

The potential for academic integrity violations increases in online courses and instructors must place extra attention on academic integrity, since cheating techniques and costs are different than in the physical classroom. Although students are less supervised and able to study in a self-paced mode in online learning, unauthorized collaboration is still considered to be a serious integrity violation. However, online learning platforms have the advantage that they may capture detailed timelines of student activity. Analysis of these can enable instructors to detect many patterns of collaboration, e.g., working on assessments together, or copying solutions from unauthorized web pages. In this paper, we describe detection methods for several common patterns of alignment between work timelines of pairs of students, and these patterns' relationship with corroborative evidence such as similar answers and unusually fast completion times. We describe data collection necessary to apply the timeline analysis technique to weekly quiz assessments and project submissions, and discuss the strength of evidence the technique can provide in different situations. We have been applying these techniques in an online project-based course over several years, and it has helped instructors to successfully identify potential cheating cases.

Supplementary Material

MP4 File (SIGCSE22-V1fp423v.mp4)
Presentation video for "Cheating Detection in Online Assessments via Timeline Analysis"; in this paper, we discuss the advantages and limitations of timeline analysis that captures student behavior patterns from online learning platform log data and how this technique fits into a larger strategy of cheat checking for an online course

References

[1]
Raghav Apoorv, Akshay Dahiya, Uma Sreeram, Bharat Rahuldhev Patil, India Irish, Rocko Graziano, and Thad Starner. 2020. Examinator: A Plagiarism Detection Tool for Take-Home Exams . Proc. Conf. on Learning @ Scale (L@S) (2020), 261--264. https://doi.org/10.1145/3386527.3406723
[2]
Mark N Bing, H Kristl Davison, Scott J Vitell, P Anthony, Bart L Garner, Milorad M Novicevic, Mark ? Bing, and Milorad M Novicevic. 2012. An Experimental Investigation oí an Interactive Model of Academic Cheating Among Business School Students . Academy of management Learning and Education, Vol. 11, 1 (2012), 28--48.
[3]
Jeremy Blackburn, Nicolas Kourtellis, John Skvoretz, Matei Ripeanu, and Adriana Iamnitchi. 2014. Cheating in online games: A social network perspective . ACM Transactions on Internet Technology, Vol. 13, 3 (2014). https://doi.org/10.1145/2602570
[4]
Binglin Chen, Matthew West, and Craig Zilles. 2017. Do performance trends suggest wide-spread collaborative cheating on asynchronous exams? Proc. Conf. on Learning @ Scale (L@S) 2 (2017), 111--120. https://doi.org/10.1145/3051457.3051465
[5]
Seife Dendir and R Stockton Maxwell. 2020. Cheating in online courses: Evidence from online proctoring. Computers in Human Behavior Reports, Vol. 2 (2020), 100033.
[6]
Olivia L. Holden, Meghan E. Norris, and Valerie A. Kuhlmeier. 2021. Academic Integrity in Online Assessment: A Research Review . Frontiers in Education, Vol. 6, July (2021), 1--13. https://doi.org/10.3389/feduc.2021.639814
[7]
Frank M Loschiavo and Mark A Shatz. 2011. The Impact of an Honor Code on Cheating in Online Courses . Journal of Online Learning and Teaching, Vol. 7, 2 (2011), 179--184.
[8]
Marsha C. Lovett, O. Meyer, and Candace Thille. 2008. The Open Learning Initiative: Measuring the Effectiveness of the OLI Statistics Course in Accelerating Student Learning. Journal of interactive media in education, Vol. 2008 (2008), 13.
[9]
Tony Mason, Ada Gavrilovska, and David A Joyner. 2019. Collaboration versus cheating: Reducing code plagiarism in an online MS computer science program. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education. 1004--1010.
[10]
Arden Miller and Adena D Young-Jones. 2012. Academic integrity: Online classes compared to face-to-face classes. Journal of Instructional Psychology, Vol. 39, 3 (2012).
[11]
Curtis G. Northcutt, Andrew D. Ho, and Isaac L. Chuang. 2016. Detecting and preventing "multiple-account" cheating in massive open online courses . Computers and Education, Vol. 100 (2016), 71--80. https://doi.org/10.1016/j.compedu.2016.04.008 arxiv: 1508.05699
[12]
Douglas Attoh Odongo, Eric Agyemang, and John Boulard Forkuor. 2021. Innovative Approaches to Cheating : An Exploration of Examination Cheating Techniques among Tertiary Students . Education Research International, Vol. 2021 (2021), 12--16.
[13]
Yehuda Peled, Yovav Eshet, Casimir Barczyk, and Keren Grinautski. 2019. Predictors of Academic Dishonesty among undergraduate students in online and face-to-face courses. Computers & Education, Vol. 131 (2019), 49--59.
[14]
Jonathan Pierce and Craig Zilles. 2017. Investigating student plagiarism patterns and correlations to grades. In ACM SIGCSE Tech. Symp. on Computer Science Education (SIGCSE). 471--476. https://doi.org/10.1145/3017680.3017797
[15]
Jochen Ranger, Nico Schmidt, and Anett Wolgast. 2020. The Detection of Cheating on E-Exams in Higher Education-The Performance of Several Old and Some New Indicators . Frontiers in Psychology, Vol. 11, October (2020), 1--16. https://doi.org/10.3389/fpsyg.2020.568825
[16]
Peter Salhofer. 2017. Analysing Student Behavior in CS Courses . 2017 IEEE Global Engineering Education Conference (EDUCON) April (2017), 1426--1431.
[17]
Vicenzo Abichequer Sangalli, Gonzalo Martinez-Munoz, and Estrella Pulido Canabate. 2020. Identifying cheating users in online courses . IEEE Global Engineering Education Conference, EDUCON, Vol. 2020-April (2020), 1168--1175. https://doi.org/10.1109/EDUCON45650.2020.9125252
[18]
Saul Schleimer, Daniel S. Wilkerson, and Alex Aiken. 2003. Winnowing: Local Algorithms for Document Fingerprinting . Proceedings of the ACM SIGMOD International Conference on Management of Data (2003), 76--85.
[19]
George Watson and James Sottile. 2010. Cheating in the Digital Age: Do Students Cheat More in Online Courses?. Online Journal of Distance Learning Administration, Vol. 13, 1 (2010).
[20]
Lisa Yan, Nick McKeown, Mehran Sahami, and Chris Piech. 2018. TMOSS: Using intermediate assignment work to understand excessive collaboration in large classes. In Proceedings of the 49th ACM technical symposium on computer science education. 110--115.

Cited By

View all
  • (2025)Towards Fair Assessments: A Machine Learning-based Approach for Detecting Cheating in Online AssessmentsProceedings of the 15th International Learning Analytics and Knowledge Conference10.1145/3706468.3706482(104-114)Online publication date: 3-Mar-2025
  • (2025)Midterm Exam Outliers Efficiently Highlight Potential Cheaters on Programming AssignmentsProceedings of the 56th ACM Technical Symposium on Computer Science Education V. 110.1145/3641554.3701883(437-442)Online publication date: 12-Feb-2025
  • (2025)Impact of evaluation method shifts on student performance: an analysis of irregular improvement in passing percentages during COVID-19 at an Ecuadorian institutionInternational Journal for Educational Integrity10.1007/s40979-024-00179-y21:1Online publication date: 24-Jan-2025
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGCSE 2022: Proceedings of the 53rd ACM Technical Symposium on Computer Science Education - Volume 1
February 2022
1049 pages
ISBN:9781450390705
DOI:10.1145/3478431
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 February 2022

Check for updates

Badges

  • Best Paper

Author Tags

  1. academic integrity
  2. cheating detection
  3. cheating patterns
  4. educational data mining
  5. online assessment
  6. timeline analysis

Qualifiers

  • Research-article

Funding Sources

Conference

SIGCSE 2022
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,787 of 5,146 submissions, 35%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)286
  • Downloads (Last 6 weeks)26
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Towards Fair Assessments: A Machine Learning-based Approach for Detecting Cheating in Online AssessmentsProceedings of the 15th International Learning Analytics and Knowledge Conference10.1145/3706468.3706482(104-114)Online publication date: 3-Mar-2025
  • (2025)Midterm Exam Outliers Efficiently Highlight Potential Cheaters on Programming AssignmentsProceedings of the 56th ACM Technical Symposium on Computer Science Education V. 110.1145/3641554.3701883(437-442)Online publication date: 12-Feb-2025
  • (2025)Impact of evaluation method shifts on student performance: an analysis of irregular improvement in passing percentages during COVID-19 at an Ecuadorian institutionInternational Journal for Educational Integrity10.1007/s40979-024-00179-y21:1Online publication date: 24-Jan-2025
  • (2024)Answer Watermarking: Using Answer Generation Assistance Tools to Find Evidence of CheatingProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664712(519-523)Online publication date: 9-Jul-2024
  • (2024)Examinator v4.0 : Cheating Detection in Online Take-Home ExamsProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664659(330-334)Online publication date: 9-Jul-2024
  • (2023)Examinator v3.0: Cheating Detection in Online Take-Home ExamsProceedings of the Tenth ACM Conference on Learning @ Scale10.1145/3573051.3596196(401-405)Online publication date: 20-Jul-2023
  • (2023)Mining Online Homework Clickstream: Detecting Students' Cooperative Behavior2023 35th Chinese Control and Decision Conference (CCDC)10.1109/CCDC58219.2023.10327133(4959-4965)Online publication date: 20-May-2023
  • (2023)From crisis to opportunity: practices and technologies for a more effective post-COVID classroomEducation and Information Technologies10.1007/s10639-023-11929-929:5(5981-6003)Online publication date: 22-Jul-2023

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media