skip to main content
10.1145/3328778.3366827acmconferencesArticle/Chapter ViewAbstractPublication PagessigcseConference Proceedingsconference-collections
research-article

Investigating Patterns of Study Persistence on Self-Assessment Platform of Programming Problem-Solving

Published:26 February 2020Publication History

ABSTRACT

A student's short-term study behavior may not necessary infer his/her long-term behavior. It is very common to see a student changes study strategy throughout a semester and adapts to learning condition. For example, a student may work very hard before the first exam but gradually reducing the effort due to several possible reasons, e.g., being overwhelmed by various course work or discouraged by increasing complexity in the subject. Consistency or differences of one student's behavior is more likely to be discovered by multiple granularity of learning analytics. In this study, we investigate students' study persistence on a self-assessment platform and explore how such a behavioral pattern is related to the performance in exams. A probabilistic mixture model trained by response streams of log data is applied to cluster students' behavior into persistence patterns, which are further categorized into "micro" (short-term) and "macro" (long-term) patterns according to the span of time being modeled. We found four types of micro persistence patterns and several macro patterns in the analysis and analyzed their relations with exam performances. The result suggests that the consistency of persistence patterns can be an important factor driving student's overall performance in the semester, and students achieving higher exam scores show relatively persistent behavior compared to students receiving lower scores.

References

  1. Marzieh Ahmadzadeh, Dave Elliman, and Colin Higgins. 2005. An analysis of patterns of debugging among novice computer science students . ACM SIGCSE Bulletin , Vol. 37, 3 (9 2005), 84. https://doi.org/10.1145/1151954.1067472Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Amjad Altadmri and Neil C C Brown. 2015. 37 Million Compilations: Investigating Novice Programming Mistakes in Large-Scale Student Data. In Proceedings of the 46th ACM Technical Symposium on Computer Science Education (SIGCSE '15). ACM, New York, NY, USA, 522--527. https://doi.org/10.1145/2676723.2677258Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Mohammed Alzaid, Devanshi Trivedi, and I-Han Hsiao. 2017. The effects of bite-size distributed practices for programming novices. In 2017 IEEE Frontiers in Education Conference (FIE). IEEE, 1--9. https://doi.org/10.1109/FIE.2017.8190593Google ScholarGoogle ScholarCross RefCross Ref
  4. Susan Bergin, Ronan Reilly, and Desmond Traynor. 2005. Examining the role of self-regulated learning on introductory programming performance. In Proceedings of the 2005 international workshop on Computing education research - ICER '05. ACM Press, New York, New York, USA, 81--86. https://doi.org/10.1145/1089786.1089794Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Paulo Blikstein, Marcelo Worsley, Chris Piech, Mehran Sahami, Steven Cooper, and Daphne Koller. 2014. Programming pluralism: Using learning analytics to detect patterns in the learning of computer programming . Journal of the Learning Sciences , Vol. 23, 4 (2014), 561--599.Google ScholarGoogle ScholarCross RefCross Ref
  6. Frank N. Dempster. 1988. The spacing effect: A case study in the failure to apply the results of psychological research. American Psychologist , Vol. 43, 8 (1988), 627--634. https://doi.org/10.1037/0003-066X.43.8.627Google ScholarGoogle ScholarCross RefCross Ref
  7. Anthony Estey, Hieke Keuning, and Yvonne Coady. 2017. Automatically Classifying Students in Need of Support by Detecting Changes in Programming Behaviour. In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education - SIGCSE '17 . ACM Press, New York, New York, USA, 189--194. https://doi.org/10.1145/3017680.3017790Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Anneli Etel"a pelto. 1993. Metacognition and the Expertise of Computer Program Comprehension . Scandinavian Journal of Educational Research , Vol. 37, 3 (1 1993), 243--254. https://doi.org/10.1080/0031383930370305Google ScholarGoogle Scholar
  9. Katrina Falkner, Rebecca Vivian, and Nickolas J.G. Falkner. 2014. Identifying computer science self-regulated learning strategies. In Proceedings of the 2014 conference on Innovation & technology in computer science education - ITiCSE '14. ACM Press, New York, New York, USA, 291--296. https://doi.org/10.1145/2591708.2591715Google ScholarGoogle Scholar
  10. Sue Fitzgerald, Gary Lewandowski, Renée McCauley, Laurie Murphy, Beth Simon, Lynda Thomas, and Carol Zander. 2008. Debugging: finding, fixing and flailing, a multi-institutional study of novice debuggers . Computer Science Education , Vol. 18, 2 (2008), 93--116. https://doi.org/10.1080/08993400802114508Google ScholarGoogle ScholarCross RefCross Ref
  11. I-Han Hsiao, Po-Kai Huang, and Hannah Murphy. 2017. Uncovering reviewing and reflecting behaviors from paper-based formal assessment. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference on - LAK '17. ACM Press, New York, New York, USA, 319--328. https://doi.org/10.1145/3027385.3027415Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. I-H Hsiao, Sergey Sosnovsky, and Peter Brusilovsky. 2010. Guiding students to the right questions: adaptive navigation support in an E-Learning system for Java programming . Journal of Computer Assisted Learning , Vol. 26, 4 (2010), 270--283.Google ScholarGoogle ScholarCross RefCross Ref
  13. Kalle Ilves, Juho Leinonen, and Arto Hellas. 2018. Supporting Self-Regulated Learning with Visualizations in Online Learning Environments. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education - SIGCSE '18. ACM Press, New York, New York, USA, 257--262. https://doi.org/10.1145/3159450.3159509Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Avi Kaplan and Martin L. Maehr. 2007. The Contributions and Prospects of Goal Orientation Theory . Educational Psychology Review , Vol. 19, 2 (4 2007), 141--184. https://doi.org/10.1007/s10648-006--9012--5Google ScholarGoogle ScholarCross RefCross Ref
  15. Hassan Khosravi and Kendra M.L. Cooper. 2017. Using Learning Analytics to Investigate Patterns of Performance and Engagement in Large Classes. In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education - SIGCSE '17 . ACM Press, New York, New York, USA, 309--314. https://doi.org/10.1145/3017680.3017711Google ScholarGoogle Scholar
  16. Dongho Kim, Meehyun Yoon, Il Hyun Jo, and Robert Maribe Branch. 2018. Learning analytics to support self-regulated learning in asynchronous online courses: A case study at a women's university in South Korea . Computers and Education , Vol. 127, September 2016 (2018), 233--251. https://doi.org/10.1016/j.compedu.2018.08.023Google ScholarGoogle ScholarCross RefCross Ref
  17. René F. Kizilcec, Mar Pé rez-Sanagustí n, and Jorge J. Maldonado. 2017. Self-regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses . Computers & Education , Vol. 104 (1 2017), 18--33. https://doi.org/10.1016/j.compedu.2016.10.001Google ScholarGoogle Scholar
  18. Dastyni Loksa, Andrew J Ko, Will Jernigan, Alannah Oleson, Christopher J Mendez, and Margaret M Burnett. 2016. Programming, Problem Solving, and Self-Awareness: Effects of Explicit Guidance. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16 . ACM Press, New York, New York, USA, 1449--1461. https://doi.org/10.1145/2858036.2858252Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Yihan Lu and I-Han Hsiao. 2017. Personalized Information Seeking Assistant (PiSA): from programming information seeking to learning . Information Retrieval Journal , Vol. 20, 5 (2017), 433--455.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Jihyun Park, Renzhe Yu, Fernando Rodriguez, Rachel Baker, Padhraic Smyth, and Mark Warschauer. 2018. Understanding Student Procrastination via Mixture Models. In Educational Data Mining . International Educational Data Mining Society, Buffalo, NY, 187--197. http://educationaldatamining.org/EDM2018/proceedings/Google ScholarGoogle Scholar
  21. Paul R Pintrich, David A F Smith, Teresa Garcia, and Wilbert J Mckeachie. 1993. Reliability and Predictive Validity of the Motivated Strategies for Learning Questionnaire (Mslq) . Educational and Psychological Measurement , Vol. 53, 3 (9 1993), 801--813. https://doi.org/10.1177/0013164493053003024Google ScholarGoogle Scholar
  22. Arthur E. Poropat. 2009. A meta-analysis of the five-factor model of personality and academic performance. Psychological Bulletin , Vol. 135, 2 (2009), 322--338. https://doi.org/10.1037/a0014996Google ScholarGoogle ScholarCross RefCross Ref
  23. Jaime Spacco, Paul Denny, Brad Richards, David Babcock, David Hovemeyer, James Moscola, and Robert Duvall. 2015. Analyzing Student Work Patterns Using Programming Exercise Data. In Proceedings of the 46th ACM Technical Symposium on Computer Science Education - SIGCSE '15 . ACM Press, New York, New York, USA, 18--23. https://doi.org/10.1145/2676723.2677297Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Sabrina Trapmann, Benedikt Hell, Jan-Oliver W Hirn, and Heinz Schuler. 2007. Meta-analysis of the relationship between the Big Five and academic success at university . Zeitschrift fü r Psychologie/Journal of Psychology , Vol. 215, 2 (2007), 132--151.Google ScholarGoogle ScholarCross RefCross Ref
  25. C.E. Weinstein, D.R. Palmer, and A.C. Schulte. 1987. The Learning and Study Strategies Inventory . Clearwater, FL: H & H Publishing , Vol. 30, 1 (1987), 115--126. http://www.amazon.com/dp/0131723154Google ScholarGoogle Scholar
  26. Philip H Winne, John C Nesbit, Vive Kumar, Allyson F Hadwin, Susanne P Lajoie, Roger Azevedo, and Nancy E Perry. 2006. Supporting self-regulated learning with gStudy software: The Learning Kit Project . Technology Instruction Cognition and Learning , Vol. 3, 1/2 (2006), 105.Google ScholarGoogle Scholar
  27. Barry J Zimmerman. 2008. Investigating Self-Regulation and Motivation: Historical Background, Methodological Developments, and Future Prospects . American Educational Research Journal , Vol. 45, 1 (3 2008), 166--183. https://doi.org/10.3102/0002831207312909Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Investigating Patterns of Study Persistence on Self-Assessment Platform of Programming Problem-Solving

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        SIGCSE '20: Proceedings of the 51st ACM Technical Symposium on Computer Science Education
        February 2020
        1502 pages
        ISBN:9781450367936
        DOI:10.1145/3328778

        Copyright © 2020 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 26 February 2020

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate1,595of4,542submissions,35%

        Upcoming Conference

        SIGCSE Virtual 2024
        SIGCSE Virtual 2024: ACM Virtual Global Computing Education Conference
        November 30 - December 1, 2024
        Virtual Event , USA

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader