skip to main content
10.1145/3408877.3432356acmconferencesArticle/Chapter ViewAbstractPublication PagessigcseConference Proceedingsconference-collections
research-article

The Impact of Programming Project Milestones on Procrastination, Project Outcomes, and Course Outcomes: A Quasi-Experimental Study in a Third-Year Data Structures Course

Published: 05 March 2021 Publication History

Abstract

When faced with a large and complex project for the first time, students face numerous self-regulatory challenges that they may be ill-equipped to overcome. These challenges can result in degraded project outcomes, as commonly observed in programming-intensive mid-level CS courses. We have previously found that success in these situations is associated with a disciplined personal software process. Procrastination is a prominent failure of self-regulation that can occur for a number of reasons, e.g., low expectancy of success, low perceived value of the task at hand, or decision-paralysis regarding how to begin when faced with a large task. It is pervasive, but may be addressed through targeted interventions. We draw on theory related to goal theory and problem-solving in engineering education to evaluate the value of explicit project milestones at curbing procrastination and its negative impacts on relatively long-running software projects. We conduct a quasi-experiment in which we study differences in project and course outcomes between students in a treatment (with milestones) and control group (without milestones). We found that students in the treatment group were more likely to finish their projects on time, produced projects with higher correctness, and finished the course with generally better outcomes. Within the treatment group, we found that students who completed more milestones saw better outcomes than those who completed fewer milestones. We found no differences in withdrawal or failure rates between the treatment and control groups. An end-of-term survey indicated that student perceptions of the milestones were overwhelmingly positive.

References

[1]
George Ainslie. 1975. Specious reward: a behavioral theory of impulsiveness and impulse control. Psychological bulletin 82, 4 (1975), 463. https://doi.org/10.1037/h0076860
[2]
T.N. Arvanitis, M.J. Todd, A.J. Gibb, and E. Orihashi. 2001. Understanding students? problem-solving performance in the context of programming-in-the-small: an ethnographic field study. In 31st Annual Frontiers in Education Conference. Impact on Engineering and Science Education. Conference Proceedings (Cat. No.01CH37193). IEEE, Reno, NV, USA, F1D--20--3. https://doi.org/10.1109/FIE.2001.963676
[3]
Richard D. Arvey, Maria Rotundo,Wendy Johnson, Zhen Zhang, and Matt McGue. 2006. The determinants of leadership role occupancy: Genetic and personality factors. The Leadership Quarterly 17, 1 (2006), 1 -- 20. https://doi.org/10.1016/j.leaqua.2005.10.009
[4]
Albert Bandura. 1997. Self-Efficacy: The Exercise of Control. Macmillan.
[5]
Morton B. Brown and Alan B. Forsythe. 1974. Robust Tests for the Equality of Variances. J. Amer. Statist. Assoc. 69, 346 (1974), 364--367. https://doi.org/10.1080/01621459.1974.10482955 arXiv:https://www.tandfonline.com/doi/pdf/10.1080/01621459.1974.10482955
[6]
Olive Jean Dunn. 1964. Multiple Comparisons Using Rank Sums. Technometrics 6, 3 (1964), 241--252. https://doi.org/10.1080/00401706.1964.10490181 arXiv:https://www.tandfonline.com/doi/pdf/10.1080/00401706.1964.10490181
[7]
Stephen H. Edwards. 2004. Using Software Testing to Move Students from Trial-and-Error to Reflection-in-Action. SIGCSE Bull. 36, 1 (March 2004), 26--30. https://doi.org/10.1145/1028174.971312
[8]
Stephen H. Edwards, Jason Snyder, Manuel A. Pérez-Quiñones, Anthony Allevato, Dongkwan Kim, and Betsy Tretola. 2009. Comparing Effective and Ineffective Behaviors of Student Programmers. In Proceedings of the Fifth International Workshop on Computing Education Research Workshop (ICER '09). ACM, New York, NY, USA, 3--14. https://doi.org/10.1145/1584322.1584325
[9]
Katrina Falkner, Rebecca Vivian, and Nickolas J. G. Falkner. 2013. Neo-Piagetian Forms of Reasoning in Software Development Process Construction. In Proceedings of the 2013 Learning and Teaching in Computing and Engineering (LATICE '13). IEEE Computer Society, USA, 31--38. https://doi.org/10.1109/LaTiCE.2013.23
[10]
Karl Pearson F.R.S. 1900. X. On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling. The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science 50, 302 (1900), 157--175. https://doi.org/10.1080/14786440009463897 arXiv:https://doi.org/10.1080/14786440009463897
[11]
Ayaan M. Kazerouni, Stephen H. Edwards, and Clifford A. Shaffer. 2017. Quantifying Incremental Development Practices and Their Relationship to Procrastination. In Proceedings of the 2017 ACM Conference on International Computing Education Research (Tacoma, Washington, USA) (ICER '17). ACM, New York, NY, USA, 191--199. https://doi.org/10.1145/3105726.3106180
[12]
Aaron Keen and Kurt Mammen. 2015. Program Decomposition and Complexity in CS1. In Proceedings of the 46th ACM Technical Symposium on Computer Science Education - SIGCSE '15. ACM Press, Kansas City, Missouri, USA, 48--53. https://doi.org/10.1145/2676723.2677219
[13]
William H. Kruskal and W. Allen Wallis. 1952. Use of Ranks in One-Criterion Variance Analysis. J. Amer. Statist. Assoc. 47, 260 (1952), 583--621. https://doi.org/10.1080/01621459.1952.10483441 arXiv:https://www.tandfonline.com/doi/pdf/10.1080/01621459.1952.10483441
[14]
Joshua Martin, Stephen H. Edwards, and Clfford A. Shaffer. 2015. The Effects of Procrastination Interventions on Programming Project Success. In Proceedings of the Eleventh Annual International Conference on International Computing Education Research (Omaha, Nebraska, USA) (ICER '15). ACM, New York, NY, USA, 3--11. https://doi.org/10.1145/2787622.2787730
[15]
Briana B. Morrison, Lauren E. Margulieux, and Mark Guzdial. 2015. Subgoals, Context, and Worked Examples in Learning Computing Problem Solving. In Proceedings of the eleventh annual International Conference on International Computing Education Research - ICER '15. ACM Press, Omaha, Nebraska, USA, 21--29.https://doi.org/10.1145/2787622.2787733
[16]
Michael K. Ponton, Julie Horine Edmister, Lawrence S. Ukeiley, and John M. Seiner. 2001. Understanding the Role of Self-Efficacy in Engineering Education. Journal of Engineering Education 90, 2 (April 2001), 247--251. https://doi.org/10.1002/j.2168--9830.2001.tb00599.x
[17]
Alex Radermacher, Gursimran Walia, and Dean Knudson. 2014. Investigating the Skill Gap between Graduating Students and Industry Expectations. In Companion Proceedings of the 36th International Conference on Software Engineering (Hyderabad, India) (ICSE Companion 2014). Association for Computing Machinery, New York, NY, USA, 291--300. https://doi.org/10.1145/2591062.2591159
[18]
Samuel S. Shapiro and Martin B. Wilk. 1965. An analysis of variance test for normality (complete samples)?. Biometrika 52, 3--4 (12 1965), 591--611. https://doi.org/10.1093/biomet/52.3--4.591 arXiv:https://academic.oup.com/biomet/articlepdf/52/3--4/591/962907/52--3--4--591.pdf
[19]
Maury Silver. 1974. Procrastination. Centerpoint (1974).
[20]
Ting Song and Kurt Becker. 2014. Expert vs. novice: Problem decomposition/recomposition in engineering design. In 2014 International Conference on Interactive Collaborative Learning (ICL). IEEE, Dubai, United Arab Emirates, 181--190. https://doi.org/10.1109/ICL.2014.7017768
[21]
Piers Steel. 2007. The nature of procrastination: A meta-analytic and theoretical review of quintessential self-regulatory failure. Psychological Bulletin 133, 1 (2007), 65--94. https://doi.org/10.1037/0033--2909.133.1.65
[22]
Jennifer Stock and Daniel Cervone. 1990. Proximal goal-setting and selfregulatory processes. Cognitive Therapy and Research 14, 5 (Oct. 1990), 483--498. https://doi.org/10.1007/BF01172969
[23]
Bruce W. Tuckman. 1991. The Development and Concurrent Validity of the Procrastination Scale. Educational and Psychological Measurement 51, 2 (June 1991), 473--480. https://doi.org/10.1177/0013164491512022
[24]
B. L. Welch. 1947. The Generalization of 'Student's? Problem When Several Different Population Variances are Involved. Biometrika 34, 1--2 (01 1947), 28--35. https://doi.org/10.1093/biomet/34.1--2.28 arXiv:https://academic.oup.com/biomet/article-pdf/34/1--2/28/553093/34--1--2--28.pdf

Cited By

View all
  • (2025)Using a wider digital ecosystem to improve self-regulated learningFrontiers in Education10.3389/feduc.2025.148734410Online publication date: 27-Feb-2025
  • (2024)Steering Student Behavior and Performance Toward Success with Mastery Learning through Policy OptimizationProceedings of the 2024 on ACM Virtual Global Computing Education Conference V. 110.1145/3649165.3690109(144-150)Online publication date: 5-Dec-2024
  • (2024)Effect of Deadlines on Student Submission Timelines and Success in a Fully-Online Self-Paced CourseProceedings of the 55th ACM Technical Symposium on Computer Science Education V. 110.1145/3626252.3630837(207-213)Online publication date: 7-Mar-2024
  • Show More Cited By

Index Terms

  1. The Impact of Programming Project Milestones on Procrastination, Project Outcomes, and Course Outcomes: A Quasi-Experimental Study in a Third-Year Data Structures Course

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SIGCSE '21: Proceedings of the 52nd ACM Technical Symposium on Computer Science Education
      March 2021
      1454 pages
      ISBN:9781450380621
      DOI:10.1145/3408877
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 05 March 2021

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. problem decomposition
      2. procrastination
      3. software development
      4. software project management

      Qualifiers

      • Research-article

      Conference

      SIGCSE '21
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,787 of 5,146 submissions, 35%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)86
      • Downloads (Last 6 weeks)8
      Reflects downloads up to 02 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)Using a wider digital ecosystem to improve self-regulated learningFrontiers in Education10.3389/feduc.2025.148734410Online publication date: 27-Feb-2025
      • (2024)Steering Student Behavior and Performance Toward Success with Mastery Learning through Policy OptimizationProceedings of the 2024 on ACM Virtual Global Computing Education Conference V. 110.1145/3649165.3690109(144-150)Online publication date: 5-Dec-2024
      • (2024)Effect of Deadlines on Student Submission Timelines and Success in a Fully-Online Self-Paced CourseProceedings of the 55th ACM Technical Symposium on Computer Science Education V. 110.1145/3626252.3630837(207-213)Online publication date: 7-Mar-2024
      • (2024)The Temporal Dynamics of Procrastination and its Impact on Academic Performance: The Case of a Task-oriented Programming CourseProceedings of the 39th ACM/SIGAPP Symposium on Applied Computing10.1145/3605098.3636072(48-55)Online publication date: 8-Apr-2024
      • (2024)Introduction to Parallel and Distributed Programming using N-Body SimulationsProceedings of the SC '24 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis10.1109/SCW63240.2024.00052(347-354)Online publication date: 17-Nov-2024
      • (2024)Identifying critical self-regulated learning skills: a Delphi process studyComputer Science Education10.1080/08993408.2024.2382631(1-28)Online publication date: 27-Oct-2024
      • (2023)Reducing Procrastination Without Sacrificing Students' Autonomy Through Optional Weekly Presentations of Student-Generated ContentProceedings of the 54th ACM Technical Symposium on Computer Science Education V. 110.1145/3545945.3569839(151-157)Online publication date: 2-Mar-2023
      • (2022)Experiences With and Lessons Learned on Deadlines and Submission BehaviorProceedings of the 22nd Koli Calling International Conference on Computing Education Research10.1145/3564721.3564728(1-13)Online publication date: 17-Nov-2022
      • (2022)A first offering of software engineeringProceedings of the First International Workshop on Designing and Running Project-Based Courses in Software Engineering Education10.1145/3524487.3527357(5-9)Online publication date: 19-May-2022
      • (2022)Metacognition and Self-Regulation in Programming Education: Theories and Exemplars of UseACM Transactions on Computing Education10.1145/348705022:4(1-31)Online publication date: 15-Sep-2022
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media