skip to main content
10.1145/3478431.3499313acmconferencesArticle/Chapter ViewAbstractPublication PagessigcseConference Proceedingsconference-collections
research-article

Another Victim of COVID-19: Computer Science Education

Published:22 February 2022Publication History

ABSTRACT

Prior literature suggests that computer science education (CSE) was less affected by the pandemic than other disciplines. However, it is unclear how the pandemic affected the quality and quantity of students' studying in CSE. We measure the impact of the pandemic on the amount and spacing of students' studying in a large introductory computer science course. Spacing is defined as the distribution of studying over multiple sessions, which is shown to improve long-term learning. Using multiple regression models, we analyzed the total number of students' interactions with the eBook and the number of days they used it, as a proxy for studying amount and spacing, respectively. We compared two sequential winter semesters of the course, one during (Winter 2021) and one prior to the pandemic (Winter 2020). After controlling for possible confounders, the results show that students had 1,345.87 fewer eBook interactions and distributed their studying on 2.36 fewer days during the pandemic when compared to the previous semester prior to the pandemic. We also compared four semesters prior to the pandemic (Fall and Winter of 2018 and 2019) to two semesters during the pandemic (Fall 2020 and Winter 2021). We found, on average, students had 3,376.30 fewer interactions with the eBook and studied the eBook on 16.35 fewer days during the pandemic. Contrary to prior studies, our results indicate that the pandemic negatively affected the amount and spacing of studying in an introductory computer science course, which may have a negative impact on their education.

Skip Supplemental Material Section

Supplemental Material

SIGCSE22V1-fp207v.mp4

mp4

210.7 MB

References

  1. Fadzlin Ahmadon, Hajar Izzati Mohd Ghazalli, and Hazlifah Mohd Rusli. 2020. Studying during Pandemic: A Review of Issues from Online Learning in the Middle of COVID-19. In 2020 6th International Conference on Interactive Digital Media (ICIDM). IEEE, 1--4.Google ScholarGoogle ScholarCross RefCross Ref
  2. Mohammed Alzaid, Devanshi Trivedi, and I-Han Hsiao. 2017. The effects of bite-size distributed practices for programming novices. In 2017 IEEE Frontiers in Education Conference (FIE). IEEE, 1--9.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Ronnie E Baticulon, Jinno Jenkin Sy, Nicole Rose I Alberto, Maria Beatriz C Baron, Robert Earl C Mabulay, Lloyd Gabriel T Rizada, Christl Jan S Tiu, Charlie A Clarion, and John Carlo B Reyes. 2021. Barriers to online learning in the time of COVID-19: A national survey of medical students in the Philippines. Medical science educator (2021), 1--12.Google ScholarGoogle Scholar
  4. EL Bjork and R Bjork. 2011. Making things hard on yourself, but in a good way. Psychology in the Real World (2011), 59--68.Google ScholarGoogle Scholar
  5. Robert A Bjork. 2014. Forgetting as a friend of learning. Remembering: Attributions, Processes, and Control in Human Memory (2014), 15.Google ScholarGoogle Scholar
  6. Robert A Bjork and Ted W Allen. 1970. The spacing effect: Consolidation or differential encoding? Journal of Verbal Learning and Verbal Behavior , Vol. 9, 5 (1970), 567--572.Google ScholarGoogle ScholarCross RefCross Ref
  7. Robert A Bjork and Elizabeth L Bjork. 2020. Desirable difficulties in theory and practice. Journal of Applied Research in Memory and Cognition , Vol. 9, 4 (2020), 475--479.Google ScholarGoogle ScholarCross RefCross Ref
  8. Paulo F. Carvalho, Faria Sana, and Veronica X. Yan. 2020. Self-regulated spacing in a massive open online course is related to better learning. NPJ Science of Learning , Vol. 5 (2020).Google ScholarGoogle Scholar
  9. Nicholas J Cepeda, Harold Pashler, Edward Vul, John T Wixted, and Doug Rohrer. 2006. Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychological bulletin , Vol. 132, 3 (2006), 354.Google ScholarGoogle Scholar
  10. Kevin E Cevasco, Hayley M North, Sheryne A Zeitoun, Abigail F Gregory, Rachel N Wofford, Maha H Hassan, Graham A Matulis, Aya D Abdo, Amira A Roess, David Farris, et almbox. 2020. How US Public Universities Responded to the COVID-19 Pandemic in March 2020: Lessons Learned from the Variations in Timing of Key Decisions. (2020).Google ScholarGoogle Scholar
  11. C Clarke, M Mullin, D McGrath, and N Farrelly. 2021. University students and study habits. Irish Journal of Psychological Medicine (2021), 1--10.Google ScholarGoogle Scholar
  12. Tom Crick, Cathryn Knight, Richard Watermeyer, and Janet Goodall. 2021. The International Impact of COVID-19 and "Emergency Remote Teaching" on Computer Science Education Practitioners. In 2021 IEEE Global Engineering Education Conference (EDUCON). IEEE, 1048--1055.Google ScholarGoogle ScholarCross RefCross Ref
  13. William Sim ao de Deus, Maria Lydia Fioravanti, Camila Dias de Oliveira, and Ellen Francine Barbosa. 2020. Emergency Remote Computer Science Education in Brazil during the COVID-19 pandemic: Impacts and Strategies. Revista Brasileira de Informática na Educacc ao , Vol. 28 (2020), 1032--1059.Google ScholarGoogle Scholar
  14. Frank N Dempster. 1988. The spacing effect: A case study in the failure to apply the results of psychological research. American Psychologist , Vol. 43, 8 (1988), 627.Google ScholarGoogle ScholarCross RefCross Ref
  15. John Dunlosky and Katherine A Rawson. 2015. Practice tests, spaced practice, and successive relearning: Tips for classroom use and for guiding students' learning. Scholarship of Teaching and Learning in Psychology , Vol. 1, 1 (2015), 72.Google ScholarGoogle ScholarCross RefCross Ref
  16. Barbara Ericson and Bradley Miler. 2020. Using and Customizing Ebooks for Computing Courses with Runestone Interactive. In Proceedings of the 51st ACM Technical Symposium on Computer Science Education . 1395--1395.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Barbara J Ericson, Lauren E Margulieux, and Jochen Rick. 2017. Solving Parsons problems versus fixing and writing code. In Proceedings of the 17th Koli Calling Conference on Computing Education Research. ACM, 20--29.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Barbara J Ericson, Iman YeckehZaare, and Mark J Guzdial. 2019. Runestone Interactive Ebooks: A Research Platform for Online Computer Science Learning. In Proceedings of SPLICE Workshop in the International Computing Education Research Conference (ICER '19), August 12--14, 2019, Toronto, ON, Canada. ACM.Google ScholarGoogle Scholar
  19. Jean-Luc Gaudiot and Hironori Kasahara. 2020. Computer Education in the Age of COVID-19. Computer , Vol. 53, 10 (2020), 114--118.Google ScholarGoogle ScholarCross RefCross Ref
  20. Jennifer K Green, Marla S Burrow, and Lucila Carvalho. 2020. Designing for transition: supporting teachers and students cope with emergency remote education. Postdigital Science and Education , Vol. 2, 3 (2020), 906--922.Google ScholarGoogle ScholarCross RefCross Ref
  21. Regan A R Gurung and Arianna Stone. 2020. You Can't Always Get What You Want and It Hurts: Learning During the Pandemic. https://doi.org/10.31234/osf.io/wqdx8Google ScholarGoogle Scholar
  22. Charles Hodges, Stephanie Moore, Barb Lockee, Torrey Trust, Aaron Bond, et almbox. 2020. The difference between emergency remote teaching and online learning. Educause review , Vol. 27 (2020), 1--12.Google ScholarGoogle Scholar
  23. Nicole Johnson, George Veletsianos, and Jeff Seaman. 2020. US Faculty and Administrators' Experiences and Approaches in the Early Weeks of the COVID-19 Pandemic. Online Learning , Vol. 24, 2 (2020), 6--21.Google ScholarGoogle ScholarCross RefCross Ref
  24. Nanigopal Kapasia, Pintu Paul, Avijit Roy, Jay Saha, Ankita Zaveri, Rahul Mallick, Bikash Barman, Prabir Das, and Pradip Chouhan. 2020. Impact of lockdown on learning status of undergraduate and postgraduate students during COVID-19 pandemic in West Bengal, India. Children and Youth Services Review , Vol. 116 (2020), 105194.Google ScholarGoogle ScholarCross RefCross Ref
  25. Sultan Ayoub Meo, Abdulelah Adnan Abukhalaf, Ali Abdullah Alomar, Kamran Sattar, and David C Klonoff. 2020. COVID-19 pandemic: impact of quarantine on medical students' mental wellbeing and learning behaviors. Pakistan journal of medical sciences , Vol. 36, COVID19-S4 (2020), S43.Google ScholarGoogle Scholar
  26. Brad Miller and David Ranum. 2014. Runestone interactive: tools for creating interactive course materials. In Proceedings of the first ACM conference on Learning@ scale conference . 213--214.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Cedric B Mpungose. 2020. Emergent transition from face-to-face to online learning in a South African University in the context of the Coronavirus pandemic. Humanities and Social Sciences Communications , Vol. 7, 1 (2020), 1--9.Google ScholarGoogle ScholarCross RefCross Ref
  28. OECD. 2020. Learning remotely when schools close: How well are students and schools prepared? Insights from PISA. OECD Policy Responses to Coronavirus (Covid-19) (2020).Google ScholarGoogle Scholar
  29. Ethan A Perets, Daniel Chabeda, Angela Z Gong, Xin Huang, Tat Sang Fung, Ka Yi Ng, Meghan Bathgate, and Elsa CY Yan. 2020. Impact of the Emergency Transition to Remote Teaching on Student Engagement in a Non-STEM Undergraduate Chemistry Course in the Time of COVID-19. Journal of Chemical Education , Vol. 97, 9 (2020), 2439--2447.Google ScholarGoogle ScholarCross RefCross Ref
  30. Goran RADIĆ, Bojan S RISTIĆ, Svetlana ANDJELIĆ , Valentin KULETO, and Milena ILIĆ. 2020. E-Learning Experiences of Higher Education Institutions in The Republic of Serbia During Covid-19, Content Analysis and Case Study ITS Belgrade. (2020).Google ScholarGoogle Scholar
  31. Emma Riese and Viggo Kann. 2021. Computer Science Majors' Experiences of Their Distance Education Caused by the COVID-19 Pandemic. In 2021 IEEE Global Engineering Education Conference (EDUCON). IEEE, 393--397.Google ScholarGoogle ScholarCross RefCross Ref
  32. Doug Rohrer and Kelli Taylor. 2006. The effects of overlearning and distributed practise on the retention of mathematics knowledge. Applied Cognitive Psychology , Vol. 20, 9 (2006), 1209--1224.Google ScholarGoogle ScholarCross RefCross Ref
  33. Chun Meng Tang and Lee Yen Chaw. 2016. Digital Literacy: A Prerequisite for Effective Learning in a Blended Learning Environment?. Electronic Journal of E-learning , Vol. 14, 1 (2016), 54--65.Google ScholarGoogle Scholar
  34. George Veletsianos, Royce Kimmons, Ross Larsen, and Jacob Rogers. 2021. Temporal flexibility, gender, and online learning completion. Distance Education (2021), 1--15.Google ScholarGoogle Scholar
  35. Iman YeckehZaare, Elijah Fox, Gail Grot, Sean Chen, Claire Walkosak, Kevin Kwon, Annelise Hofmann, Jessica Steir, Olivia McGeough, and Nealie Silverstein. 2021. Incentivized Spacing and Gender in Computer Science Education. In Proceedings of the International Computing Education Research Conference (ICER '21), August 16--19, 2021, Virtual. ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Iman YeckehZaare, Gail Grot, and Chloe Aronoff. 2022 a. Retrieval-based Teaching Incentivizes Spacing and Improves Grades in Computer Science Education. In Proceedings of the 53rd ACM Technical Symposium on Computer Science Education V. 1 (SIGCSE 2022), March 3--5, 2022, Providence, RI, USA. ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Iman YeckehZaare, Victoria Mulligan, Grace Victoria Ramstad, and Paul Resnick. 2022 b. Semester-level Spacing but Not Procrastination Affected Student Exam Performance. In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge . ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Iman YeckehZaare, Paul Resnick, and Barbara Ericson. 2019. A Spaced, Interleaved Retrieval Practice Tool that is Motivating and Effective. In Proceedings of the 2019 ACM Conference on International Computing Education Research . 71--79.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Lishan Zhang, Baoping Li, Qiujie Zhang, and I-Han Hsiao. 2020. Does a Distributed Practice Strategy for Multiple Choice Questions Help Novices Learn Programming? International Journal of Emerging Technologies in Learning (iJET) , Vol. 15, 18 (2020), 234--250.Google ScholarGoogle Scholar

Index Terms

  1. Another Victim of COVID-19: Computer Science Education

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        SIGCSE 2022: Proceedings of the 53rd ACM Technical Symposium on Computer Science Education - Volume 1
        February 2022
        1049 pages
        ISBN:9781450390705
        DOI:10.1145/3478431

        Copyright © 2022 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 22 February 2022

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate1,595of4,542submissions,35%

        Upcoming Conference

        SIGCSE Virtual 2024

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader