ABSTRACT
Prior literature suggests that computer science education (CSE) was less affected by the pandemic than other disciplines. However, it is unclear how the pandemic affected the quality and quantity of students' studying in CSE. We measure the impact of the pandemic on the amount and spacing of students' studying in a large introductory computer science course. Spacing is defined as the distribution of studying over multiple sessions, which is shown to improve long-term learning. Using multiple regression models, we analyzed the total number of students' interactions with the eBook and the number of days they used it, as a proxy for studying amount and spacing, respectively. We compared two sequential winter semesters of the course, one during (Winter 2021) and one prior to the pandemic (Winter 2020). After controlling for possible confounders, the results show that students had 1,345.87 fewer eBook interactions and distributed their studying on 2.36 fewer days during the pandemic when compared to the previous semester prior to the pandemic. We also compared four semesters prior to the pandemic (Fall and Winter of 2018 and 2019) to two semesters during the pandemic (Fall 2020 and Winter 2021). We found, on average, students had 3,376.30 fewer interactions with the eBook and studied the eBook on 16.35 fewer days during the pandemic. Contrary to prior studies, our results indicate that the pandemic negatively affected the amount and spacing of studying in an introductory computer science course, which may have a negative impact on their education.
Supplemental Material
- Fadzlin Ahmadon, Hajar Izzati Mohd Ghazalli, and Hazlifah Mohd Rusli. 2020. Studying during Pandemic: A Review of Issues from Online Learning in the Middle of COVID-19. In 2020 6th International Conference on Interactive Digital Media (ICIDM). IEEE, 1--4.Google ScholarCross Ref
- Mohammed Alzaid, Devanshi Trivedi, and I-Han Hsiao. 2017. The effects of bite-size distributed practices for programming novices. In 2017 IEEE Frontiers in Education Conference (FIE). IEEE, 1--9.Google ScholarDigital Library
- Ronnie E Baticulon, Jinno Jenkin Sy, Nicole Rose I Alberto, Maria Beatriz C Baron, Robert Earl C Mabulay, Lloyd Gabriel T Rizada, Christl Jan S Tiu, Charlie A Clarion, and John Carlo B Reyes. 2021. Barriers to online learning in the time of COVID-19: A national survey of medical students in the Philippines. Medical science educator (2021), 1--12.Google Scholar
- EL Bjork and R Bjork. 2011. Making things hard on yourself, but in a good way. Psychology in the Real World (2011), 59--68.Google Scholar
- Robert A Bjork. 2014. Forgetting as a friend of learning. Remembering: Attributions, Processes, and Control in Human Memory (2014), 15.Google Scholar
- Robert A Bjork and Ted W Allen. 1970. The spacing effect: Consolidation or differential encoding? Journal of Verbal Learning and Verbal Behavior , Vol. 9, 5 (1970), 567--572.Google ScholarCross Ref
- Robert A Bjork and Elizabeth L Bjork. 2020. Desirable difficulties in theory and practice. Journal of Applied Research in Memory and Cognition , Vol. 9, 4 (2020), 475--479.Google ScholarCross Ref
- Paulo F. Carvalho, Faria Sana, and Veronica X. Yan. 2020. Self-regulated spacing in a massive open online course is related to better learning. NPJ Science of Learning , Vol. 5 (2020).Google Scholar
- Nicholas J Cepeda, Harold Pashler, Edward Vul, John T Wixted, and Doug Rohrer. 2006. Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychological bulletin , Vol. 132, 3 (2006), 354.Google Scholar
- Kevin E Cevasco, Hayley M North, Sheryne A Zeitoun, Abigail F Gregory, Rachel N Wofford, Maha H Hassan, Graham A Matulis, Aya D Abdo, Amira A Roess, David Farris, et almbox. 2020. How US Public Universities Responded to the COVID-19 Pandemic in March 2020: Lessons Learned from the Variations in Timing of Key Decisions. (2020).Google Scholar
- C Clarke, M Mullin, D McGrath, and N Farrelly. 2021. University students and study habits. Irish Journal of Psychological Medicine (2021), 1--10.Google Scholar
- Tom Crick, Cathryn Knight, Richard Watermeyer, and Janet Goodall. 2021. The International Impact of COVID-19 and "Emergency Remote Teaching" on Computer Science Education Practitioners. In 2021 IEEE Global Engineering Education Conference (EDUCON). IEEE, 1048--1055.Google ScholarCross Ref
- William Sim ao de Deus, Maria Lydia Fioravanti, Camila Dias de Oliveira, and Ellen Francine Barbosa. 2020. Emergency Remote Computer Science Education in Brazil during the COVID-19 pandemic: Impacts and Strategies. Revista Brasileira de Informática na Educacc ao , Vol. 28 (2020), 1032--1059.Google Scholar
- Frank N Dempster. 1988. The spacing effect: A case study in the failure to apply the results of psychological research. American Psychologist , Vol. 43, 8 (1988), 627.Google ScholarCross Ref
- John Dunlosky and Katherine A Rawson. 2015. Practice tests, spaced practice, and successive relearning: Tips for classroom use and for guiding students' learning. Scholarship of Teaching and Learning in Psychology , Vol. 1, 1 (2015), 72.Google ScholarCross Ref
- Barbara Ericson and Bradley Miler. 2020. Using and Customizing Ebooks for Computing Courses with Runestone Interactive. In Proceedings of the 51st ACM Technical Symposium on Computer Science Education . 1395--1395.Google ScholarDigital Library
- Barbara J Ericson, Lauren E Margulieux, and Jochen Rick. 2017. Solving Parsons problems versus fixing and writing code. In Proceedings of the 17th Koli Calling Conference on Computing Education Research. ACM, 20--29.Google ScholarDigital Library
- Barbara J Ericson, Iman YeckehZaare, and Mark J Guzdial. 2019. Runestone Interactive Ebooks: A Research Platform for Online Computer Science Learning. In Proceedings of SPLICE Workshop in the International Computing Education Research Conference (ICER '19), August 12--14, 2019, Toronto, ON, Canada. ACM.Google Scholar
- Jean-Luc Gaudiot and Hironori Kasahara. 2020. Computer Education in the Age of COVID-19. Computer , Vol. 53, 10 (2020), 114--118.Google ScholarCross Ref
- Jennifer K Green, Marla S Burrow, and Lucila Carvalho. 2020. Designing for transition: supporting teachers and students cope with emergency remote education. Postdigital Science and Education , Vol. 2, 3 (2020), 906--922.Google ScholarCross Ref
- Regan A R Gurung and Arianna Stone. 2020. You Can't Always Get What You Want and It Hurts: Learning During the Pandemic. https://doi.org/10.31234/osf.io/wqdx8Google Scholar
- Charles Hodges, Stephanie Moore, Barb Lockee, Torrey Trust, Aaron Bond, et almbox. 2020. The difference between emergency remote teaching and online learning. Educause review , Vol. 27 (2020), 1--12.Google Scholar
- Nicole Johnson, George Veletsianos, and Jeff Seaman. 2020. US Faculty and Administrators' Experiences and Approaches in the Early Weeks of the COVID-19 Pandemic. Online Learning , Vol. 24, 2 (2020), 6--21.Google ScholarCross Ref
- Nanigopal Kapasia, Pintu Paul, Avijit Roy, Jay Saha, Ankita Zaveri, Rahul Mallick, Bikash Barman, Prabir Das, and Pradip Chouhan. 2020. Impact of lockdown on learning status of undergraduate and postgraduate students during COVID-19 pandemic in West Bengal, India. Children and Youth Services Review , Vol. 116 (2020), 105194.Google ScholarCross Ref
- Sultan Ayoub Meo, Abdulelah Adnan Abukhalaf, Ali Abdullah Alomar, Kamran Sattar, and David C Klonoff. 2020. COVID-19 pandemic: impact of quarantine on medical students' mental wellbeing and learning behaviors. Pakistan journal of medical sciences , Vol. 36, COVID19-S4 (2020), S43.Google Scholar
- Brad Miller and David Ranum. 2014. Runestone interactive: tools for creating interactive course materials. In Proceedings of the first ACM conference on Learning@ scale conference . 213--214.Google ScholarDigital Library
- Cedric B Mpungose. 2020. Emergent transition from face-to-face to online learning in a South African University in the context of the Coronavirus pandemic. Humanities and Social Sciences Communications , Vol. 7, 1 (2020), 1--9.Google ScholarCross Ref
- OECD. 2020. Learning remotely when schools close: How well are students and schools prepared? Insights from PISA. OECD Policy Responses to Coronavirus (Covid-19) (2020).Google Scholar
- Ethan A Perets, Daniel Chabeda, Angela Z Gong, Xin Huang, Tat Sang Fung, Ka Yi Ng, Meghan Bathgate, and Elsa CY Yan. 2020. Impact of the Emergency Transition to Remote Teaching on Student Engagement in a Non-STEM Undergraduate Chemistry Course in the Time of COVID-19. Journal of Chemical Education , Vol. 97, 9 (2020), 2439--2447.Google ScholarCross Ref
- Goran RADIĆ, Bojan S RISTIĆ, Svetlana ANDJELIĆ , Valentin KULETO, and Milena ILIĆ. 2020. E-Learning Experiences of Higher Education Institutions in The Republic of Serbia During Covid-19, Content Analysis and Case Study ITS Belgrade. (2020).Google Scholar
- Emma Riese and Viggo Kann. 2021. Computer Science Majors' Experiences of Their Distance Education Caused by the COVID-19 Pandemic. In 2021 IEEE Global Engineering Education Conference (EDUCON). IEEE, 393--397.Google ScholarCross Ref
- Doug Rohrer and Kelli Taylor. 2006. The effects of overlearning and distributed practise on the retention of mathematics knowledge. Applied Cognitive Psychology , Vol. 20, 9 (2006), 1209--1224.Google ScholarCross Ref
- Chun Meng Tang and Lee Yen Chaw. 2016. Digital Literacy: A Prerequisite for Effective Learning in a Blended Learning Environment?. Electronic Journal of E-learning , Vol. 14, 1 (2016), 54--65.Google Scholar
- George Veletsianos, Royce Kimmons, Ross Larsen, and Jacob Rogers. 2021. Temporal flexibility, gender, and online learning completion. Distance Education (2021), 1--15.Google Scholar
- Iman YeckehZaare, Elijah Fox, Gail Grot, Sean Chen, Claire Walkosak, Kevin Kwon, Annelise Hofmann, Jessica Steir, Olivia McGeough, and Nealie Silverstein. 2021. Incentivized Spacing and Gender in Computer Science Education. In Proceedings of the International Computing Education Research Conference (ICER '21), August 16--19, 2021, Virtual. ACM.Google ScholarDigital Library
- Iman YeckehZaare, Gail Grot, and Chloe Aronoff. 2022 a. Retrieval-based Teaching Incentivizes Spacing and Improves Grades in Computer Science Education. In Proceedings of the 53rd ACM Technical Symposium on Computer Science Education V. 1 (SIGCSE 2022), March 3--5, 2022, Providence, RI, USA. ACM.Google ScholarDigital Library
- Iman YeckehZaare, Victoria Mulligan, Grace Victoria Ramstad, and Paul Resnick. 2022 b. Semester-level Spacing but Not Procrastination Affected Student Exam Performance. In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge . ACM.Google ScholarDigital Library
- Iman YeckehZaare, Paul Resnick, and Barbara Ericson. 2019. A Spaced, Interleaved Retrieval Practice Tool that is Motivating and Effective. In Proceedings of the 2019 ACM Conference on International Computing Education Research . 71--79.Google ScholarDigital Library
- Lishan Zhang, Baoping Li, Qiujie Zhang, and I-Han Hsiao. 2020. Does a Distributed Practice Strategy for Multiple Choice Questions Help Novices Learn Programming? International Journal of Emerging Technologies in Learning (iJET) , Vol. 15, 18 (2020), 234--250.Google Scholar
Index Terms
- Another Victim of COVID-19: Computer Science Education
Recommendations
Incentivized Spacing and Gender in Computer Science Education
ICER 2021: Proceedings of the 17th ACM Conference on International Computing Education ResearchExtensive prior research shows that spacing – the distribution of studying over multiple sessions – significantly improves long-term learning in many disciplines. However, in computer science education, it is unclear if 1) spacing is effective in an ...
Telesimulation for COVID-19 Ventilator Management Training With Social-Distancing Restrictions During the Coronavirus Pandemic
Background. In early 2020, the novel coronavirus pandemic forced communities around the globe to shut down and isolate. Routine graduate medical education activities have also been suspended as resident and fellow physicians-in-training have been re-...
Telehealth utilization during the Covid-19 pandemic: A systematic review
AbstractDuring the coronavirus disease (COVID-19) pandemic, different technologies, including telehealth, are maximised to mitigate the risks and consequences of the disease. Telehealth has been widely utilised because of its usability and safety in ...
Highlights- State-of-the-art Literature Categorization for Telehealth utilization during COVID-19.
- Challenges, motivations and recommended solutions are identified for Telehealth during COVID-19.
- Different Applications of Telehealth during the ...
Comments