Reza Soltanpoor
Daryl D'Souza
ABSTRACT
Learning to program is a cognitively demanding activity. Students need to combine mental models of various concepts and constructs to solve problems. Many students new to IT and CS programs have little or no prior experience with abstract reasoning and problem-solving. Instructors attempt to present the core concepts early to allow adequate time for students to complete their programming assignments. However, misconceptions of basic concepts formed in the early stages often get propagated blocking any further progress. Such students often begin to form poor opinions about their capability leading to low self-esteem and performance.
This paper proposes a framework to help individual students to overcome their misconceptions through personalized prescriptive quizzes. These quizzes are generated by combining the rich meta-data captured by each quiz question with analysis of past responses to class quizzes. The personalized prescriptive quizzes generated helped to improve student engagement and performance substantially. Over 91% of the students surveyed indicated that personalized quizzes helped them to clarify their own misconceptions and made them more confident of their progress. Students using the prescriptive quizzes performed significantly better than others in subsequent class assessments and the final exam.
- S Adams Becker, M Cummins, A Davis, A Freeman, C Hall Giesinger, and V Ananthanarayanan. 2017. NMC horizon report: 2017 higher education edition. Austin, Texas: The New Media Consortium (2017).Google Scholar
- Lorin W Anderson, David R Krathwohl, P Airasian, K Cruikshank, R Mayer, P Pintrich, J Raths, and M Wittrock. 2001. A taxonomy for learning, teaching and assessing: A revision of Bloom’s taxonomy. New York. Longman Publishing. Artz, AF, & Armour-Thomas, E.(1992). Development of a cognitive-metacognitive framework for protocol analysis of mathematical problem solving in small groups. Cognition and Instruction 9, 2 (2001), 137–175.Google Scholar
- Department of Education Australian Government and Training. 2017.Google Scholar
- Release of the Higher Education Standards - Panel’s Discussion Paper on Improving Completion, Retention and Success in Higher Education. https://www .education.gov.au/news/release-higher-education-standardspanelsdiscussionpaperimprovingcompletionretention- and. (2017). {Online; accessed 31-August-2017}.Google Scholar
- A Bandura. 1986. Social foundations of thought and action (pp. 5-107). Englewood Cliffs, NJ: PrenticeHall (1986).Google Scholar
- Theresa Beaubouef and John Mason. 2005.Google Scholar
- Why the high attrition rate for computer science students: some thoughts and observations. ACM SIGCSE Bulletin 37, 2 (2005), 103–106. https:// Google ScholarDigital Library
- Matthew Berland, Taylor Martin, Tom Benton, Carmen Petrick Smith, and Don Davis. 2013. Using learning analytics to understand the learning pathways of novice programmers. Journal of the Learning Sciences 22, 4 (2013), 564–599. https://Google ScholarCross Ref
- Maureen Biggers, Anne Brauer, and Tuba Yilmaz. 2008.Google Scholar
- Student perceptions of computer science: a retention study comparing graduating seniors with cs leavers. In ACM SIGCSE Bulletin, Vol. 40. ACM, 402–406. https:// Google ScholarDigital Library
- Paulo Blikstein, Marcelo Worsley, Chris Piech, Mehran Sahami, Steven Cooper, and Daphne Koller. 2014. Programming pluralism: Using learning analytics to detect patterns in the learning of computer programming. Journal of the Learning Sciences 23, 4 (2014), 561–599.Google ScholarCross Ref
- Richard F Burton. 2001. Do Item-discrimination Indices Really Help Us to Improve Our Tests? Assessment & Evaluation in Higher Education 26, 3 (2001), 213–220. https://Google Scholar
- Ricardo Caceffo, Steve Wolfman, Kellogg S Booth, and Rodolfo Azevedo. 2016.Google Scholar
- Developing a computer science concept inventory for introductory programming. In Proceedings of the 47th ACM Technical Symposium on Computing Science Education. ACM, 364–369. Google ScholarDigital Library
- Peter J Denning and Andrew McGettrick. 2005. Recentering computer science. Commun. ACM 48, 11 (2005), 15–19. https:// Google ScholarDigital Library
- Andrew Gibson, Kirsty Kitto, and Jill Willis. 2014. A cognitive processing framework for learning analytics. In Proceedings of the Fourth International Conference on Learning Analytics And Knowledge. ACM, 212–216. https:// Google ScholarDigital Library
- Shuchi Grover and Satabdi Basu. 2017. Measuring student learning in introductory block-based programming: Examining misconceptions of loops, variables, and boolean logic. In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education. ACM, 267–272. Google ScholarDigital Library
- Maya M Khanna. 2015. Ungraded pop quizzes: Test-enhanced learning without all the anxiety.Google Scholar
- Teaching of Psychology 42, 2 (2015), 174–178.Google Scholar
- Hassan Khosravi and Kendra ML Cooper. 2017.Google Scholar
- Using Learning Analytics to Investigate Patterns of Performance and Engagement in Large Classes. In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education. ACM, 309–314. Google ScholarDigital Library
- Marja Kuittinen and Jorma Sajaniemi. 2004.Google Scholar
- Teaching roles of variables in elementary programming courses. ACM SIGCSE Bulletin 36, 3 (2004), 57–61. https:// Google ScholarDigital Library
- Catherine Lang, Judy McKay, and Sue Lewis. 2007. Seven factors that influence ICT student achievement. In ACM SIGCSE Bulletin, Vol. 39. ACM, 221–225. https: // Google ScholarDigital Library
- Alwyn Vwen Yen Lee and Seng Chee Tan. 2017. Understanding idea flow: applying learning analytics in discourse. Learning: Research and Practice 3, 1 (2017), 12–29.Google Scholar
- Linxiao Ma. 2007.Google Scholar
- Investigating and improving novice programmers’ mental models of programming concepts. Ph.D. Dissertation. University of Strathclyde.Google Scholar
- Wenting Ma, Olusola O Adesope, John C Nesbit, and Qing Liu. 2014. Intelligent tutoring systems and learning outcomes: A meta-analysis. (2014).Google Scholar
- Michael McCracken, Vicki Almstrum, Danny Diaz, Mark Guzdial, Dianne Hagan, Yifat Ben-David Kolikant, Cary Laxer, Lynda Thomas, Ian Utting, and Tadeusz Wilusz. 2001. A multi-national, multi-institutional study of assessment of programming skills of first-year CS students. ACM SIGCSE Bulletin 33, 4 (2001), 125–180. https:// Google ScholarDigital Library
- Mark A McDaniel, Pooja K Agarwal, Barbie J Huelser, Kathleen B McDermott, and Henry L Roediger III. 2011. Test-enhanced learning in a middle school science classroom: The effects of quiz frequency and placement. Journal of Educational Psychology 103, 2 (2011), 399.Google ScholarCross Ref
- Arnold Pears, Stephen Seidman, Lauri Malmi, Linda Mannila, Elizabeth Adams, Jens Bennedsen, Marie Devlin, and James Paterson. 2007. A survey of literature on the teaching of introductory programming. ACM SIGCSE Bulletin 39, 4 (2007), 204–223. https:// Google ScholarDigital Library
- Yizhou Qian and James Lehman. 2017.Google Scholar
- Students’ Misconceptions and Other Difficulties in Introductory Programming: A Literature Review. ACM Transactions on Computing Education (TOCE) 18, 1 (2017), 1. Google ScholarDigital Library
- Vennila Ramalingam, Deborah LaBelle, and Susan Wiedenbeck. 2004. Self-efficacy and mental models in learning to program. In ACM SIGCSE Bulletin, Vol. 36. ACM, 171–175. Google ScholarDigital Library
- Michael C Rodriguez, Ryan J Kettler, and Stephen N Elliott. 2014.Google Scholar
- Distractor functioning in modified items for test accessibility. SAGE Open 4, 4 (2014), 2158244014553586.Google Scholar
- Henry E Schaffer, Karen R Young, Emily W Ligon, and Diane D Chapman. 2017.Google Scholar
- Automating Individualized Formative Feedback in Large Classes Based on a Directed Concept Graph. Frontiers in psychology 8 (2017).Google Scholar
- https://Google Scholar
- Takayuki Sekiya and Kazunori Yamaguchi. 2013.Google Scholar
- Tracing quiz set to identify novices’ programming misconceptions. In Proceedings of the 13th Koli Calling International Conference on Computing Education Research. ACM, 87–95. Google ScholarDigital Library
- S Mohamed Shuhidan. 2012.Google Scholar
- Probing the minds of novice programmers through guided learning. Ph.D. Dissertation. PhD thesis, retrieved July 2013, RMIT University: Australia.Google Scholar
- S Mohamed Shuhidan. 2012.Google Scholar
- Probing the minds of novice programmers through guided learning. Ph.D. Dissertation. PhD thesis, retrieved July 2013, RMIT University: Australia.Google Scholar
- George Siemens and Phil Long. 2011. Penetrating the fog: Analytics in learning and education. EDUCAUSE review 46, 5 (2011), 30. https://Google Scholar
- Reza Soltanpoor and Timos Sellis. 2016. Prescriptive analytics for big data. In Australasian Database Conference. Springer, 245–256. https://Google ScholarCross Ref
- Maddalena Taras. 2005.Google Scholar
- ASSESSMENT - SUMMATIVE AND FORMATIVE - SOME THEORETICAL REFLECTIONS. British Journal of Educational Studies 53, 4 (2005), 466–478. https://Google Scholar
- Sven Venema and Andrew Rock. 2014. Improving learning outcomes for first year introductory programming students. FYHE 2014 (2014).Google Scholar
- Susan Wiedenbeck, Deborah Labelle, and Vennila NR Kain. 2004. Factors affecting course outcomes in introductory programming. In 16th Annual Workshop of the Psychology of Programming Interest Group. 97–109. Abstract 1 Introduction 2 Related Work 3 Design of our framework and PPQs 4 Results 4.1 The PPQ Survey Responses 4.2 Quantitative Evaluation 5 Discussion and Future Work 6 Conclusions Acknowledgments ReferencesGoogle Scholar
Index Terms
- Adaptive remediation for novice programmers through personalized prescriptive quizzes
Recommendations
Correcting Novice Programmers' Misconceptions Through Personalized Quizzes: (Abstract Only)
SIGCSE '18: Proceedings of the 49th ACM Technical Symposium on Computer Science EducationIntroductory programming students unable to grasp and apply abstract concepts are known to become disengaged and drop out of the course. The large class sizes, increasing diversity and inadequate teaching support have exacerbated the problems leading to ...
A blended learning lecture delivery model for large and diverse undergraduate cohorts
A blended learning model was developed to enhance lecture delivery in a large, diverse introductory psychology unit, introducing the use of an online, personalized learning system for lecture preparation and using lecture time to extend students' ...
Effects of Learning Analytics on Students' Self-Regulated Learning in Flipped Classroom
The present article is aimed at analyzing the effects of learning analytics on students' self-regulated learning in a flipped classroom. An experiment was conducted with 96 engineering students, enrolled in a subject offered in the Flipped Classroom ...
Comments