Alex Lishinski
Aman Yadav
Jon Good
ABSTRACT
Previous research in computer science education has demonstrated the importance of motivation for success in introductory programming. Theoretical constructs from self-regulated learning theory (SRL), which integrates several different types of metacognitive processes, as well as motivational constructs, have proved to be important predictors of success in most academic disciplines. These individual components of self-regulated learning (e.g., self-efficacy, metacognitive strategies) interact in complex ways to influence students' affective states and behaviors, which in turn influence learning outcomes. These elements have been previously examined individually in novice programmers, but we do not have a comprehensive understanding of how SRL constructs interact to influence learning to program. This paper reports on a study that examined the interaction of self-efficacy, intrinsic and extrinsic goal orientations, and metacognitive strategies and their impact on student performance in a CS1 course. We also report on significant gender differences in the relationships between SRL constructs and learning outcomes. We found that student performance had the expected motivational and SRL precursors, but the interactions between these constructs revealed some unexpected relationships. Furthermore, we found that females' self-efficacy had a different connection to programming performance than that of their male peers. Further research on success in introductory programming should take account of the unique and complex relationship between SRL and student success, as well as gender differences in these relationships that are specific to CS.
- I. S. Al-Harthy and C. A. Was. Knowledge monitoring, goal orientations, self-efficacy, and academic performance: A path analysis. Journal of College Teaching and Learning, 10(4):263--279, 2013.Google Scholar
Cross Ref
- S. Andrew. Self-efficacy as a predictor of academic performance in science. Journal of Advanced Nursing, 27(3):596--603, 1998.Google ScholarCross Ref
- P. Azalov, S. Azaloff, and F. Zlatarova. Work in Progress - Comparing Assessment Tools in Computer Science Education: Empirical Analysis. Proceedings of 34th ASEE/IEEE Frontiers in Education Conference, 20--23 October 2004, 2:18--19, 2004.Google ScholarCross Ref
- A. Bandura. Self-efficacy: toward a unifying theory of behavioral change. Psychological review, 84(2):191--215, 1977.Google ScholarCross Ref
- A. Bandura. Social Foundations of Thought and Action: A Social Cognitive Theory. Prentice-Hall, Englewood Cliffs, NJ, 1986.Google Scholar
- S. Bergin, A. Mooney, J. Ghent, and K. Quille. Using Machine Learning Techniques to Predict Introductory Programming Performance. International Journal of Computer Science and Software Engineering, 4(12):323--328, 2015.Google Scholar
- S. Bergin and R. Reilly. Programming: Factors that Influence Success. ACM SIGCSE Bulletin, 37(1):411--415, 2005. Google ScholarDigital Library
- S. Bergin and R. Reilly. The influence of motivation and comfort-level on learning to program. Ppig 17, (June):293--304, 2005.Google Scholar
- S. Bergin, R. Reilly, and D. Traynor. Examining the role of self-regulated learning on introductory programming performance. First International Workshop on Computing Education Research, pages 81--86, 2005. Google ScholarDigital Library
- D. R. Bernstein. Comfort and Experience with Computing: Are They the Same for Women and Men? SIGCSE Bull., 23(3):57--61. Google ScholarDigital Library
- S. Beyer. Gender differences in the accuracy of self-evaluations of performance. Journal of Personality and Social Psychology, 59(5):960--970, 1990.Google ScholarCross Ref
- S. Beyer. Predictors of Female and Male Computer Science Students' Grades. Journal of Women and Minorities in Science and Engineering, 14(4):377--409, 2008.Google ScholarCross Ref
- S. Beyer. Why are women underrepresented in Computer Science? Gender differences in stereotypes, self-efficacy, values, and interests and predictors of future CS course-taking and grades. Computer Science Education, 24(2--3):153--192, 2014.Google Scholar
- S. L. Britner and F. Pajares. Sources of science self-efficacy beliefs of middle school students. Journal of Research in Science Teaching, 43(5):485--499, 2006.Google ScholarCross Ref
- T. Busch. Gender Differences in Self-Efficacy and Attitudes Toward Computers. Journal of Educational Computing Research, 12(2):147--158, 1995.Google ScholarCross Ref
- J. Cohoon. Must there be so few? Including women in CS. 25th International Conference on Software Engineering, 2003. Proceedings., pages 668--674, 2003. Google ScholarDigital Library
- L. Corno. The metacognitive control components of self-regulated learning. Contemporary Educational Psychology, 11(4):333--346, 1986.Google ScholarCross Ref
- M. Credé and L. A. Phillips. A meta-analytic review of the Motivated Strategies for Learning Questionnaire. Learning and Individual Differences, 21:337--346, 2011.Google ScholarCross Ref
- A. J. Elliot. Approach and avoidance motivation and achievement goals. Educational Psychologist, 34:169--189, 1999.Google ScholarCross Ref
- K. Falkner, R. Vivian, and N. Falkner. Identifying Computer Science Self-Regulated Learning Strategies. Proceedings of the 2014 conference on Innovation & technology in computer science education, ITiCSE '14, pages 291--296, 2014. Google ScholarDigital Library
- J. K. Ford, E. M. Smith, A. Consulting, D. A. Weissbein, S. M. Gully, and E. Salas. Relationships of Goal Orientation, Metacognitive Activity, and Practice Strategies With Learning Outcomes and Transfer. Journal of Applied Psyc, 83(2):218--233, 1998.Google ScholarCross Ref
- M. E. Gist. Self-Efficacy: A Theoretical Analysis of its Determinants and Malleability. Academy of Management Review, 17(2), 1992.Google ScholarCross Ref
- J. M. Harackiewicz, K. E. Barron, P. R. Pintrich, A. J. Elliot, and T. M. Thrash. Revision of achievement goal theory: Necessary and illuminating. Journal of Educational Psychology, 94(3):638--645, 2002.Google ScholarCross Ref
- H. M. Havenga. An investigation of students' knowledge, skills and strategies during problem solving in object-oriented programming. 2008.Google Scholar
- M. Havenga. The role of metacognitive skills in solving object-oriented programming problems: a case study. The Journal for Transdisciplinary Research in Southern Africa, 11(1):133--147, 2015.Google ScholarCross Ref
- D. Iacobucci. Structural equations modeling: Fit Indices, sample size, and advanced topics. Journal of Consumer Psychology, 20(1):90--98, 2010.Google ScholarCross Ref
- P. Kinnunen and B. Simon. Experiencing Programming Assignments in CS1: The Emotional Toll. Icer'10, pages 77--85, 2010. Google ScholarDigital Library
- P. Kinnunen and B. Simon. CS Majors' Self-Efficacy Perceptions in CS1: Results in Light of Social Cognitive Theory. Proceedings of the seventh international workshop on Computing education research - ICER '11, pages 19--26, 2011. Google ScholarDigital Library
- S. Krieger, M. Allen, and C. Rawn. Are Females Disinclined to Tinker in Computer Science? In Proceedings of the 46th ACM Technical Symposium on Computer Science Education (SIGCSE '15), pages 102--107, 2015. Google ScholarDigital Library
- W. Kuechler and M. Simkin. How well do multiple choice tests evaluate student understanding in computer programming classes? Journal of Information Systems Education, 14(4):389--399, 2003.Google Scholar
- R. W. Lent and G. Hackett. Career self-efficacy: Empirical status and future directions. Journal of Vocational Behavior, 30(3):347--382, 1987.Google ScholarCross Ref
- A. Lishinski. Cognitive, Affective, and Dispositional Components of Learning Programming. In ICER Doctoral Consortium, 2016. Google ScholarDigital Library
- E. A. Locke and G. P. Latham. New Developments in Goal Setting and Task Performance. Routledge, 2012.Google Scholar
- C. Midgley, A. Kaplan, and M. Middleton. Performance-approach goals: Good for what, for whom, under what circumstances, and at what cost? Journal of Educational Psychology, 93(1):77--86, 2001.Google ScholarCross Ref
- F. Pajares. Self-Efficacy Beliefs and Mathematical Problem-Solving of Gifted Students. Contemporary educational psychology, 21(4):325--44, 1996.Google Scholar
- F. Pajares. Self-Efficacy Beliefs in Academic Settings. Review of Educational Research, 66(4):543--578, 1996.Google ScholarCross Ref
- F. Pajares and L. Graham. Self-Efficacy, Motivation Constructs, and Mathematics Performance of Entering Middle School Students. Contemporary educational psychology, 24(2):124--139, 1999.Google Scholar
- F. Pajares and M. D. Miller. Role of self-efficacy and self-concept beliefs in mathematical problem solving: A path analysis. Journal of educational psychology, 86(2):193, 1994.Google Scholar
- F. Pajares and G. Valiante. Influence of Self-Efficacy on Elementary Students' Writing. Journal of Educational Research, 90(6):353--360, 1997.Google ScholarCross Ref
- M. Pajares, F. & Johnson. Self-efficacy beliefs and the writing performance of entering high school students. Psychology in the Schools, 33(April):163--175, 1996.Google Scholar
- R. Paul, S. Smith, M. L. Genthon, G. G. Martens, C. L. Hauen, G. G. Martens, M. Genthon, and P. Wren. A Manual for the Use of the Motivated Strategies for Learning Questionnaire (MSLQ). Technical Report No. 91-B-004, (The Regents of The University of Michigan.), 1991.Google Scholar
- P. R. Pintrich and E. V. de Groot. Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82(1):33--40, 1990.Google ScholarCross Ref
- P. R. Pintrich and D. H. Schunk. Motivation in education: Theory, research, and applications. Prentice-Hall, Englewood Cliffs, NJ, 1995.Google Scholar
- P. R. Pintrich and D. H. Schunk. Motivation in education: Theory, research, and practice. Chapter, 5:153--197, 1996.Google Scholar
- R Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2015.Google Scholar
- V. Ramalingam, D. LaBelle, and S. Wiedenbeck. Self-efficacy and mental models in learning to program. Proceedings of the 9th annual SIGCSE conference on Innovation and technology in computer science education - ITiCSE '04, page 171, 2004. Google ScholarDigital Library
- T. Raykov and G. A. Marcoulides. A First Course in Structural Equation Modeling. Lawrence Erlbaum Associates, London, 2006.Google Scholar
- Y. Rosseel.{lavaan}: An {R} Package for Structural Equation Modeling. Journal of Statistical Software, 48(2):1--36, 2012.Google ScholarCross Ref
- M. A. Rubio, R. Romero-Zaliz, C. Mañoso, and A. P. de Madrid. Closing the gender gap in an introductory programming course. Computers & Education, 82:409--420, 2015. Google ScholarDigital Library
- D. H. Schunk. Self-Efficacy and Education and Instruction. In Self-Efficacy, Adaptation, and Adjustment: Theory Research and Application, pages 281--303. 1995.Google ScholarCross Ref
- J. Sheard, S. Simon, M. Hamilton, and J. Lönnberg. Analysis of research into the teaching and learning of programming. Proceedings of the fifth international workshop on Computing education research workshop - ICER '09, page 93, 2009. Google ScholarDigital Library
- K. Sveidqvist, M. Bostock, C. Pettitt, M. Daines, A. Kashcha, and R. Iannone. DiagrammeR: Create Graph Diagrams and Flowcharts Using R, 2016.Google Scholar
- A. Syzmanowicz and A. Furnham. Gender differences in self-estimates of general, mathematical, spatial and verbal intelligence: Four meta analyses. Learning and Individual Differences, 21(5):493--504, 2011.Google ScholarCross Ref
- J. Tsan, K. E. Boyer, and C. F. Lynch. How Early Does the CS Gender Gap Emerge? A Study of Collaborative Problem Solving in 5th Grade Computer Science. Proceedings of the 47th ACM Technical Symposium on Computer Science Education (SIGCSE '16), pages 388--393, 2016. Google ScholarDigital Library
- J. C. Valentine, D. L. Dubois, and H. Cooper. The Relation Between Self-Beliefs and Academic Achievement: A Meta-Analytic Review. Educational Psychologist, 39:111--133, 2004.Google ScholarCross Ref
- C. Watson, F. W. B. Li, and J. L. Godwin. No Tests Required: Comparing Traditional and Dynamic Predictors of Programming Success. Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE '14), 2014. Google ScholarDigital Library
- H. Wickham. ggplot2: elegant graphics for data analysis. Springer New York, 2009. Google ScholarCross Ref
- S. Wiedenbeck. Factors affecting the success of non-majors in learning to program. Proceedings of the 2005 international workshop on Computing education research - ICER '05, pages 13--24, 2005. Google ScholarDigital Library
- B. C. Wilson. A Study of Factors Promoting Success in Computer Science Including Gender Differences. Computer Science Education, 12(1--2):141--164, 2010.Google Scholar
- B. C. Wilson and S. Shrock. Contributing to success in an introductory computer science course: a study of twelve factors. ACM SIGCSE Bulletin, 33(1):184--188, 2001. Google ScholarDigital Library
- P. H. Winne. A metacognitive view of individual differences in self-regulated learning. Learning and Individual Differences, 8(4):327--353, 1996.Google ScholarCross Ref
- C. Wolters and S. Yu. The Relation Between Goal Orientation and Students' Motivational Beliefs and Self-Regulated Learning. Learning & Individual Differences, 8(3):211--238, 1996.Google ScholarCross Ref
- B. J. Zimmerman. Becoming a self-regulated learner: Which are the key subprocesses? Contemporary Educational Psychology, 11(4):307--313, 1986.Google ScholarCross Ref
- B. J. Zimmerman. Self-Regulated Learning and Academic Achievement: An Overview. Educational psychologist, 25(1):3--17, 2010.Google ScholarCross Ref
- D. Zingaro and L. Porter. Impact of Student Achievement Goals on CS1 Outcomes. Proceedings of the 47th ACM Technical Symposium on Computer Science Education (SIGCSE '16), pages 279--284, 2016. Google ScholarDigital Library
Index Terms
- Learning to Program: Gender Differences and Interactive Effects of Students' Motivation, Goals, and Self-Efficacy on Performance
Recommendations
Designing Learning by Teaching Agents: The Betty's Brain System
The idea that teaching others is a powerful way to learn is intuitively compelling and supported in the research literature. We have developed computer-based, domain-independent Teachable Agents that students can teach using a visual representation. The ...
Examining the role of self-regulated learning on introductory programming performance
ICER '05: Proceedings of the first international workshop on Computing education researchThe purpose of this study was to investigate the relationship between self-regulated learning (SRL) and introductory programming performance. Participants were undergraduate students enrolled in an introductory computer programming module at a third-...
The effects of feedback protocol on self-regulated learning in a web-based worked example learning environment
The current research investigated the effects of differing feedback protocols in a Web-based worked example learning environment to determine if changes would occur over time in goal orientation, self-regulation, self-efficacy or achievement. ...
Comments