skip to main content
10.1145/3059009.3059036acmconferencesArticle/Chapter ViewAbstractPublication PagesiticseConference Proceedingsconference-collections
research-article

On the Ability to Reason About Program Behaviour: A Think-Aloud Study

Published:28 June 2017Publication History

ABSTRACT

Abstraction is a core skill for both programming and problem solving, however it is also a challenge for many students to develop a correct understanding of abstract concepts, such as program behaviour, which causes them to struggle with both introductory and advanced programming courses. Thus, evaluating students' ability to reason about programs should be an important topic for CS education.

We use a think-aloud study to record and analyse the strategies students apply to reason about program behaviour within the context of reversibility. Reversibility is a property of a program or function that indicates it could be brought back to its original state. Reasoning about reversibility requires students to have a mental model of the state, thus they should reason about program behaviour as a whole, compared with reasoning about concrete cases using testing and tracing. We have identified four strategies used by students to complete the reversibility task, which we have named as algorithm decomposition, input analysis, abstraction and inductive testing. Although 70% of students successful identified reversibility in 2 of the 3 exercises, most students fail to correctly reason about reversibility in an exercise involving a seemingly simple conditional statement.

References

  1. R. Bornat, S. Dehnadi, and D. Barton. Observing mental models in novice programmers. In Proc. 24th Annual Workshop of the Psychology of Programming Interest Group, ACE '12, pages 77--86, 2012.Google ScholarGoogle Scholar
  2. I. Cetin. Student's Understanding of Loops and Nested Loops in Computer Programming: An APOS Theory Perspective. Canadian Journal of Science, Mathematics and Technology Education, 15(2):155--170, Feb. 2015.Google ScholarGoogle ScholarCross RefCross Ref
  3. E. Charters. The Use of Think-aloud Methods in Qualitative Research An Introduction to Think-aloud Methods. Brock Educ. J., 12(2):68--82, 2003.Google ScholarGoogle ScholarCross RefCross Ref
  4. C. L. Corritore and S. Wiedenbeck. What do novices learn during program comprehension? International Journal of Human-Computer Interaction, 3(2):199--222, 1991.Google ScholarGoogle ScholarCross RefCross Ref
  5. K. Ericsson and H. Simon. Protocol Analysis: Verbal Reports as Data. Bradford books. MIT Press, 1984.Google ScholarGoogle Scholar
  6. F. King, L. Goodson, and F. Rohani. Higher order thinking skills: Definitions, strategies, assessment. A publication of the Educational Services Program (now known as the Center for Advancement of Learning and Assessment). Retrieved December, 4:2014, 1998.Google ScholarGoogle Scholar
  7. R. Lister. Concrete and other neo-piagetian forms of reasoning in the novice programmer. Conf. Res. Pract. Inf. Technol. Ser., 114:9--18, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. R. Lister, B. Simon, E. Thompson, J. L. Whalley, and C. Prasad. Not seeing the forest for the trees: Novice programmers and the solo taxonomy. SIGCSE Bull., 38(3):118--122, June 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. M. Lopez, J. Whalley, P. Robbins, and R. Lister. Relationships between reading, tracing and writing skills in introductory programming. In Proc. 4th Int. Workshop on Computing Education Research, ICER '08, pages 101--112, New York, NY, USA, 2008. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. N. Pennington. Empirical studies of programmers: Second workshop. chapter Comprehension Strategies in Programming, pages 100--113. Ablex Publishing Corp., Norwood, NJ, USA, 1987. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. N. Ragonis and M. Ben-Ari. On understanding the statics and dynamics of object-oriented programs. SIGCSE Bull., 37(1):226--230, Feb. 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. P. Sutherland. The application of piagetian and neo-piagetian ideas to further and higher education. International Journal of Lifelong Education, 18(4):286--294, 1999.Google ScholarGoogle ScholarCross RefCross Ref
  13. D. Teague and R. Lister. Programming: Reading, Writing And Reversing. Proc. 19th ACM Conf. Innov. Technol. Comput. Sci. Educ. - ITiCSE '14, pages 285--290, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. On the Ability to Reason About Program Behaviour: A Think-Aloud Study

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      ITiCSE '17: Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education
      June 2017
      412 pages
      ISBN:9781450347044
      DOI:10.1145/3059009

      Copyright © 2017 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 28 June 2017

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      ITiCSE '17 Paper Acceptance Rate56of175submissions,32%Overall Acceptance Rate552of1,613submissions,34%

      Upcoming Conference

      ITiCSE 2024

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader