skip to main content
10.1145/3524488.3527363acmconferencesArticle/Chapter ViewAbstractPublication PagesetraConference Proceedingsconference-collections
research-article

Some thoughts on designing eye movement studies for novice programmers

Published:28 November 2022Publication History

ABSTRACT

I first describe my three-stage model of how novices understand code. In the first stage, the novice cannot trace code. In the second stage, the novice has mastered tracing, but, crucially, that is the only skill they have mastered. It is only when novices reach the third stage that they begin to reason about code in a more general, abstract way. Most programming instructors mistakenly assume that all students begin at the third stage. Having described the three-stage model, I then explore implications of the model for the design of eye movement studies. I also provide some pieces of code that would make for interesting eye movement studies.

References

  1. Raymond Lister, Elizabeth S. Adams, Sue C. Fitzgerald, William Fone, John Hamer, Morten Lindholm, Robert McCartney, Jan Erik Moström, Kate E Sanders, Otto Seppälä, Beth Simon, Lynda A Thomas (2004). A Multi-National Study of Reading and Tracing Skills in Novice Programmers. SIGSCE Bulletin, 36(4), 119--150. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Raymond Lister, Beth Simon, Errol Thompson, Jacqueline L. Whalley, Christine Prasad (2006) Not seeing the forest for the trees: novice programmers and the SOLO taxonomy. ACM SIGCSE Bulletin 38 (3), 118--122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Raymond Lister (2011). Concrete and Other Neo-Piagetian Forms of Reasoning in the Novice Programmer. Thirteenth Australasian Computer Education Conference, Perth. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Raymond Lister (2016) Toward a Developmental Epistemology of Computer Programming. Keynote paper/address at Workshop in Primary and Secondary Computing Education (WiPSCE), Münster, Germany, 13 - 15 Oct 2016. pp. 5--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Raymond Lister (2020) On the cognitive development of the novice programmer: and the development of a computing education researcher. Keynote paper/address at the 9th Computer Science Education Research Conference (CSERC '20). pp. 1--15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Mike Lopez, Jacqueline L. Whalley, Phil Robbins, Raymond Lister (2008) Relationships between reading, tracing and writing skills in introductory programming. Fourth International Workshop on Computing Education Research (Sydney, Australia, September 6 - 7). ICER '08. ACM, New York, NY, 101--112. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Laurie Murphy, Sue Fitzgerald, Raymond Lister, and Renée McCauley. (2012). Ability to 'explain in plain english' linked to proficiency in computer-based programming. In Proceedings of the ninth annual international conference on computing education research (ICER '12). ACM, New York, NY, USA, 111--118. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Thomas Pelchen and Raymond Lister. 2019. On the Frequency of Words Used in Answers to Explain in Plain English Questions by Novice Programmers. In Proceedings of the Twenty-First Australasian Computing Education Conference (ACE '19). Association for Computing Machinery, New York, NY, USA, 11--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Juha Sorva. 2012. Visual program simulation in introductory programming education. (Doctoral dissertation). Aalto University, Espoo, Finland. ISBN (printed) 978-952-60-4625-9. https://aaltodoc.aalto.fi/handle/123456789/3534Google ScholarGoogle Scholar
  10. Donna Teague. 2015. Neo-Piagetian Theory and the Novice Programmer. Ph.D Thesis. Queensland University of Technology. http://eprints.qut.edu.au/86690/1/Donna_Teague_Thesis.pdfGoogle ScholarGoogle Scholar
  11. Lynda Thomas, Mark Ratcliffe, Benjy Thomasson. 2004 Scaffolding with object diagrams in first year programming classes: some unexpected results. SIGCSE Bull. 36, 1, pp 250--254. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Maarten W. van Someren, Yvonne F. Barnard, and Jacobijn A.C. Sandberg (1994). The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes. Academic Press.Google ScholarGoogle Scholar
  13. Anne Venables, Grace Tan, Raymond Lister. 2009. A Closer Look at Tracing, Explaining and Code Writing Skills in the Novice Programmer. International Computing Education Research Workshop (ICER), Berkeley, California, August 10--11, 117--128. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Jacqueline L. Whalley, Raymond Lister, Errol Thompson, Tony Clear, Phil Robbins Phil, P K Ajith Kumar, Christine Prasad. 2006. An Australasian study of reading and comprehension skills in novice programmers, using the bloom and SOLO taxonomies. Proceedings of the 8th Australasian Conference on Computing Education, 243--252. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Wikipedia. 2022. Cargo cult programming. https://en.wikipedia.org/wiki/Cargo_cult_programming [Accessed March 2022].Google ScholarGoogle Scholar
  16. Wikipedia. 2022. Programming by permutation. https://en.wikipedia.org/wiki/Programming_by_permutation [Accessed March 2022].Google ScholarGoogle Scholar
  17. Wikipedia. 2022. Shotgun debugging. https://en.wikipedia.org/wiki/Shotgun_debugging [Accessed March 2022].Google ScholarGoogle Scholar
  18. Wikipedia. 2022. Voodoo programming. https://en.wikipedia.org/wiki/Voodoo_programming [Accessed March 2022].Google ScholarGoogle Scholar

Index Terms

  1. Some thoughts on designing eye movement studies for novice programmers

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      EMIP '22: Proceedings of the Tenth International Workshop on Eye Movements in Programming
      May 2022
      30 pages
      ISBN:9781450392891
      DOI:10.1145/3524488

      Copyright © 2022 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 28 November 2022

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Upcoming Conference

      ETRA '24
      The 2024 Symposium on Eye Tracking Research and Applications
      June 4 - 7, 2024
      Glasgow , United Kingdom

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader