Skip to main content

Eye Tracking-Based Platform for Programming Teaching

  • Conference paper
  • First Online:
Human-Computer Interaction (HCI-COLLAB 2023)

Abstract

Currently, the benefits of learning about Computer Science in general, and algorithms and programming in particular, are widely recognised. There is a vulnerable student population with motor disabilities that could benefit from programming learning environments featuring interaction methods beyond conventional ones, such as a keyboard and mouse.

In this work, we present the definition and design of a platform dedicated to programming education that utilises eye tracking as the primary mechanism for human-computer interaction. This techno-pedagogical device supports the creation of simple software components, serving as a tool to reinforce the learning of concepts in the field of algorithms and programming. Additionally, an open-source prototype is introduced, implementing key aspects of the designed platform. This prototype allows users who are unable to interact through conventional means to develop, modify, and execute programs using their gaze as the primary means of human-computer interaction. The purpose is to contribute to narrowing the gaps created by conventional input methods when aiming to include students with motor disabilities in environments designed to learn programming practices and concepts.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://brackets.io/.

  2. 2.

    https://developers.google.com/mediapipe.

References

  1. Papert, S.: Mindstorms: Children, Computers, and Powerful Ideas. Basic Books Inc, USA (1980)

    Google Scholar 

  2. Wing, J.: Computational thinking. Commun. ACM 49, 33–35 (2006). https://doi.org/10.1145/1118178.1118215

    Article  Google Scholar 

  3. The K–12 Computer Science Framework. The Computer Science Teachers Association, New York (2016)

    Google Scholar 

  4. Bonello, M., Czemerinski, H.: Program.ar: una propuesta para incorporar ciencias de la computación a la escuela Argentina (2015)

    Google Scholar 

  5. Smith, M.: Computer science for all. The White House (2016)

    Google Scholar 

  6. Falkner, K., et al.: An international comparison of k-12 computer science education intended and enacted curricula, pp. 1–10 (2019). https://doi.org/10.1145/3364510.3364517

  7. Society, R.: After the reboot: Computing education in UK schools. Policy Report (2017)

    Google Scholar 

  8. Consejo Provincial de Educación de la Provincia de Neuquén: Diseño Curricular Jurisdiccional de los tres primeros años de la Escuela Secundaria Neuquina. Resolución Nº1463/18 (2018)

    Google Scholar 

  9. Bialowas, S., Szyszka, A.: Eye-tracking research, pp. 40–60 (2021). kd3g

    Google Scholar 

  10. Maboe, M., Eloff, M., Schoeman, M.: The role of accessibility and usability in bridging the digital divide for students with disabilities in an e-learning environment, pp. 222–228 (2018). https://doi.org/10.1145/3278681.3278708

  11. Santos, A.L.: Javardeye: gaze input for cursor control in a structured editor, p. 31–35. Programming 2021, Association for Computing Machinery, New York, NY, USA (2021). https://doi.org/10.1145/3464432.3464435

  12. Jara Guillén, B.C., Barzallo Vallejo, B.P.: Desarrollo de un software para realizar evaluaciones educativas a niños con parálisis cerebral entre 5 a 7 años de edad con el uso de sistemas eye-tracking. B.S. thesis, Universidad del Azuay (2018)

    Google Scholar 

  13. Rotariu, C., Costin, H., Bozomitu, R.G., Petroiu-Andruseac, G., Ursache, T.I., Doina Cojocaru, C.: New assistive technology for communicating with disabled people based on gaze interaction. In: 2019 E-Health and Bioengineering Conference (EHB), pp. 1–4 (2019). https://doi.org/10.1109/EHB47216.2019.8969981

  14. Molina, A.I., Navarro, Ó., Ortega, M., Lacruz, M.: Evaluating multimedia learning materials in primary education using eye tracking. Comput. Stand. Interfaces, 59, 45–60 (2018). https://doi.org/10.1016/j.csi.2018.02.004

  15. Jamet, E.: An eye-tracking study of cueing effects in multimedia learning. Comput. Hum. Behav. 32, 47–53 (2014). https://doi.org/10.1016/j.chb.2013.11.013

    Article  Google Scholar 

  16. Hyönä, J.: The use of eye movements in the study of multimedia learning. Learn. Instruction 20(2), 172–176 (2010). https://doi.org/10.1016/j.learninstruc.2009.02.013

    Article  Google Scholar 

  17. Dilini, N., Senaratne, A., Yasarathna, T., Warnajith, N., Seneviratne, L.: Cheating detection in browser-based online exams through eye gaze tracking. pp. 1–8 (2021). https://doi.org/10.1109/ICITR54349.2021.9657277

  18. Katona, J.: Measuring cognition load using eye-tracking parameters based on algorithm description tools. Sensors 22(3) (2022). https://doi.org/10.1109/ICITR54349.2021.965727

  19. Radevski, S., Hata, H., Matsumoto, K.: Eyenav: gaze-based code navigation, pp. 1–4 (2016). https://doi.org/10.1145/2971485.2996724

  20. Ramos, M.C.: Una plataforma para la Programación Tangible. Tesis de Licenciatura en Ciencias de la Computación, Facultad de Informática. Universidad Nacional del Comahue (2021)

    Google Scholar 

  21. Lugaresi, C., et al.: Mediapipe: a framework for building perception pipelines (2019). https://doi.org/10.48550/arXiv.1906.08172

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Guillermo A. Guerrero .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Guerrero, G.A., Rodríguez, J.P., Cecchi, L.A. (2024). Eye Tracking-Based Platform for Programming Teaching. In: Ruiz, P.H., Agredo-Delgado, V., Mon, A. (eds) Human-Computer Interaction. HCI-COLLAB 2023. Communications in Computer and Information Science, vol 1877. Springer, Cham. https://doi.org/10.1007/978-3-031-57982-0_13

Download citation

Publish with us

Policies and ethics