skip to main content
research-article

Learners Learn More and Instructors Track Better with Real-time Gaze Sharing

Published: 22 April 2021 Publication History

Abstract

Shared gaze visualizations, where the real-time gaze location of group members is shared with one another, have become increasingly studied over the last decade by HCI researchers. Shared gaze studies so far have found improved outcomes and better collaboration for peer collaborators. Less is known, however, about how gaze sharing may aid learners and instructors. In our study, an instructor teaches a learner how to assemble and program a simple microcontroller, communicating either through a webcam feed (webcam condition), a field-of-view video feed (HMC condition), or a field-of-view video feed with a gaze location pointer (gaze condition). We find that learning gain is highest in the gaze condition, especially for low achievers. Moreover, instructors predict learner post-test scores more accurately with gaze visualizations, suggesting gaze sharing can help instructors track the cognitive state of the learner. This effect was also most salient for low achievers. We find that in the HMC condition that only lacked this single dot, many of the benefits for both learning and teaching were lost. The paper concludes with discussions on how gaze visualization may support learning and teaching, and on the tool's limitations and conditions for usefulness.

References

[1]
Michael Baker, Tia Hansen, and Richard Joiner. 1999. The role of grounding in collaborative learning tasks. In Collaborative learning: Cognitive and computational approaches, Pierre Dillenbourg (ed.). Pergamon, Oxford, 31--63.
[2]
Douglas Bates, Reinhold Kliegl, Shravan Vasishth, and Harald Baayen. 2018. Parsimonious Mixed Models. arXiv:1506.04967 [stat] (May 2018). Retrieved October 10, 2020 from http://arxiv.org/abs/1506.04967
[3]
Roman Bednarik, Carsten Schulte, Lea Budde, Birte Heinemann, and Hana Vrzakova. 2018. Eye-movement Modeling Examples in Source Code Comprehension: A Classroom Study. In Proceedings of the 18th Koli Calling International Conference on Computing Education Research (Koli Calling '18), Association for Computing Machinery, Koli, Finland, 1--8.
[4]
Matthew Berland, Ryan S. Baker, and Paulo Blikstein. 2014. Educational Data Mining and Learning Analytics: Applications to Constructionist Research. Tech Know Learn 19, 1 (July 2014), 205--220.
[5]
Paulo Blikstein and Marcelo Worsley. 2016. Multimodal Learning Analytics and Education Data Mining: using computational technologies to measure complex learning tasks. Journal of Learning Analytics 3, 2 (September 2016), 220--238.
[6]
Susan E. Brennan, Xin Chen, Christopher A. Dickinson, Mark B. Neider, and Gregory J. Zelinsky. 2008. Coordinating cognition: The costs and benefits of shared gaze during collaborative search. Cognition 106, 3 (March 2008), 1465--1477.
[7]
Anthony S Bryk and Stephen W Raudenbush. 1987. Application of Hierarchical Linear Models to Assessing Change. Psychological Bulletin 101, 1 (1987), 147--158.
[8]
Teresa Busjahn, Roman Bednarik, Andrew Begel, Martha Crosby, James H. Paterson, Carsten Schulte, Bonita Sharif, and Sascha Tamm. 2015. Eye Movements in Code Reading: Relaxing the Linear Order. In 2015 IEEE 23rd International Conference on Program Comprehension, 255--265.
[9]
Su Cai, Xu Wang, and Feng-Kuang Chiang. 2014. A case study of Augmented Reality simulation system application in a chemistry course. Computers in Human Behavior 37, (August 2014), 31--40.
[10]
Shiwei Cheng, Zhiqiang Sun, Lingyun Sun, Kirsten Yee, and Anind K. Dey. 2015. Gaze-Based Annotations for Reading Comprehension. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), Association for Computing Machinery, Seoul, Republic of Korea, 1569--1572.
[11]
Herbert H. Clark and Susan E. Brennan. 1991. Grounding in communication. In Perspectives on socially shared cognition. American Psychological Association, Washington, DC, US, 127--149.
[12]
Sarah D'Angelo and Andrew Begel. 2017. Improving Communication Between Pair Programmers Using Shared Gaze Awareness. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17), Association for Computing Machinery, Denver, Colorado, USA, 6245--6290.
[13]
Sarah D'Angelo and Darren Gergle. 2016. Gazed and Confused: Understanding and Designing Shared Gaze for Remote Collaboration. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, San Jose California USA, 2492--2496.
[14]
Lori J. Dwyer, Mitchell R. Williams, and Shana Pribesh. 2019. Impact of Early Alert on Community College Student Persistence in Virginia. Community College Journal of Research and Practice 43, 3 (March 2019), 228--231.
[15]
Elizabeth van Es and Miriam Sherin. 2002. Learning to Notice: Scaffolding New Teachers' Interpretations of Classroom Interactions. Journal of Information Technology for Teacher Education 10, 4 (2002), 571--596.
[16]
David F. Feldon. 2007. Cognitive Load and Classroom Teaching: The Double-Edged Sword of Automaticity. Educational Psychologist 42, 3 (July 2007), 123--137.
[17]
Alexandra Frischen, Andrew P. Bayliss, and Steven P. Tipper. 2007. Gaze Cueing of Attention. Psychol Bull 133, 4 (July 2007), 694--724.
[18]
Catherine Good, Joshua Aronson, and Jayne Ann Harder. 2008. Problems in the pipeline: Stereotype threat and women's achievement in high-level math courses. Journal of Applied Developmental Psychology 29, 1 (January 2008), 17--28.
[19]
Kunal Gupta, Gun A. Lee, and Mark Billinghurst. 2016. Do You See What I See? The Effect of Gaze Tracking on Task Space Remote Collaboration. IEEE Transactions on Visualization and Computer Graphics 22, 11 (November 2016), 2413--2422.
[20]
Keita Higuch, Ryo Yonetani, and Yoichi Sato. 2016. Can Eye Help You?: Effects of Visualizing Eye Fixations on Remote Collaboration Scenarios for Physical Tasks. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, ACM Press, Santa Clara, California, USA, 5180--5190.
[21]
Simon Ho, Tom Foulsham, and Alan Kingstone. 2015. Speaking and Listening with the Eyes: Gaze Signaling during Dyadic Interactions. PLoS One 10, 8 (August 2015).
[22]
Matthew Inglis and Lara Alcock. 2012. Expert and Novice Approaches to Reading Mathematical Proofs. Journal for Research in Mathematics Education 43, 4 (2012), 358--390.
[23]
Halszka Jarodzka, Peter Gerjets, Tamara van Gog, and Michael Dorr. 2010. How to Convey Perceptual Skills by Displaying Experts' Gaze Data. (2010), 6.
[24]
Patrick Jermann, Marc-Antoine Nüssli, and Weifeng Li. 2010. Using dual eye-tracking to unveil coordination and expertise in collaborative Tetris.
[25]
Grete Helena Kütt, Kevin Lee, Ethan Hardacre, and Alexandra Papoutsaki. 2019. Eye-Write: Gaze Sharing for Collaborative Writing. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19), Association for Computing Machinery, Glasgow, Scotland Uk, 1--12.
[26]
Lucia Mason, Patrik Pluchino, and Maria Caterina Tornatora. 2015. Eye-movement modeling of integrative reading of an illustrated text: Effects on processing and learning. Contemporary Educational Psychology 41, (April 2015), 172--187.
[27]
Bernhard Maurer, Michael Lankes, Barbara Stiglbauer, and Manfred Tscheligi. 2016. EyeCo: Effects of Shared Gaze on Social Presence in an Online Cooperative Game. In Entertainment Computing - ICEC 2016 (Lecture Notes in Computer Science), Springer International Publishing, Cham, 102--114.
[28]
Andrew F. Monk and Caroline Gale. 2002. A Look Is Worth a Thousand Words: Full Gaze Awareness in Video-Mediated Conversation. Discourse Processes 33, 3 (May 2002), 257--278.
[29]
Joshua Newn, Eduardo Velloso, Fraser Allison, Yomna Abdelrahman, and Frank Vetere. 2017. Evaluating Real-Time Gaze Representations to Infer Intentions in Competitive Turn-Based Strategy Games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play, ACM, Amsterdam The Netherlands, 541--552.
[30]
Hans-Rüdiger Pfister. 2005. How to Support Synchronous Net-Based Learning Discourses: Principles and Perspectives. In Barriers and Biases in Computer-Mediated Knowledge Communication: And How They May Be Overcome, Rainer Bromme, Friedrich W. Hesse and Hans Spada (eds.). Springer US, Boston, MA, 39--57.
[31]
Pernilla Qvarfordt, David Beymer, and Shumin Zhai. 2005. RealTourist -- A Study of Augmenting Human-Human and Human-Computer Dialogue with Eye-Gaze Overlay. In Human-Computer Interaction - INTERACT 2005 (Lecture Notes in Computer Science), Springer, Berlin, Heidelberg, 767--780.
[32]
Eyal M. Reingold, Neil Charness, Marc Pomplun, and Dave M. Stampe. 2001. Visual Span in Expert Chess Players: Evidence From Eye Movements. Psychol Sci 12, 1 (January 2001), 48--55.
[33]
Melissa Roderick and Mimi Engel. 2001. The Grasshopper and the Ant: Motivational Responses of Low-Achieving Students to High-Stakes Testing. Educational Evaluation and Policy Analysis 23, 3 (September 2001), 197--227.
[34]
Sajay Sadasivan, Joel S. Greenstein, Anand K. Gramopadhye, and Andrew T. Duchowski. 2005. Use of eye movements as feedforward training for a synthetic aircraft inspection task. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05), Association for Computing Machinery, Portland, Oregon, USA, 141--149.
[35]
M. Scaife and J. S. Bruner. 1975. The capacity for joint visual attention in the infant. Nature 253, 5489 (January 1975), 265--266.
[36]
Bertrand Schneider and Roy Pea. 2013. Real-time mutual gaze perception enhances collaborative learning and collaboration quality. Intern. J. Comput.-Support. Collab. Learn. 8, 4 (December 2013), 375--397.
[37]
Alan H. Schoenfeld and Douglas J. Herrmann. 1982. Problem perception and knowledge structure in expert and novice mathematical problem solvers. Journal of Experimental Psychology: Learning, Memory, and Cognition 8, 5 (1982), 484--494.
[38]
Kshitij Sharma, Patrick Jermann, and Pierre Dillenbourg. 2014. "With-me-ness": A gaze-measure for students' attention in MOOCs. Proceedings of International Conference of the Learning Sciences 2014 (2014), 1017--1022.
[39]
Kusum Singh, Monique Granville, and Sandra Dika Reviewed work(s): 2002. Mathematics and Science Achievement: Effects of Motivation, Interest, and Academic Engagement. The Journal of Educational Research 95, 6 (2002), 323--332.
[40]
Oleg ?pakov, Diederick Niehorster, Howell Istance, Kari-Jouko Räihä, and Harri Siirtola. 2019. Two-Way Gaze Sharing in Remote Teaching. In Human-Computer Interaction -- INTERACT 2019 (Lecture Notes in Computer Science), Springer International Publishing, Cham, 242--251.
[41]
Maria Staudte and Matthew W. Crocker. 2011. Investigating joint attention mechanisms through spoken human--robot interaction. Cognition 120, 2 (August 2011), 268--291.
[42]
Shari L. Stockero. 2014. Transitions in Prospective Mathematics Teacher Noticing. In Research Trends in Mathematics Teacher Education, Jane-Jane Lo, Keith R. Leatham and Laura R. Van Zoest (eds.). Springer International Publishing, Cham, 239--259.
[43]
Melanie Swan. 2012. Sensor Mania! The Internet of Things, Wearable Computing, Objective Metrics, and the Quantified Self 2.0. Journal of Sensor and Actuator Networks 1, 3 (December 2012), 217--253.
[44]
Michael Tomasello. 1995. Joint attention as social cognition. In Joint attention: Its origins and role in development. Lawrence Erlbaum Associates, Inc, Hillsdale, NJ, US, 103--130.
[45]
Samuel J. Vine, Rich S. W. Masters, John S. McGrath, Elizabeth Bright, and Mark R. Wilson. 2012. Cheating experience: Guiding novices to adopt the gaze strategies of experts expedites the learning of technical laparoscopic skills. Surgery 152, 1 (July 2012), 32--40.
[46]
Susan Wiedenbeck, Vikki Fix, and Jean Scholtz. 1993. Characteristics of the mental representations of novice and expert programmers: an empirical study. International Journal of Man-Machine Studies 39, 5 (November 1993), 793--812.
[47]
Nancy Yao, Jeff Brewer, Sarah D'Angelo, Mike Horn, and Darren Gergle. 2018. Visualizing Gaze Information from Multiple Students to Support Remote Instruction. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18), Association for Computing Machinery, Montreal QC, Canada, 1--6.

Cited By

View all
  • (2024)Gaze Sharing, a Double-Edged Sword: Examining the Effect of Real-Time Gaze Sharing Visualizations on Team Performance and Situation AwarenessHuman Factors: The Journal of the Human Factors and Ergonomics Society10.1177/00187208241272060Online publication date: 19-Aug-2024
  • (2024)Understanding The Needs of Mentoring in Surgery to Guide the Design of Surgical Telementoring SystemsProceedings of the ACM on Human-Computer Interaction10.1145/36374208:CSCW1(1-28)Online publication date: 26-Apr-2024
  • (2024)Looking Together ≠ Seeing the Same Thing: Understanding Surgeons' Visual Needs During Intra-operative Coordination and InstructionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641929(1-12)Online publication date: 11-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction
Proceedings of the ACM on Human-Computer Interaction  Volume 5, Issue CSCW1
CSCW
April 2021
5016 pages
EISSN:2573-0142
DOI:10.1145/3460939
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 April 2021
Published in PACMHCI Volume 5, Issue CSCW1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. communications applications
  2. gaze visualization
  3. information interfaces and presentation
  4. technology-supported learning

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)80
  • Downloads (Last 6 weeks)7
Reflects downloads up to 15 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Gaze Sharing, a Double-Edged Sword: Examining the Effect of Real-Time Gaze Sharing Visualizations on Team Performance and Situation AwarenessHuman Factors: The Journal of the Human Factors and Ergonomics Society10.1177/00187208241272060Online publication date: 19-Aug-2024
  • (2024)Understanding The Needs of Mentoring in Surgery to Guide the Design of Surgical Telementoring SystemsProceedings of the ACM on Human-Computer Interaction10.1145/36374208:CSCW1(1-28)Online publication date: 26-Apr-2024
  • (2024)Looking Together ≠ Seeing the Same Thing: Understanding Surgeons' Visual Needs During Intra-operative Coordination and InstructionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641929(1-12)Online publication date: 11-May-2024
  • (2024)Gaze analysisImage and Vision Computing10.1016/j.imavis.2024.104961144:COnline publication date: 1-Apr-2024
  • (2024)Immersive gaze sharing for enhancing education: An exploration of user experience and future directionsComputers & Education: X Reality10.1016/j.cexr.2024.1000815(100081)Online publication date: Dec-2024
  • (2023)Can Synchronous Code Editing and Awareness Tools Support Remote Tutoring? Effects on Learning and TeachingProceedings of the ACM on Human-Computer Interaction10.1145/36101777:CSCW2(1-30)Online publication date: 4-Oct-2023
  • (2023)Three challenges in Implementing multimodal learning analytics in real-world learning environmentsLearning: Research and Practice10.1080/23735082.2023.227061110:1(103-112)Online publication date: 7-Nov-2023
  • (2023)Design of Collaborative Learning Experience with AR–AR Collaboration Game for Children at MuseumEntertainment Computing – ICEC 202310.1007/978-981-99-8248-6_19(231-240)Online publication date: 15-Nov-2023
  • (2023)Automated Detection of Students’ Gaze Interactions in Collaborative Learning Videos: A Novel ApproachResponsive and Sustainable Educational Futures10.1007/978-3-031-42682-7_34(504-517)Online publication date: 4-Sep-2023
  • (2022)Small Pupils Lead to Lower Judgements of a Person’s Characteristics for Exaggerated, but Not for Realistic PupilsBehavioral Sciences10.3390/bs1208028312:8(283)Online publication date: 12-Aug-2022
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media