Abstract
We describe preliminary applications of network analysis techniques to eye-tracking data collected during a collaborative learning activity. This paper makes three contributions: first, we visualize collaborative eye-tracking data as networks, where the nodes of the graph represent fixations and edges represent saccades. We found that those representations can serve as starting points for formulating research questions and hypotheses about collaborative processes. Second, network metrics can be computed to interpret the properties of the graph and find proxies for the quality of students’ collaboration. We found that different characteristics of our graphs correlated with different aspects of students’ collaboration (for instance, the extent to which students reached consensus was associated with the average size of the strongly connected components of the graphs). Third, we used those characteristics to predict the quality of students’ collaboration by feeding those features into a machine-learning algorithm. We found that among the eight dimensions of collaboration that we considered, we were able to roughly predict (using a median-split) students’ quality of collaboration with an accuracy between ~85 and 100 %. We conclude by discussing implications for developing “collaboration-sensing” tools, and comment on implementing this approach for formal learning environments.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Anderson, J. R. (2004). Cognitive psychology and its implications (6th ed.). Worth Publishers.
Barron, B. (2003). When smart groups fail. The Journal of the Learning Sciences, 12(3), 307–359.
Bates, E., Thal, D., Whitesell, K., Fenson, L., & Oakes, L. (1989). Integrating language and gesture in infancy. Developmental Psychology, 25(6), 1004–1019.
Brooks, R., & Meltzoff, A. N. (2008). Infant gaze following and pointing predict accelerated vocabulary growth through two years of age: A longitudinal, growth curve modeling study. Journal of Child Language, 35(1), 207–220.
Catan, L. (1986). The dynamic display of process: Historical development and contemporary uses of the microgenetic method. Human Development, 29(5), 252–263.
Cherubini, M., Nüssli, M.-A., & Dillenbourg, P. (2008). Deixis and gaze in collaborative work at a distance (over a shared map): a computational model to detect misunderstandings. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications, ETRA’08 (pp. 173–180). New York: ACM.
Cortes, C., & Vapnik, V. N. (1995). Support-vector networks. Machine Learning, 20(3), 273–297.
Engelbart, D. (1963). Conceptual framework for the augmentation of man’s intellect. In P. Howerton & D. Weeks (Eds.), Vistas in information handling (pp. 1–29). Spartan Books.
Erdos, P., & Rényi, A. (1960). On the evolution of random graphs. Publ. Math. Inst. Hung. Acad. Sci, 5, 17–61.
Flavell, J. H., & Draguns, J. (1957). A microgenetic approach to perception and thought. Psychological Bulletin, 54(3), 197.
Freeman, L. (1977). A set of measures of centrality based upon betweenness. Sociometry, 40, 35–41.
Fruchterman, T. M., & Reingold, E. M. (1991). Graph drawing by force-directed placement. Software: Practice and Experience, 21(11), 1129–1164.
Hayes, A. F., & Krippendorff, K. (2007). Answering the call for a standard reliability measure for coding data. Communication Methods and Measures, 1, 77–89.
Jermann, P., Mullins, D., Nuessli, M.-A., & Dillenbourg, P. (2011). Collaborative gaze footprints: Correlates of interaction quality. In Proceedings of CSCL 2011. Hong Kong.
Licklider, J. C. R. (1960). Man-computer symbiosis. IRE Transactions on Human Factors in Electronics, 1, 4–11.
Liu, Y., Hsueh, P.-Y., Lai, J., Sangin, M., Nussli, M.-A., & Dillenbourg, P. (2009). Who is the expert? Analyzing gaze data to predict expertise level in collaborative applications. In IEEE International Conference on Multimedia and Expo, 2009. ICME 2009 (pp. 898 –901).
Luria, A. (1978). The development of writing in the child. In M. Cole (Ed.), The selected writings of A. R. Luria. New York: M. Sharpe. Originally published, 1928.
Meier, A., Spada, H., & Rummel, N. (2007). A rating scheme for assessing the quality of computer-supported collaboration processes. International Journal of Computer-Supported Collaborative Learning, 2(1), 63–86.
Pea, R. D. (2004). The social and technological dimensions of “scaffolding” and related theoretical concepts for learning, education and human activity. The Journal of the Learning Sciences, 13(3), 423–451.
Pellegrino, J. W., & Hilton, M. L. (Eds.). (2012). Education for life and work: Developing transferable knowledge and skills in the 21st century. Washington, DC: National Research Council.
Pentland, A. S. (2010). Honest signals. Cambridge: MIT Press.
Richardson, D. C., & Dale, R. (2005). Looking to understand: The coupling between speakers’ and listeners’ eye movements and its relationship to discourse comprehension. Cognitive Science, 29(6), 1045–1060.
Rosenthal, V. (2004). Microgenesis, immediate experience and visual processes in reading. In Seeing, thinking and knowing (pp. 221–243). Netherlands: Springer.
Roth, W.-M. (2001). Gestures: Their role in teaching and learning. Review of Educational Research, 71(3), 365–392.
Rothman, K. J. (1990). No adjustments are needed for multiple comparisons. Epidemiology, 1(1), 43–46.
Schneider, B., & Pea, R. (2013). Real-time mutual gaze perception enhances collaborative learning and collaboration quality. International Journal of Computer-Supported Collaborative Learning, 8(4), 375–397.
Schwartz, D. L. (1995). The emergence of abstract representations in dyad problem solving. The Journal of the Learning Sciences, 4(3), 321–354.
Schwartz, D., & Martin, T. (2004). Inventing to prepare for future learning: The hidden efficiency of encouraging original student production in statistics instruction. Cognition and Instruction, 22(2), 129–184.
Scribner, S. (1984). Organizing knowledge at work. Quarterly Newsletter of the Laboratory of Comparative Human Cognition, 6(1&2), 5.
Scribner, S. (1985). Vygotsky’s uses of history. In J. Wertsch (Ed.), Culture, communication, and cognition: Vygotskian perspectives (pp. 119–145). New York: Cambridge University Press.
Selassie, D., Heller, B., & Heer, J. (2011). Divided edge bundling for directional network data. IEEE Transactions on Visualization and Computer Graphics, 17(12), 2354–2363.
Stern, D. N. (2002). The first relationship: Infant and mother. Cambridge: Harvard University Press.
Streeck, J., Goodwin, C., & LeBaron, C. D. (Eds.). (2014). Embodied Interaction: Language and body in the material world. Cambridge: Cambridge University Press.
Tomasello, M. (1995). Joint attention as social cognition. In C. Moore & P. J. Dunham (Eds.), Joint attention: Its origins and role in development (pp. 103–130). Hillsdale: Lawrence Erlbaum Associates.
Vygotsky, L. S. (1978). Mind in society: The development of higher mental process. Cambridge: Harvard University Press.
Werner, H. (1940). The comparative psychology of mental development (2nd ed.). Chicago: Follett, 1948. Originally published, 1926.
Werner, H. (1956). Microgenesis and aphasia. Journal of Abnormal Social Psychology, 52, 347–353.
Acknowledgments
We gratefully acknowledge grant support from the National Science Foundation (NSF) for this work from the LIFE Center (NSF #0835854).
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix 1
Appendix 2
Rights and permissions
About this article
Cite this article
Schneider, B., Pea, R. Toward collaboration sensing. Intern. J. Comput.-Support. Collab. Learn. 9, 371–395 (2014). https://doi.org/10.1007/s11412-014-9202-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11412-014-9202-y