Abstract
This chapter constitutes an overview of logfile-based interaction analysis techniques that can be used for the support of Computer Supported Collaborative Learning (CSCL) activities. Interaction analysis is central in the study of CSCL activities, since in such activities through interactions between partners the state of evolving group knowledge is communicated. This interaction is facilitated by tools that allow logging of events that take place, capturing thus information about the content and the process of collaboration. Automated analysis techniques of this information can be developed. The objective of this analysis is often to support participants, in several ways: explicitly, by providing feedback to them in order to regulate their practices, or by making adaptive changes to some aspects of the collaborative setting; or implicitly, by making available to them representations of their activities. This chapter presents the most common approaches used in interaction analysis, while it particularly emphasizes recent innovative efforts to reap the advantages of machine learning techniques in order to overcome common shortcomings of previous approaches.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Avouris, N., Dimitracopoulou, A., Komis, V.: On analysis of collaborative problem solving: An object oriented approach. Computers in Human Behavior 19(2), 147–167 (2003)
Avouris, N., Margaritis, M., Komis, V.: Modelling interaction during small-group synchronous problem-solving activities: The Synergo approach. In: 2nd Int. Workshop on Designing Computational Models of Collaborative Learning Interaction, ITS 2004, Maceio, Brasil (September 2004)
Baker, M.J., Lund, K.: Promoting reflective interactions in a CSCL environment. Journal of Computer Assisted Learning 13, 175–193 (1997)
Baker, M.J., Quignard, M., Lund, K., Séjourné, A.: Computer-supported collaborative learning in the space of debate. In: Wasson, B., Ludvigsen, S., Hoppe, U. (eds.) Designing for Change in Networked Learning Environments, pp. 11–20. Kluwer Academic Publishers, Dordrecht (2003)
Barros, M., Verdejo, M.: Analysing student interaction processes in order to improve collaboration. The DEGREE approach. International Journal of Artificial Intelligence in Education 11, 221–241 (2000)
Brown, A.: Metacognition, Executive Control, Self regulation, and other more mysterious mechanisms. In: Weinert, F.E., Kluwe, R.H. (eds.) Metacognition, motivation and understanding. Laurence Erlbaum Associates, Hillsdale (1987)
Buisine, S.: Quantitative assessment of collaboration. International Reports on Socio-Informatics 7, 32–39 (2010)
Cohen, J.: A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20, 37–46 (1960)
Collins, A., Brown, J.S., Holum, A.: Cognitive apprenticeship: making thinking visible. American Educator 15(3), 6–11,38–39 (1991)
Constantino-Gonzalez, M., Suthers, D.: A Coached Collaborative Learning Environment for Entity-Relationship Modeling. In: Gauthier, G., VanLehn, K., Frasson, C. (eds.) ITS 2000. LNCS, vol. 1839, pp. 324–333. Springer, Heidelberg (2000)
Cronbach, L.J.: Coefficient alpha and the internal structure of tests. Psychometrika 16(3), 297–334 (1951)
De Laat, M.: Network and content analysis in an online community discourse. In: Stahl, G. (ed.) Proceedings of CSCL 2002 Computer Support for Collaborative Learning: Foundations for a CSCL Community., pp. 625–626. Lawrence Erlbaum Associates, Hillsdale (2002)
Dillenbourg, P., Baker, M., Blaye, A., O’Malley, C.: The evolution of research on collaborative learning. In: Reimann, P., Spada, H. (eds.) Learning in Humans and Machines, pp. 189–211. Springer, Berlin (1995)
Dimitracopoulou, A., Petrou, A.: Advanced Collaborative Learning Systems for young students: Design issues and current trends on new cognitive and metacognitive tools. THEMES in Education International Journal (2003)
Dourish, P., Bellotti, V.: Awareness and Coordination in Shared Workspaces. In: Turner, J., Kraut, R.E. (eds.) CSCW 1992: Proceedings of the Conference on Computer-Supported Cooperative Work, Toronto, Canada, pp. 107–114. ACM Press, New York (1992)
Erkens, G., Janssen, J.: Automatic coding of communication in collaboration protocols. International Journal of Computer Supported Collaborative Learning 3(4), 447–470 (2008)
Garcia, A., Jacobs, J.: The eyes of the beholder: Understanding the turn talking system in quasi-synchronous computer mediated communication. Research on Language and Social Interaction 32(4), 337–367 (1999)
Garrison, D.R.: Critical thinking and adult education: A conceptual model for developing critical thinking in adult learners. International Journal of Lifelong Education 10(4), 287–303 (1991)
Garrison, D.R., Anderson, T., Archer, W.: Critical thinking in a text-based environment: computer conferencing in higher education. Internet and Higher Education 11, 1–14 (2000)
George, D., Mallery, P.: SPSS for Windows Step by Step: A Simple Guide and Reference. 11.0 Update. Allyn & Bacon, Boston (2003)
Guilford, J.P.: Psychometric methods. McGraw-Hill, New York (1954)
Gunawardena, C.N., Lowe, C.A., Anderson, T.: Analysis of global online debate and the development of an interaction analysis model for examining social construction of knowledge in computer conferencing. Journal of Educational Computer Research 17(4), 397–431 (1997)
Gutwin, C., Greenberg, S.: A Descriptive Framework of Workspace Awareness for Real-Time Groupware. Computer-Supported Cooperative Work 3-4, 411–446 (2002)
Henri, F.: Computer conferencing and content analysis. In: Kaye, A. (ed.) Collaborative Learning Through Computer Conferencing: The Najaden Papers, pp. 117–136. Springer, New York (1992)
Herring, S.C.: Interactional coherence in CMC. Journal of Computer-Mediated Communication 4(4) (1999)
Hewitt, J.: How habitual online practices affect the development of asynchronous discussion threads. Journal of Educational Computing Research 28, 31–45 (2003)
Hiltz, S.R., Turoff, M., Johnson, K.: Experiments in group decision making, 3: Disinhibition, deindividuation, and group process in pen name and real name computer conferences. Journal of Decision Support Systems 5, 217–232 (1989)
Holsti, O.R.: Content Analysis for the Social Sciences and Humanities. Addison-Wesley, Reading (1969)
Howell-Richardson, C., Mellar, H.: A methodology for the analysis of patterns of participation within computer mediated communication courses. Instructional Science 24, 47–69 (1996)
Inaba, A., Okamoto, T.: Negotiation Process Model for Intelligent Discussion Coordinating System on CSCL Environment. In: Proceedings of the 8th World Conference on Artificial Intelligence in Education, Kobe, Japan, pp. 175–182 (1997)
Järvelä, S., Häkkinen, P.: The levels of web-based discussions: Using perspective-taking theory as an analytical tool. In: van Oostendorp, H. (ed.) Cognition in a Digital World, pp. 77–95. Lawrence Erlbaum Associates, Mahwah (2003)
Jermann, P., Soller, A., Muehlenbrock, M.: From mirroring to guiding: A review of state of the art technology for supporting collaborative learning. In: Dillenbourg, P., Eurelings, A., Hakkarainen, K. (eds.) Proceedings of Euro CSCL 2001: European Perspectives on Computer-supported Collaborative Learning, Maastricht, The Netherlands, University of Maastricht, pp. 324–331 (2001)
Jermann, P., Dillenbourg, P.: Group mirrors to support interaction regulation in collaborative problem solving. Computers and Education 51(1), 279–296 (2008)
Jordan, B., Henderson, A.: Interaction Analysis: Foundations and Practice. Journal of the Learning Sciences 4(1), 39–103,1532–7809 (1995)
Kahrimanis, G., Meier, A., Chounta, I.A., Voyiatzaki, E., Spada, H., Rummel, N., Avouris, N.: Assessing collaboration quality in synchronous CSCL problem-solving activities: Adaptation and empirical evaluation of a rating scheme. In: Cress, U., Dimitrova, V., Specht, M. (eds.) EC-TEL 2009. LNCS, vol. 5794, pp. 267–272. Springer, Heidelberg (2009)
Kahrimanis, G., Chouda, I.A., Avouris, N.: Study of correlations between logfile-based metrics of interaction and the quality of synchronous collaboration. International Reports on Socio-Informatics (IRSI) 7(1), 24–31 (2010)
Katz, S., Aronis, J., Creitz, C.: Modelling pedagogical interactions with machine learning. In: Proceedings of the Ninth International Conference on Artificial Intelligence in Education, LeMans, France, pp. 543–550 (1999)
Kerlinger, F.N., Lee, H.B.: Foundations of behavioral research. Harcourt College Publishers, New York (2000)
Kollar, I., Fischer, F., Hesse, F.W.: Collaboration scripts–a conceptual analysis. Educational Psychology Review 18, 159–182 (2006)
Koschmann, T.: Paradigm shifts and instructional technology: An introduction. In: Koschmann, T. (ed.) CSCL: Theory and practice of an emerging paradigm, pp. 1–23. Lawrence Erlbaum Associates, Mahwah (1996)
Krippendorf, K.: Content analysis: An introduction to its methodology. Sage Publications, Beverly Hills (1980)
Langer, I., Schulz von Thun, F.: Messung komplexer Merkmale in Psychologie und Pädagogik - Ratingverfahren. Reinhardt, München (1974)
Law, N., Yuen, J., Huang, R., Li, Y., Pan, N.: A learnable content & participation analysis toolkit for assessing CSCL learning outcomes and processes. In: Chinn, C.A., Erkens, G., Puntambekar, S. (eds.) Mice, minds, and society: The Computer Supported Collaborative Learning (CSCL) Conference 2007, vol. 8, pp. 408–417. International Society of the Learning Sciences, New Brunswick (2007)
Lipponen, L.: Exploring foundations for computer-supported collaborative learning. In: Stahl, G. (ed.) Computer-supported collaborative learning: Foundations for a CSCL community. Proceedings of the Computer-Supported Collaborative Learning 2002 Conference, pp. 72–81. Erlbaum, Mahwah (2002)
Marshall, P., Hornecker, E., Morris, R., Dalton, N.S., Rogers, Y.: When the fingers do the talking: A study of group participation with varying constraints to a tabletop interface. In: Proceedings of IEEE International Workshop on Horizontal Interactive Human-Computer System, pp. 37–44 (2008)
Martinez, A., Dimitriadis, Y., Gomez, E., Rubia, B., de la Fuente, P.: Combining qualitative and social network analysis for the study of classroom social interactions. Computers and Education, special issue on Documenting Collaborative Interactions: Issues and Approaches 41(4), 353–368 (2003)
McManus, M., Aiken, R.: Monitoring computer-based problem solving. Journal of Artificial Intelligence in Education 6(4), 307–336 (1995)
Meier, A.: Evaluating Collaboration: A Rating Scheme for Assessing the Quality of Net-Based, Interdisciplinary, Collaborative Problem Solving. Unpublished diploma thesis, Institut für Psychologie, Albert-Ludwigs-Universität Freiburg im Breisgau, Freiburg, Germany (2005)
Meier, A., Spada, H., Rummel, N.: A rating scheme for assessing the quality of computer-supported collaboration processes. International Journal of Computer-Supported Collaborative Learning 2, 63–86 (2007)
Meier, A., Voyiatzaki, E., Kahrimanis, G., Rummel, N., Spada, H., Avouris, N.: Teaching students how to improve their collaboration: Assessing collaboration quality and providing adaptive feedback in a CSCL setting. In: Rummel, N., Weinberger, A. (eds.) New Challenges in CSCL: Towards adaptive script support. Proceedings of the Eighth International Conference of the Learning Sciences (ICLS 2008), Utrecht. International Society of the Learning Sciences, June 2008, vol. 3, pp. 338–345 (2008)
Muehlebrock, M., Hoppe, H.U.: A collaboration monitor for shared workspaces. In: Proceedings of the International Conference on Artificial Intelligence in Education (AIED 2001), San Antonio, TX, pp. 154–165 (2001)
Newman, D.R., Johnson, C., Webb, B., Cochrane, C.: Evaluating the quality of learning in Computer Supported Co-operative Learning. Journal of the American Society for Information Science 48(6), 484–495 (1997)
Nurmela, K., Lehtinen, E., Palonen, T.: Evaluating CSCL log files by social network analysis. In: Hoadley, C. (ed.) Proceedings of Computer Supported Collaborative Learning 1999, pp. 434–444. Erlbaum, Mahwah (1999)
O’Neill, J., Martin, D.: Text chat in action. In: Proceedings of the 2003 International ACM SIGGROUP Conference on Supporting Group Work, Sanibel Island, Florida, USA, November 9-12 (2003)
Reffay, C., Chanier, T.: How social networl analysis can help to measure cohesion in collaborative distancelearning. In: Proceedings of Computer Support for Collaborative Learning: Designing for change in Networked Environments, CSCL 2003, pp. 343–352. Kluwer Academic Publishers, Amsterdam (2003)
Reiser, B.J.: Why scaffolding should sometimes make tasks more difficult for learners. In: Proceedings of the Computer Support for Collaborative Learning (CSCL 2002), Boulder, Colorado, USA, pp. 255–264 (2002)
Robertson, J., Good, J., Pain, H.: BetterBlether: The Design and Evaluation of a Discussion Tool for Education. International Journal of Artificial Intelligence in Education 9, 219–236 (1998)
Rodden, T.: Populating the Application: A Model of Awareness for Cooperative Applications. In: Ackermann, M.S. (ed.) Proc. of Conference on Computer Supported Cooperative Work (CSCW 1996), pp. 87–96. ACM Press, Boston (1996)
Rosé, C., Wang, Y.C., Cui, Y., Arguello, J., Stegmann, K., Weinberger, A., Fischer, F.: Analyzing collaborative learning processes automatically: Exploiting the advances of computational linguistics in computer-supported collaborative learning. International Journal of Computer Supported Collaborative Learning 3(3), 237–271 (2008)
Rummel, N., Weinberger, A.: New Challenges in CSCL: Towards adaptive script support. In: Proceedings of the Eighth International Conference of the Learning Sciences (ICLS 2008), Utrecht. International Society of the Learning Sciences, June 2008, vol. 3, pp. 338–345 (2008)
Salomon, G., Globerson, T.: When teams do not function the way they ought to. International Journal of Educational Research 13, 89–98 (1989)
Salomon, G.: Distributed Cognitions: Psychological and educational considerations. Cambridge University Press, Cambridge (1995)
Schümmer, T., Strijbos, J.-W., Berkel, T.: A new direction for log file analysis in CSCL: Experiences with a spatio-temporal metric. In: Koschmann, T., Suthers, D., Chan, T.W. (eds.) Computer Supported Collaborative Learning 2005: The Next 10 Years, pp. 567–576. Erlbaum, Mahwah (2005)
Scott, J.: Social Network Analysis: A Handbook, 2nd edn. Sage, London (2000)
Scott, W.: Reliability of content analysis: The case of nominal scale coding. Public Opinion Quarterly 17, 321–325 (1955)
Searle, J.: Expression and Meaning: Studies in the Theory of Speech Acts. Cambridge University Press, Cambridge (1979)
Selman, R.L.: The growth of interpersonal understanding. Academic Press, New York (1980)
Shrout, P.E., Fleiss, J.L.: Intraclass Correlations: Uses in Assessing Rater Reliability. Psychological Bulletin 2, 420–428 (1979)
Shute, V.J., Psotka, J.: Intelligent Tutoring Systems: Past, Present, and Future. In: Jonassen, D. (ed.) Handbook of Research on Educational Communications and Technology. Scholastic Publications (1995)
Simoff, S.: Monitoring and Evaluation in Collaborative Learning Environments. In: Proceedings of the Computer Support for Collaborative Learning (CSCL) 1999 Conference, Stanford University, Palo Alto (1999), http://www.ciltkn.org/cscl99/A83/A83.html
Soller, A., Wiebe, J., Lesgold, A.: A machine learning approach to assessing knowledge sharing during collaborative learning activities. In: Proceedings of Computer- Support for Collaborative Learning 2002, Boulder, CO, pp. 128–137 (2002)
Soller, A., Lesgold, A.: A computational approach to analyzing online knowledge sharing interaction. In: Proceedings of Artificial Intelligence in Education 2003, Sydney, Australia, pp. 253–260 (2003)
Soller, A., MartÃnez, A., Jermann, P., Muehlenbrock, M.: From mirroring to guiding: A review of the state of the art technology for supporting collaborative learning. Int. J. on Artificial Intelligence in Education 15, 261–290 (2005)
Stahl, G.: Rediscovering CSCL. In: Koschmann, T., Hall, R., Miyake, N. (eds.) CSCL 2: Carrying forward the conversation, pp. 169–181. Lawrence Erlbaum Associates, Hillsdale (2002)
Stahl, G., Koschmann, T., Suthers, D.: Computer-supported collaborative learning: An historical perspective. In: Sawyer, R.K. (ed.) Cambridge Handbook of the Learning Sciences, pp. 409–426. Cambridge University Press, Cambridge (2006)
Suthers, D., Hundhausen, C.: An empirical study of the effects of representational guidance on collaborative learning. Journal of the Learning Sciences 12(2), 183–219 (2003)
Veerman, A., Veldhuis-Diermanse, E.: Collaborative learning through computer-mediated communication in academic education. In: Dillenbourg, P., Eurelings, A., Hakkarainen, K. (eds.) European Perspectives on Computer-Supported Collaborative Learning. Proceedings of the first European Conference on CSCL. McLuhan Institute, University of Maastricht, Maastricht, Netherlands (2001)
Vygotsky, L.: Mind in society. Harvard University Press, Cambridge (1930/1978)
Warschauer, M.: Comparing face-to-face and electronic communication in the second language classroom. CALICO Journal 13(2), 7–26 (1996)
Wasserman, S., Faust, K.: Social network analysis: Methods and applications. Cambridge University Press, Cambridge (1994)
Wasserman, L.: All of Nonparametric Statistics. Springer, Berlin (2006)
Weber, R.P.: Basic content analysis. University of Iowa, Iowa City (1990)
Weinberger, A., Reiserer, M., Ertl, B., Fischer, F., Mandl, H.: Facilitating collaborative knowledge construction in computer-mediated learning environments with cooperation scripts. In: Bromme, R., Hesse, F., Spada, H. (eds.) Barriers and Biases in Computer-Mediated Knowledge Communication–and How They May Be Overcome. Kluwer Academic Publisher, Dordrecht (2005)
Weinberger, A., Fischer, F.: A framework to analyze argumentative knowledge construction in computer-supported collaborative learning. Computers & Education 46(1), 71–95 (2006)
Weiner, B.: An attributional theory of achievement motivation and emotion. Psychological Review 92, 548–573 (1985)
Wirtz, M., Caspar, F.: Beurteilerübereinstimmung und Beurteilerreliabilität. [Inter-rater agreement and inter-rater reliability]. Verlag für Psychologie, Göttingen (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Kahrimanis, G., Avouris, N., Komis, V. (2011). Interaction Analysis as a Tool for Supporting Collaboration: An Overview. In: Daradoumis, T., Caballé, S., Juan, A.A., Xhafa, F. (eds) Technology-Enhanced Systems and Tools for Collaborative Learning Scaffolding. Studies in Computational Intelligence, vol 350. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19814-4_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-19814-4_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19813-7
Online ISBN: 978-3-642-19814-4
eBook Packages: EngineeringEngineering (R0)