Skip to main content

Part of the book series: Studies in Computational Intelligence ((SCI,volume 350))

Abstract

This chapter constitutes an overview of logfile-based interaction analysis techniques that can be used for the support of Computer Supported Collaborative Learning (CSCL) activities. Interaction analysis is central in the study of CSCL activities, since in such activities through interactions between partners the state of evolving group knowledge is communicated. This interaction is facilitated by tools that allow logging of events that take place, capturing thus information about the content and the process of collaboration. Automated analysis techniques of this information can be developed. The objective of this analysis is often to support participants, in several ways: explicitly, by providing feedback to them in order to regulate their practices, or by making adaptive changes to some aspects of the collaborative setting; or implicitly, by making available to them representations of their activities. This chapter presents the most common approaches used in interaction analysis, while it particularly emphasizes recent innovative efforts to reap the advantages of machine learning techniques in order to overcome common shortcomings of previous approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Avouris, N., Dimitracopoulou, A., Komis, V.: On analysis of collaborative problem solving: An object oriented approach. Computers in Human Behavior 19(2), 147–167 (2003)

    Article  Google Scholar 

  • Avouris, N., Margaritis, M., Komis, V.: Modelling interaction during small-group synchronous problem-solving activities: The Synergo approach. In: 2nd Int. Workshop on Designing Computational Models of Collaborative Learning Interaction, ITS 2004, Maceio, Brasil (September 2004)

    Google Scholar 

  • Baker, M.J., Lund, K.: Promoting reflective interactions in a CSCL environment. Journal of Computer Assisted Learning 13, 175–193 (1997)

    Article  Google Scholar 

  • Baker, M.J., Quignard, M., Lund, K., Séjourné, A.: Computer-supported collaborative learning in the space of debate. In: Wasson, B., Ludvigsen, S., Hoppe, U. (eds.) Designing for Change in Networked Learning Environments, pp. 11–20. Kluwer Academic Publishers, Dordrecht (2003)

    Google Scholar 

  • Barros, M., Verdejo, M.: Analysing student interaction processes in order to improve collaboration. The DEGREE approach. International Journal of Artificial Intelligence in Education 11, 221–241 (2000)

    Google Scholar 

  • Brown, A.: Metacognition, Executive Control, Self regulation, and other more mysterious mechanisms. In: Weinert, F.E., Kluwe, R.H. (eds.) Metacognition, motivation and understanding. Laurence Erlbaum Associates, Hillsdale (1987)

    Google Scholar 

  • Buisine, S.: Quantitative assessment of collaboration. International Reports on Socio-Informatics 7, 32–39 (2010)

    Google Scholar 

  • Cohen, J.: A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20, 37–46 (1960)

    Article  Google Scholar 

  • Collins, A., Brown, J.S., Holum, A.: Cognitive apprenticeship: making thinking visible. American Educator 15(3), 6–11,38–39 (1991)

    Google Scholar 

  • Constantino-Gonzalez, M., Suthers, D.: A Coached Collaborative Learning Environment for Entity-Relationship Modeling. In: Gauthier, G., VanLehn, K., Frasson, C. (eds.) ITS 2000. LNCS, vol. 1839, pp. 324–333. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  • Cronbach, L.J.: Coefficient alpha and the internal structure of tests. Psychometrika 16(3), 297–334 (1951)

    Article  Google Scholar 

  • De Laat, M.: Network and content analysis in an online community discourse. In: Stahl, G. (ed.) Proceedings of CSCL 2002 Computer Support for Collaborative Learning: Foundations for a CSCL Community., pp. 625–626. Lawrence Erlbaum Associates, Hillsdale (2002)

    Chapter  Google Scholar 

  • Dillenbourg, P., Baker, M., Blaye, A., O’Malley, C.: The evolution of research on collaborative learning. In: Reimann, P., Spada, H. (eds.) Learning in Humans and Machines, pp. 189–211. Springer, Berlin (1995)

    Google Scholar 

  • Dimitracopoulou, A., Petrou, A.: Advanced Collaborative Learning Systems for young students: Design issues and current trends on new cognitive and metacognitive tools. THEMES in Education International Journal (2003)

    Google Scholar 

  • Dourish, P., Bellotti, V.: Awareness and Coordination in Shared Workspaces. In: Turner, J., Kraut, R.E. (eds.) CSCW 1992: Proceedings of the Conference on Computer-Supported Cooperative Work, Toronto, Canada, pp. 107–114. ACM Press, New York (1992)

    Chapter  Google Scholar 

  • Erkens, G., Janssen, J.: Automatic coding of communication in collaboration protocols. International Journal of Computer Supported Collaborative Learning 3(4), 447–470 (2008)

    Article  Google Scholar 

  • Garcia, A., Jacobs, J.: The eyes of the beholder: Understanding the turn talking system in quasi-synchronous computer mediated communication. Research on Language and Social Interaction 32(4), 337–367 (1999)

    Article  Google Scholar 

  • Garrison, D.R.: Critical thinking and adult education: A conceptual model for developing critical thinking in adult learners. International Journal of Lifelong Education 10(4), 287–303 (1991)

    Article  Google Scholar 

  • Garrison, D.R., Anderson, T., Archer, W.: Critical thinking in a text-based environment: computer conferencing in higher education. Internet and Higher Education 11, 1–14 (2000)

    Google Scholar 

  • George, D., Mallery, P.: SPSS for Windows Step by Step: A Simple Guide and Reference. 11.0 Update. Allyn & Bacon, Boston (2003)

    Google Scholar 

  • Guilford, J.P.: Psychometric methods. McGraw-Hill, New York (1954)

    Google Scholar 

  • Gunawardena, C.N., Lowe, C.A., Anderson, T.: Analysis of global online debate and the development of an interaction analysis model for examining social construction of knowledge in computer conferencing. Journal of Educational Computer Research 17(4), 397–431 (1997)

    Article  Google Scholar 

  • Gutwin, C., Greenberg, S.: A Descriptive Framework of Workspace Awareness for Real-Time Groupware. Computer-Supported Cooperative Work 3-4, 411–446 (2002)

    Article  Google Scholar 

  • Henri, F.: Computer conferencing and content analysis. In: Kaye, A. (ed.) Collaborative Learning Through Computer Conferencing: The Najaden Papers, pp. 117–136. Springer, New York (1992)

    Google Scholar 

  • Herring, S.C.: Interactional coherence in CMC. Journal of Computer-Mediated Communication 4(4) (1999)

    Google Scholar 

  • Hewitt, J.: How habitual online practices affect the development of asynchronous discussion threads. Journal of Educational Computing Research 28, 31–45 (2003)

    Article  Google Scholar 

  • Hiltz, S.R., Turoff, M., Johnson, K.: Experiments in group decision making, 3: Disinhibition, deindividuation, and group process in pen name and real name computer conferences. Journal of Decision Support Systems 5, 217–232 (1989)

    Article  Google Scholar 

  • Holsti, O.R.: Content Analysis for the Social Sciences and Humanities. Addison-Wesley, Reading (1969)

    Google Scholar 

  • Howell-Richardson, C., Mellar, H.: A methodology for the analysis of patterns of participation within computer mediated communication courses. Instructional Science 24, 47–69 (1996)

    Article  Google Scholar 

  • Inaba, A., Okamoto, T.: Negotiation Process Model for Intelligent Discussion Coordinating System on CSCL Environment. In: Proceedings of the 8th World Conference on Artificial Intelligence in Education, Kobe, Japan, pp. 175–182 (1997)

    Google Scholar 

  • Järvelä, S., Häkkinen, P.: The levels of web-based discussions: Using perspective-taking theory as an analytical tool. In: van Oostendorp, H. (ed.) Cognition in a Digital World, pp. 77–95. Lawrence Erlbaum Associates, Mahwah (2003)

    Google Scholar 

  • Jermann, P., Soller, A., Muehlenbrock, M.: From mirroring to guiding: A review of state of the art technology for supporting collaborative learning. In: Dillenbourg, P., Eurelings, A., Hakkarainen, K. (eds.) Proceedings of Euro CSCL 2001: European Perspectives on Computer-supported Collaborative Learning, Maastricht, The Netherlands, University of Maastricht, pp. 324–331 (2001)

    Google Scholar 

  • Jermann, P., Dillenbourg, P.: Group mirrors to support interaction regulation in collaborative problem solving. Computers and Education 51(1), 279–296 (2008)

    Article  Google Scholar 

  • Jordan, B., Henderson, A.: Interaction Analysis: Foundations and Practice. Journal of the Learning Sciences 4(1), 39–103,1532–7809 (1995)

    Article  Google Scholar 

  • Kahrimanis, G., Meier, A., Chounta, I.A., Voyiatzaki, E., Spada, H., Rummel, N., Avouris, N.: Assessing collaboration quality in synchronous CSCL problem-solving activities: Adaptation and empirical evaluation of a rating scheme. In: Cress, U., Dimitrova, V., Specht, M. (eds.) EC-TEL 2009. LNCS, vol. 5794, pp. 267–272. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  • Kahrimanis, G., Chouda, I.A., Avouris, N.: Study of correlations between logfile-based metrics of interaction and the quality of synchronous collaboration. International Reports on Socio-Informatics (IRSI) 7(1), 24–31 (2010)

    Google Scholar 

  • Katz, S., Aronis, J., Creitz, C.: Modelling pedagogical interactions with machine learning. In: Proceedings of the Ninth International Conference on Artificial Intelligence in Education, LeMans, France, pp. 543–550 (1999)

    Google Scholar 

  • Kerlinger, F.N., Lee, H.B.: Foundations of behavioral research. Harcourt College Publishers, New York (2000)

    Google Scholar 

  • Kollar, I., Fischer, F., Hesse, F.W.: Collaboration scripts–a conceptual analysis. Educational Psychology Review 18, 159–182 (2006)

    Article  Google Scholar 

  • Koschmann, T.: Paradigm shifts and instructional technology: An introduction. In: Koschmann, T. (ed.) CSCL: Theory and practice of an emerging paradigm, pp. 1–23. Lawrence Erlbaum Associates, Mahwah (1996)

    Google Scholar 

  • Krippendorf, K.: Content analysis: An introduction to its methodology. Sage Publications, Beverly Hills (1980)

    Google Scholar 

  • Langer, I., Schulz von Thun, F.: Messung komplexer Merkmale in Psychologie und Pädagogik - Ratingverfahren. Reinhardt, München (1974)

    Google Scholar 

  • Law, N., Yuen, J., Huang, R., Li, Y., Pan, N.: A learnable content & participation analysis toolkit for assessing CSCL learning outcomes and processes. In: Chinn, C.A., Erkens, G., Puntambekar, S. (eds.) Mice, minds, and society: The Computer Supported Collaborative Learning (CSCL) Conference 2007, vol. 8, pp. 408–417. International Society of the Learning Sciences, New Brunswick (2007)

    Google Scholar 

  • Lipponen, L.: Exploring foundations for computer-supported collaborative learning. In: Stahl, G. (ed.) Computer-supported collaborative learning: Foundations for a CSCL community. Proceedings of the Computer-Supported Collaborative Learning 2002 Conference, pp. 72–81. Erlbaum, Mahwah (2002)

    Chapter  Google Scholar 

  • Marshall, P., Hornecker, E., Morris, R., Dalton, N.S., Rogers, Y.: When the fingers do the talking: A study of group participation with varying constraints to a tabletop interface. In: Proceedings of IEEE International Workshop on Horizontal Interactive Human-Computer System, pp. 37–44 (2008)

    Google Scholar 

  • Martinez, A., Dimitriadis, Y., Gomez, E., Rubia, B., de la Fuente, P.: Combining qualitative and social network analysis for the study of classroom social interactions. Computers and Education, special issue on Documenting Collaborative Interactions: Issues and Approaches 41(4), 353–368 (2003)

    Google Scholar 

  • McManus, M., Aiken, R.: Monitoring computer-based problem solving. Journal of Artificial Intelligence in Education 6(4), 307–336 (1995)

    Google Scholar 

  • Meier, A.: Evaluating Collaboration: A Rating Scheme for Assessing the Quality of Net-Based, Interdisciplinary, Collaborative Problem Solving. Unpublished diploma thesis, Institut für Psychologie, Albert-Ludwigs-Universität Freiburg im Breisgau, Freiburg, Germany (2005)

    Google Scholar 

  • Meier, A., Spada, H., Rummel, N.: A rating scheme for assessing the quality of computer-supported collaboration processes. International Journal of Computer-Supported Collaborative Learning 2, 63–86 (2007)

    Article  Google Scholar 

  • Meier, A., Voyiatzaki, E., Kahrimanis, G., Rummel, N., Spada, H., Avouris, N.: Teaching students how to improve their collaboration: Assessing collaboration quality and providing adaptive feedback in a CSCL setting. In: Rummel, N., Weinberger, A. (eds.) New Challenges in CSCL: Towards adaptive script support. Proceedings of the Eighth International Conference of the Learning Sciences (ICLS 2008), Utrecht. International Society of the Learning Sciences, June 2008, vol. 3, pp. 338–345 (2008)

    Google Scholar 

  • Muehlebrock, M., Hoppe, H.U.: A collaboration monitor for shared workspaces. In: Proceedings of the International Conference on Artificial Intelligence in Education (AIED 2001), San Antonio, TX, pp. 154–165 (2001)

    Google Scholar 

  • Newman, D.R., Johnson, C., Webb, B., Cochrane, C.: Evaluating the quality of learning in Computer Supported Co-operative Learning. Journal of the American Society for Information Science 48(6), 484–495 (1997)

    Article  Google Scholar 

  • Nurmela, K., Lehtinen, E., Palonen, T.: Evaluating CSCL log files by social network analysis. In: Hoadley, C. (ed.) Proceedings of Computer Supported Collaborative Learning 1999, pp. 434–444. Erlbaum, Mahwah (1999)

    Google Scholar 

  • O’Neill, J., Martin, D.: Text chat in action. In: Proceedings of the 2003 International ACM SIGGROUP Conference on Supporting Group Work, Sanibel Island, Florida, USA, November 9-12 (2003)

    Google Scholar 

  • Reffay, C., Chanier, T.: How social networl analysis can help to measure cohesion in collaborative distancelearning. In: Proceedings of Computer Support for Collaborative Learning: Designing for change in Networked Environments, CSCL 2003, pp. 343–352. Kluwer Academic Publishers, Amsterdam (2003)

    Google Scholar 

  • Reiser, B.J.: Why scaffolding should sometimes make tasks more difficult for learners. In: Proceedings of the Computer Support for Collaborative Learning (CSCL 2002), Boulder, Colorado, USA, pp. 255–264 (2002)

    Google Scholar 

  • Robertson, J., Good, J., Pain, H.: BetterBlether: The Design and Evaluation of a Discussion Tool for Education. International Journal of Artificial Intelligence in Education 9, 219–236 (1998)

    Google Scholar 

  • Rodden, T.: Populating the Application: A Model of Awareness for Cooperative Applications. In: Ackermann, M.S. (ed.) Proc. of Conference on Computer Supported Cooperative Work (CSCW 1996), pp. 87–96. ACM Press, Boston (1996)

    Chapter  Google Scholar 

  • Rosé, C., Wang, Y.C., Cui, Y., Arguello, J., Stegmann, K., Weinberger, A., Fischer, F.: Analyzing collaborative learning processes automatically: Exploiting the advances of computational linguistics in computer-supported collaborative learning. International Journal of Computer Supported Collaborative Learning 3(3), 237–271 (2008)

    Article  Google Scholar 

  • Rummel, N., Weinberger, A.: New Challenges in CSCL: Towards adaptive script support. In: Proceedings of the Eighth International Conference of the Learning Sciences (ICLS 2008), Utrecht. International Society of the Learning Sciences, June 2008, vol. 3, pp. 338–345 (2008)

    Google Scholar 

  • Salomon, G., Globerson, T.: When teams do not function the way they ought to. International Journal of Educational Research 13, 89–98 (1989)

    Article  Google Scholar 

  • Salomon, G.: Distributed Cognitions: Psychological and educational considerations. Cambridge University Press, Cambridge (1995)

    Google Scholar 

  • Schümmer, T., Strijbos, J.-W., Berkel, T.: A new direction for log file analysis in CSCL: Experiences with a spatio-temporal metric. In: Koschmann, T., Suthers, D., Chan, T.W. (eds.) Computer Supported Collaborative Learning 2005: The Next 10 Years, pp. 567–576. Erlbaum, Mahwah (2005)

    Chapter  Google Scholar 

  • Scott, J.: Social Network Analysis: A Handbook, 2nd edn. Sage, London (2000)

    Google Scholar 

  • Scott, W.: Reliability of content analysis: The case of nominal scale coding. Public Opinion Quarterly 17, 321–325 (1955)

    Article  Google Scholar 

  • Searle, J.: Expression and Meaning: Studies in the Theory of Speech Acts. Cambridge University Press, Cambridge (1979)

    Book  Google Scholar 

  • Selman, R.L.: The growth of interpersonal understanding. Academic Press, New York (1980)

    Google Scholar 

  • Shrout, P.E., Fleiss, J.L.: Intraclass Correlations: Uses in Assessing Rater Reliability. Psychological Bulletin 2, 420–428 (1979)

    Article  Google Scholar 

  • Shute, V.J., Psotka, J.: Intelligent Tutoring Systems: Past, Present, and Future. In: Jonassen, D. (ed.) Handbook of Research on Educational Communications and Technology. Scholastic Publications (1995)

    Google Scholar 

  • Simoff, S.: Monitoring and Evaluation in Collaborative Learning Environments. In: Proceedings of the Computer Support for Collaborative Learning (CSCL) 1999 Conference, Stanford University, Palo Alto (1999), http://www.ciltkn.org/cscl99/A83/A83.html

    Google Scholar 

  • Soller, A., Wiebe, J., Lesgold, A.: A machine learning approach to assessing knowledge sharing during collaborative learning activities. In: Proceedings of Computer- Support for Collaborative Learning 2002, Boulder, CO, pp. 128–137 (2002)

    Google Scholar 

  • Soller, A., Lesgold, A.: A computational approach to analyzing online knowledge sharing interaction. In: Proceedings of Artificial Intelligence in Education 2003, Sydney, Australia, pp. 253–260 (2003)

    Google Scholar 

  • Soller, A., Martínez, A., Jermann, P., Muehlenbrock, M.: From mirroring to guiding: A review of the state of the art technology for supporting collaborative learning. Int. J. on Artificial Intelligence in Education 15, 261–290 (2005)

    Google Scholar 

  • Stahl, G.: Rediscovering CSCL. In: Koschmann, T., Hall, R., Miyake, N. (eds.) CSCL 2: Carrying forward the conversation, pp. 169–181. Lawrence Erlbaum Associates, Hillsdale (2002)

    Google Scholar 

  • Stahl, G., Koschmann, T., Suthers, D.: Computer-supported collaborative learning: An historical perspective. In: Sawyer, R.K. (ed.) Cambridge Handbook of the Learning Sciences, pp. 409–426. Cambridge University Press, Cambridge (2006)

    Google Scholar 

  • Suthers, D., Hundhausen, C.: An empirical study of the effects of representational guidance on collaborative learning. Journal of the Learning Sciences 12(2), 183–219 (2003)

    Article  Google Scholar 

  • Veerman, A., Veldhuis-Diermanse, E.: Collaborative learning through computer-mediated communication in academic education. In: Dillenbourg, P., Eurelings, A., Hakkarainen, K. (eds.) European Perspectives on Computer-Supported Collaborative Learning. Proceedings of the first European Conference on CSCL. McLuhan Institute, University of Maastricht, Maastricht, Netherlands (2001)

    Google Scholar 

  • Vygotsky, L.: Mind in society. Harvard University Press, Cambridge (1930/1978)

    Google Scholar 

  • Warschauer, M.: Comparing face-to-face and electronic communication in the second language classroom. CALICO Journal 13(2), 7–26 (1996)

    Google Scholar 

  • Wasserman, S., Faust, K.: Social network analysis: Methods and applications. Cambridge University Press, Cambridge (1994)

    Google Scholar 

  • Wasserman, L.: All of Nonparametric Statistics. Springer, Berlin (2006)

    MATH  Google Scholar 

  • Weber, R.P.: Basic content analysis. University of Iowa, Iowa City (1990)

    Google Scholar 

  • Weinberger, A., Reiserer, M., Ertl, B., Fischer, F., Mandl, H.: Facilitating collaborative knowledge construction in computer-mediated learning environments with cooperation scripts. In: Bromme, R., Hesse, F., Spada, H. (eds.) Barriers and Biases in Computer-Mediated Knowledge Communication–and How They May Be Overcome. Kluwer Academic Publisher, Dordrecht (2005)

    Google Scholar 

  • Weinberger, A., Fischer, F.: A framework to analyze argumentative knowledge construction in computer-supported collaborative learning. Computers & Education 46(1), 71–95 (2006)

    Article  Google Scholar 

  • Weiner, B.: An attributional theory of achievement motivation and emotion. Psychological Review 92, 548–573 (1985)

    Article  Google Scholar 

  • Wirtz, M., Caspar, F.: Beurteilerübereinstimmung und Beurteilerreliabilität. [Inter-rater agreement and inter-rater reliability]. Verlag für Psychologie, Göttingen (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Kahrimanis, G., Avouris, N., Komis, V. (2011). Interaction Analysis as a Tool for Supporting Collaboration: An Overview. In: Daradoumis, T., Caballé, S., Juan, A.A., Xhafa, F. (eds) Technology-Enhanced Systems and Tools for Collaborative Learning Scaffolding. Studies in Computational Intelligence, vol 350. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19814-4_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-19814-4_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-19813-7

  • Online ISBN: 978-3-642-19814-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics