Skip to main content

Assessing Collaboration Quality in Synchronous CSCL Problem-Solving Activities: Adaptation and Empirical Evaluation of a Rating Scheme

  • Conference paper
Book cover Learning in the Synergy of Multiple Disciplines (EC-TEL 2009)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 5794))

Included in the following conference series:

Abstract

The work described is part of an ongoing interdisciplinary collaboration between two research teams of the University of Patras, Greece and the University of Freiburg, Germany, which aims at the exchange of analysis tools and data sets in order to broaden the scope of analysis methods and tools available for Computer-Supported Collaborative Learning (CSCL) support. This article describes the adaptation, generalization and application of a rating scheme which had been developed by the Freiburg team for assessing collaboration quality on several dimensions [1]. The scheme was successfully adapted to suit data gathered by the Patras team in a different CSCL scenario. Collaboration quality is assessed by quantitative ratings of seven qualitatively defined rating dimensions. An empirical evaluation based on a dataset of 101 collaborative sessions showed high inter-rater agreement for all dimensions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Meier, A., Spada, H., Rummel, N.: A rating scheme for assessing the quality of computer-supported collaboration processes. International Journal of Computer-Supported Collaborative Learning 2(1), 63–86 (2007)

    Article  Google Scholar 

  2. De Wever, B., Schellens, T., Valcke, M., Van Keer, H.: Content analysis schemes to analyze transcripts of online asynchronous discussion groups: a review. Computers & Education 46, 6–28 (2006)

    Article  Google Scholar 

  3. Dillenbourg, P., Baker, M., Blaye, A., O’Malley, C.: The evolution of research on collaborative learning. In: Reimann, P., Spada, H. (eds.) Learning in humans and machines: Towards an interdisciplinary learning science, pp. 189–211. Elsevier/Pergamon, Oxford (1995)

    Google Scholar 

  4. Weinberger, A., Fischer, F.: A framework to analyze argumentative knowledge construction in computer-supported collaborative learning. Computers & Education 46, 71–95 (2006)

    Article  Google Scholar 

  5. Suthers, D., Law, N., Rose, C., Dwyer, N.: A common framework for CSCL interaction analysis. Pre-conference workshop at the 2008 ICLS conference, Utrecht, The Netherlands (2008)

    Google Scholar 

  6. Rummel, N., Spada, H.: Learning to collaborate: An instructional approach to promoting problem-solving in computer-mediated settings. The Journal of the Learning Sciences 14(2), 201–241 (2005)

    Article  Google Scholar 

  7. Avouris, N., Margaritis, M., Komis, V.: Modelling interaction during small-group synchronous problem solving activities: the Synergo approach. In: Proceedings of 2nd International Workshop on Designing Computational Models of Collaborative Learning Interaction, ITS 2004, 7th Conference on Intelligent Tutoring Systems, Maceio, Brasil, pp. 13–18 (2004)

    Google Scholar 

  8. Clark, H.H., Brennan, S.E.: Grounding in communication. In: Resnick, L.B., Levine, J.M., Teasley, S.D. (eds.) Perspectives on socially shared cognition, pp. 127–148. American Psychological Association, Washington (1991)

    Chapter  Google Scholar 

  9. Meier, A., Voyatzaki, E., Kahrimanis, G., Rummel, N., Spada, H., Avouris, N.: Teaching students how to improve their collaboration: Assessing collaboration quality and providing adaptive feedback in a CSCL setting. Submitted as part of the symposium New Challenges in CSCL: Towards adaptive script support (Nikol Rummel and Armin Weinberger), ICLS 2008, Utrecht (June 2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kahrimanis, G. et al. (2009). Assessing Collaboration Quality in Synchronous CSCL Problem-Solving Activities: Adaptation and Empirical Evaluation of a Rating Scheme. In: Cress, U., Dimitrova, V., Specht, M. (eds) Learning in the Synergy of Multiple Disciplines. EC-TEL 2009. Lecture Notes in Computer Science, vol 5794. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04636-0_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04636-0_25

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04635-3

  • Online ISBN: 978-3-642-04636-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics