Skip to main content
SpringerLink
Log in

Rainbow: A framework for analysing computer-mediated pedagogical debates

  • Published:
International Journal of Computer-Supported Collaborative Learning Aims and scope Submit manuscript

Abstract

In this paper we present a framework for analysing when and how students engage in a specific form of interactive knowledge elaboration in CSCL environments: broadening and deepening understanding of a space of debate. The framework is termed “Rainbow,” as it comprises seven principal analytical categories, to each of which a colour is assigned, thus enabling informal visualisation by the analyst of the extent to which students are engaging in interaction relating to potential achievement of its pedagogical goal. The categories distinguish between activities that are part of the prescribed assignment and activities that are not, and between task-focused and non-task-focused activities. Activities focused on managing the interaction itself are distinguished from argumentative interaction. Notably, an operational definition of what it means to broaden and deepen understanding in this case is also provided here. The functional Rainbow analysis is complemented by an analysis of topics and subtopics that enables identification of one form of conceptual deepening of the question. In comparison with existing analysis techniques, Rainbow synthesises much of what is known into a single framework, with a broad theoretical base. The usability and educational relevance of the framework has been validated experimentally across a variety of collaborative learning tasks and communication media. Possible and actual extensions to the framework are discussed, with respect to additional CSCL tools, domains and tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Allwood, J., Nivre, J., & Ahlsén, E. (1991). On the semantics and pragmatics of linguistic feedback. Gothenburg Papers in Theoretical Linguistics no. 64. University of Gothenburg, Department of Linguistics, Sweden.

  • Andriessen, J., Baker, M. J., & Suthers, D. (2003a). Argumentation, computer support, and the educational context of confronting cognitions. In J. Andriessen, M. Baker, & D. Suthers (Eds.), Arguing to learn: Confronting cognitions in computer-supported collaborative learning environments (pp. 1–25). Dordrecht: Kluwer.

    Google Scholar 

  • Andriessen, J., Erkens, G., van de Laak, C., Peters, N., & Coirier, P. (2003b). Argumentation as negotiation in electronic collaborative writing. In J. Andriessen, M. Baker, & D. Suthers (Eds.), Arguing to learn: Confronting cognitions in computer-supported collaborative learning environments (pp. 79–115). Dordrecht: Kluwer.

    Google Scholar 

  • Baker, M. J. (1999). Argumentation and constructive interaction. In P. Coirier & J. Andriessen (Eds.), Studies in writing: Vol. 5. Foundations of argumentative text processing (pp. 179–202). Amsterdam: University of Amsterdam.

    Google Scholar 

  • Baker, M. J. (2002). Argumentative interactions, discursive operations and learning to model in science. In P. Brna, M. Baker, K. Stenning, & A. Tiberghien (Eds.), The role of communication in learning to model (pp. 303–324). Mahwah, NJ: Lawrence Erlbaum.

    Google Scholar 

  • Baker, M. J. (2003). Computer-mediated argumentative interactions for the co-elaboration of scientific notions. In J. Andriessen, M. Baker, & D. Suthers (Eds.), Arguing to learn: Confronting cognitions in computer-supported collaborative learning environments (pp. 47–78). Dordrecht: Kluwer.

    Google Scholar 

  • Baker, M. J., & Lund, K. (1997). Promoting reflective interactions in a computer-supported collaborative learning environment. Journal of Computer Assisted Learning, 13, 175–193.

    Article  Google Scholar 

  • Baker, M. J., Quignard, M., Lund, K., & Séjourné, A. (2003). Computer-supported collaborative learning in the space of debate. In B. Wasson, S. Ludvigsen, & U. Hoppe (Eds.), Designing for change in networked learning environments : Proceedings of the International Conference on Computer Support for Collaborative Learning 2003 (pp. 11–20). Dordrecht: Kluwer.

    Google Scholar 

  • Barth, E. M., & Krabbe, E. C. W. (1982). From axiom to dialogue: A philosophical study of logics and argumentation. Berlin: Walter de Gruyter.

    Google Scholar 

  • Bunt, H. C. (1989). Information dialogues as communicative action in relation to partner modelling and information processing. In M. M. Taylor, F. Néel, & D. G. Bouwhuis (Eds.), The structure of multimodal dialogue (pp. 47–74). The Netherlands: Elsevier.

    Google Scholar 

  • Bunt, H. C. (1995). Dialogue control functions and interaction design. In R. J. Beun, M. J. Baker, & M. Reiner (Eds.), Dialogue and instruction, modeling interaction in intelligent tutoring systems. Proceedings of the NATO Advanced Research Workshop on Natural Dialogue and Interactive Student Modeling (pp. 197–214). Berlin, Germany: Springer.

    Google Scholar 

  • Clark, H. H., & Brennan, S. (1991). Grounding in communication. In L. B. Resnick, J. M. Levine, & S. D. Teasley (Eds.), Perspectives on socially shared cognition (pp. 127–149). Washington DC: American Psychological Association.

    Chapter  Google Scholar 

  • Clark, D. B., & Sampson, V. (2006). Characteristics of students’ argumentation practices when supported by personally-seeded discussions. Paper presented at the annual meeting of the National Association for Research in Science Teaching, San Francisco, CA.

  • Clark, D., Sampson, V., Weinberger, A., & Erkens, G. (2007). Analytic frameworks for assessing dialogic argumentation in online learning environments. Educational Psychology Review (in press).

  • Clark, H. H., & Schaefer, E. F. (1989). Contributing to discourse. Cognitive Science, 13, 259–294.

    Article  Google Scholar 

  • Cohen, J. (1992). An essay on belief and acceptance. Oxford: Oxford University Press.

    Google Scholar 

  • Coirier, P., & Andriessen, J. (Eds.) (1999). Foundations of argumentative text processing. Amsterdam: University of Amsterdam Press.

  • Corbel, A., Girardot, J. J., & Jaillon, P. (2002). DREW: A dialogical reasoning web tool, ICTE2002. Int. Conf. on ICT’s in Education. Badajoz, Espagne, 13–16 November 2002.

  • Corbel, A., Jaillon, P., Serpaggi, X., Baker, M., Quignard, M., Lund, K., et al. (2003). DREW: Un outil Internet pour créer des situations d’apprentissage coopérant [DREW: An internet tool for creating cooperative learning situations]. In C. Desmoulins, C. Marquet, & D. Bouhineau (Eds.), EIAH2003 Environnements Informatiques pour l’Apprentissage Humain, Actes de la conférence EIAH 2003. Strasbourg, 15–17 April 2003 (pp. 109–113). Paris: INRP.

    Google Scholar 

  • De Vries, E., Lund, K., & Baker, M. J. (2002). Computer-mediated epistemic dialogue: Explanation and argumentation as vehicles for understanding scientific notions. The Journal of the Learning Sciences, 11(1), 63–103.

    Article  Google Scholar 

  • Dillenbourg, P., Baker, M. J., Blaye, A., & O’Malley, C. (1996). The evolution of research on collaborative learning. In H. Spada & P. Reimann (Eds.), Learning in humans and machines (pp. 189–205). London: Pergamon.

    Google Scholar 

  • Edmondson, W. (1981). Spoken discourse: A model for analysis. London: Longman.

    Google Scholar 

  • Erduran, S., Simon, S., & Osborne, J. (2004). TAPping into argumentation: Developments in the application of Toulmin’s argument pattern for studying science discourse. Science Education, 88, 915–933.

    Article  Google Scholar 

  • Grosz, B. J. (1981). Focusing and description in natural language dialogues. In A. Joshi, B. Webber, & I. Sag (Eds.), Elements of discourse understanding (pp. 84–105). Cambridge: Cambridge University Press.

    Google Scholar 

  • Grosz, B. J., & Sidner, C. (1986). Attention, intentions and the structure of discourse. Computational Linguistics, 12(3), 175–204.

    Google Scholar 

  • Jimenez-Aleixandre, M., Rodriguez, M., & Duschl, R. A. (2000). ‘Doing the lesson’ or ‘doing science’: Argument in high school genetics. Science Education, 84(6), 757–792.

    Article  Google Scholar 

  • Koschmann, T. (2001). Revisiting the paradigms of instructional technology. Proceedings of the 18th Annual Conference of the Australian Society for Computers in Learning in Tertiary Education (pp. 15–22). Melbourne, Australia, Downloaded from the Internet on 7 December 2005: http://www.ascilite.org.au/conferences/melbourne01/pubs/index.html.

  • Kuhn, D., & Udell, W. (2003). The development of argument skills. Child Development, 74(5), 1245–1260.

    Article  Google Scholar 

  • Leitão, S. (2000). The potential of argument in knowledge building. Human Development, 43, 332–360.

    Article  Google Scholar 

  • Litosseliti, L., Marttunen, M., Laurinen, L., & Salminen, T. (2005). Computer-based and face-to-face collaborative argumentation in secondary schools in England and Finland. Education, Communication and Information, 5(2), 131–146.

    Google Scholar 

  • Meier, A., Spada, H., & Rummel, N. (2007). A rating scheme for assessing the quality of computer-supported collaboration processes. International Journal of Computer-Supported Collaborative Learning, 2, 63–86.

    Article  Google Scholar 

  • Moeschler, J. (1985). Argumentation et Conversation : Eléments pour une analyse pragmatique du discours [Argumentation and conversation: Elements for a pragmatic analysis of discourse]. Paris: Crédif-Hatier.

    Google Scholar 

  • Naess, A. (1966). Communication and argument: Elements of applied semantics. London: Allen & Unwin.

    Google Scholar 

  • Perelman, C., & Olbrechts-Tyteca, L. (1958). Traité de l’argumentation. La nouvelle rhétorique. [Treatise on argumentation: The new rhetoric]. Paris: Presses Universitaires de France.

    Google Scholar 

  • Perret-Clermont, A.-N., Perret, J.-F., & Bell, N. (1991). The social construction of meaning and cognitive activity in elementary school children. In L. B. Resnick, J. M. Levine, & S. D. Teasley (Eds.), Perspectives on socially shared cognition (pp. 41–62). Washington DC: American Psychological Association.

    Chapter  Google Scholar 

  • Pilkington, R. M. (1999). analysing educational discourse: The DISCOUNT scheme. Technical Report no. 99/2. CBLU, University of Leeds, Leeds, UK. Retrieved November 14, 2004, from http://www.education.bham.ac.uk/aboutus/profiles/curped/pilkington/docs/DISCoun99.htm.

  • Quignard, M. (2000). Modélisation cognitive de l’argumentation dialoguée. Etudes de dialogues d’eleves en resolution de probleme de sciences physiques. [Cognitive modelling of argumentation dialogue. Studies of students in physics problem-solving]. Unpublished PhD thesis in Cognitive Science. Grenoble: Université Joseph Fourier.

  • Quignard, M. (2005). A collaborative model of argumentation in dyadic problem-solving interactions. In F. H. van Eemeren & P. Houtlosser (Eds.), Argumentation in practice (pp. 69–86). Amsterdam: John Benjamins.

    Google Scholar 

  • Roulet, E. (1991). On the structure of conversation as negotiation. In J. R. Searle, et al. (Eds.), (On) Searle on conversation (pp. 91–99). Amsterdam: John Benjamins.

    Google Scholar 

  • Roulet, E., Auchlin, A., Schelling, M., Moeschler, J., & Rubattel, C. (1991). L’articulation du discours en français contemporain [The articulation of discourse in contemporary French]. Berne: Peter Lang.

    Google Scholar 

  • Sinclair, J., & Coulthard, R. M. (1975). Towards and analysis of discourse: The English used by teachers and pupils. London: Oxford University Press.

    Google Scholar 

  • Spada, H., Meier, A., Rummel, N., & Hauser, S. (2005). A new method to assess the quality of collaborative process in CSCL. In T. Koschmann, T.-W. Chan, & D. Suthers (Eds.), Computer Supported Collaborative Learning 2005: The next 10 years! (Proceedings of CSCL 2005, Taiwan) (pp. 622–631). Hillsdale, NJ: Lawrence Erlbaum.

  • Stahl, G. (2004). Building collaborative knowing: Elements of a social theory of CSCL. In J. W. Strijbos, P. A. Kirschner, & R. L. Martens (Eds.), What we know about CSCL (pp. 53–85). Dordrecht: Kluwer.

    Chapter  Google Scholar 

  • Star, S. L. (1989). The structure of ill-solutions: Boundary objects and heterogeneous distributed problem solving. In L. Gasser & M. N. Huhns (Eds.), Distributed artificial intelligence (vol. II, pp. 37–54). London: Pitman.

    Google Scholar 

  • Suthers, D. (2006). A qualitative analysis of collaborative knowledge construction through shared representations. Research and Practice in Technology Enhanced Learning, 1(2), 1–28. [Final draft at http://lilt.ics.hawaii.edu/lilt/papers/2006/Suthers-2006-RPTEL.pdf].

    Google Scholar 

  • Suthers, D., Dwyer, N., Vatrapu, R., & Medina, R. (2007). An abstract transcript notation for analysing interactional construction of meaning in online learning. In Proceedings of the 40th Hawai`i International Conference on the System Sciences (HICSS-40), January 3-6, 2007, Waikoloa, Hawai`i (CD-ROM): Institute of Electrical and Electronics Engineers, Inc. (IEEE). [Final draft at http://lilt.ics.hawaii.edu/lilt/papers/2007/Suthers-et-al-HICSS-2007.pdf].

  • Suthers, D., Toth, E., & Weiner, A. (1997). An integrated approach to implementing collaborative inquiry in the classroom. Proceedings of Computer Supported Collaborative Learning (CSCL’97) (pp. 272–279). Toronto, accessed on December 10–14, 1997 at http://lilt.ics.hawaii.edu/lilt/papers/1997/CSCL97.html.

  • Toulmin, S. E. (1958). The uses of argument. Cambridge: Cambridge University Press.

    Google Scholar 

  • Trognon, A. (1990). Relations intersubjectives dans les débats [Intersubjective relations in debates]. In A. Berrendonner & H. Parret (Eds.), L’interaction communicative [Communicative interaction] (pp. 195–213). Berne: Peter Lang.

    Google Scholar 

  • Trognon, A. (1993). How does the process of interaction work when two interlocutors try to resolve a logical problem? Cognition and Instruction, 11(3–4), 325–345.

    Article  Google Scholar 

  • Trognon, A., & Batt, M. (2003). Comment représenter le passage de l’intersubjectif à l’intrasubjectif ? Essai de Logique Interlocutoire. [How to represent the transition from the intersubjective to the subjective: An essay in interlocutionary logic]. L’Orientation Scolaire et Professionnelle, 32(3), 399–436.

    Google Scholar 

  • Van Amelsvoort, M., Andriessen, J., & Kanselaar, G. (2007). Representational tools in computer-supported collaborative argumentation-based learning: How dyads work with constructed and inspected argumentative diagrams. The Journal of the Learning Sciences (in press).

  • van Bruggen, J., & Kirschner, P. (2003). Designing external representations to support solving wicked problems. In J. Andriessen, M. J. Baker, & D. Suthers (Eds.), Arguing to learn: Confronting cognitions in computer-supported collaborative learning environments (pp. 177–203). Dordrecht: Kluwer.

    Google Scholar 

  • Van der Puil, C., Andriessen, J., & Kanselaar, G. (2004). Exploring relational regulation in computer mediated (collaborative) learning interaction: A developmental perspective. Cyberpsychology & Behavior, 7(2), 183–195.

    Article  Google Scholar 

  • Van Eemeren, F. H., & Grootendorst, R. (1984). Speech acts in argumentative discussions. Dordrecht, Holland: Foris.

    Google Scholar 

  • Van Eemeren, F. H., Grootendorst, R., & Henkemans, F. S. (1996). Fundamentals of argumentation theory: A handbook of historical backgrounds and contemporary developments. Mahwah, NJ: Lawrence Erlbaum.

    Google Scholar 

  • Veerman, A. (2003). Constructive discussions through electronic dialogue. In J. Andriessen, M. J. Baker, & D. Suthers (Eds.), Arguing to learn: Confronting cognitions in computer-supported collaborative learning environments (pp. 117–143). Dordrecht: Kluwer.

    Google Scholar 

  • Vion, R. (1992). La Communication Verbale: Analyse des Interactions. [Verbal communication: Interaction analysis]. Paris: Hachette.

    Google Scholar 

  • Voss, J. (Ed.) (2001). Argumentation in psychology [Special issue]. Discourse Processes, 32(2 & 3).

  • Walton, D. N. (1989). Informal logic: A handbook for critical argumentation. Cambridge: Cambridge University Press.

    Google Scholar 

  • Weinberger, A., & Fischer, F. (2006). A framework to analyse argumentative knowledge construction in computer-supported collaborative learning. Computers and Education, 46, 71–95.

    Article  Google Scholar 

  • Woods, D., & Fassnacht, C. (2007). Transana v2.2x. http://www.transana.org. Madison, WI: The Board of Regents of the University of Wisconsin.

Download references

Author information

Authors and Affiliations

  1. CNRS and University of Paris, MODYCO Laboratory, Bât. A-403c, 200 avenue de la République, 92001, Nanterre Cedex, Paris, France

    Michael Baker

  2. Utrecht University, Utrecht, The Netherlands

    Jerry Andriessen

  3. ICAR laboratory, CNRS, University of Lyon, Lyon, France

    Kristine Lund

  4. Tilburg University, Tilburg, The Netherlands

    Marie van Amelsvoort

  5. LORIA, CNRS, University of Nancy, Nancy, France

    Matthieu Quignard

Authors
  1. Michael Baker
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jerry Andriessen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kristine Lund
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marie van Amelsvoort
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Matthieu Quignard
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Michael Baker.

Additional information

The research reported here was carried out within the SCALE project (Internet-based intelligent tool to Support Collaborative Argumentation-based Learning in secondary schools, project n° IST-1999–10664, March 2001 – February 2004), funded by the European Community under the ‘Information Societies’ Technology’ (IST) Programme. Information on the project can be found at: http://www.euroscale.net/, or http://scale.emse.fr

Rights and permissions

Reprints and permissions

About this article

Cite this article

Baker, M., Andriessen, J., Lund, K. et al. Rainbow: A framework for analysing computer-mediated pedagogical debates. Computer Supported Learning 2, 315–357 (2007). https://doi.org/10.1007/s11412-007-9022-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11412-007-9022-4

Keywords

Search

Navigation