Skip to main content
Log in

Scaffolding student online discussions using past discussions: PedaBot studies

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

We are developing instructional tools that will help students and instructors use discussion boards more effectively, with an emphasis on automatically assessing discussion activities and promoting student discussion participation and learning. In this paper, we present a discussion scaffolding tool that exploits natural language processing and information retrieval techniques. The PedaBot tool is designed to aid student knowledge acquisition, promote reflection about course topics and encourage student participation in discussions. It dynamically processes student discussions and presents related discussions and document from a knowledge base of past discussions and course materials. This paper describes the system and presents a comparative analysis of the information retrieval techniques used to respond to free-form student discussions, including a combination of topic profiling, term frequency-inverse document frequency, and latent semantic analysis. Responses are presented as annotated links that students can follow and rate for usefulness. The tool has been integrated into a live discussion board and has been used by an undergraduate computer science course for three semesters. We report current studies of PedaBot from its usages based on student viewings, student ratings, and a small survey. Initial results indicate that there is a high level of student interest in the feature and that its responses are moderately relevant to student discussions. We are exploring more opportunities to exposing the tool to students.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Boyer K, Phillips R, Wallis M, Vouk M, Lester J (2008) Learner characteristics and feedback in tutorial dialogue. In: ACL workshop on innovative use of NLP for building educational applications

  • Feng D, Shaw E, Kim J, Hovy E (2006a) An intelligent discussion bot for answering student queries. In: Proceedings of IUI-06

  • Feng D, Kim J, Shaw E, Hovy E (2006b) Towards modeling threaded discussions through ontology-based analysis. In: Proceedings of national conference on artificial intelligence

  • Foltz PW, Laham D, Landauer TK (1999) Automated essay scoring: applications to educational technology. In: Proceedings of world conference on educational multimedia, hypermedia & telecommunications

  • Graddy DB (2006) Gender salience and the user of linguistic qualifiers and intensifiers in olnine course discussions. Am J Distance Educ 20(4): 195–210 Lawrence Erlbaum Associates, Inc

    Article  Google Scholar 

  • Graesser AC, Olney A, Ventura M, Jackson GT (2005) AutoTutor’s coverage of expectations during tutorial dialogue. Proc FLAIRS Conf 2005: 518–523

    Google Scholar 

  • Hearst MA (1994) Multi-paragraph segmentation of expository text. In: Proceedings of the 32th annual meeting of the association for computational linguistics, pp 9–16, Las Cruces, New Mexico

  • Jeong A (2006) Gender interaction patterns and gender participation in computer-supported collaborative argumentation. Am J Distance Educ 20(4): 195–210 Lawrence Erlbaum Associates, Inc

    Article  Google Scholar 

  • Kakkonen T, Myller N, Sutinen E (2006) Applying part-of speech enhanced LSA to automatic essay grading. In: Proceedings of the 4th IEEE international conference on information technology: research and education

  • Kim J, Beal C (2006) Turning quantity into quality: supporting automatic assessment of on-line discussion contributions. In: Annual meetings of the American educational research association

  • Kim J, Shaw E, Ravi S, Tavano E, Arromratana A, Sarda P (2008) Scaffolding of on-line discussions with past discussions: an analysis and pilot study of PedaBot. In: Proceedings of intelligent tutoring systems conference

  • Knowlton DS (2001) Promoting durable knowledge construction through online discussion. In: Proceedings of 6th annual mid-south instructional technology conference

  • Lai M, Law N (2006) Peer scaffolding of knowledge building through collaborative groups with differential learning experiences. J Educ Comput Res 35: 123–144

    Article  Google Scholar 

  • Landauer TK, Dumais ST (1997) A solution to Plato’s problem: the Latent Semantic Analysis theory of acquisition, induction, and representation of knowledge. Psychol Rev 104(2): 211–240

    Article  Google Scholar 

  • McLaren B, Scheuer O, De Laat M, Hever R, De Groot R, Rose C (2007) Using machine learning techniques to analyze and support mediation of student E-discussions. In: Proceedings of AI in education conference, 2007

  • Painter C, Coffin C, Hewings A (2003) Impacts of directed tutorial activities in computer conferencing: a case Study. Distance Educ 4(2): 159–174

    Article  Google Scholar 

  • Palloff RM, Pratt K (1999) Building learning communities in cyberspace: effective strategies for the online classroom. San Francisco, CA: Jossey-Bass.

  • Pasca M, Harabagiu S (2001) High performance question/answering. In: Proceedings of SIGIR-2001, pp 366–374

  • Ravi S, Kim J (2007) Profiling student interactions in threaded discussions with speech act classifiers. In: Proceedings of AI in education

  • Salton G (1989) Automatic text processing, the transformation, analysis, and retrieval of information by computer

  • Shum BS (2000) Workshop report: computer supported collaborative argumentation for learning communities. In: SIGWEB newsletter, pp 27–30

  • Soller A, Lesgold A (2003) Computational approach to analyzing online knowledge sharing interaction. In: Proceedings of AI in education

  • Soricut R, Marcu D (2003) Sentence level discourse parsing using syntactic and lexical information. In: Proceedings of HLT/NAACL-2003

  • Sporleder C, Lapata M (2005) Discourse chunking and its application to sentence compression. In: Proceedings of human language technology conference—EMNLP

  • Stevens R, Soller A, Cooper M, Sprang M (2004) Modeling the development of problem solving skills in chemistry with a web-based tutor. In: Proceedings of the intelligent tutoring systems conference

  • Voorhees EM (1999) TREC-8 question answering track report. In: Proceedings of the 8th text retrieval conference

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jihie Kim.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kim, J., Shaw, E. Scaffolding student online discussions using past discussions: PedaBot studies. Artif Intell Rev 41, 97–112 (2014). https://doi.org/10.1007/s10462-011-9300-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-011-9300-4

Keywords

Navigation