Abstract
We are developing instructional tools that will help students and instructors use discussion boards more effectively, with an emphasis on automatically assessing discussion activities and promoting student discussion participation and learning. In this paper, we present a discussion scaffolding tool that exploits natural language processing and information retrieval techniques. The PedaBot tool is designed to aid student knowledge acquisition, promote reflection about course topics and encourage student participation in discussions. It dynamically processes student discussions and presents related discussions and document from a knowledge base of past discussions and course materials. This paper describes the system and presents a comparative analysis of the information retrieval techniques used to respond to free-form student discussions, including a combination of topic profiling, term frequency-inverse document frequency, and latent semantic analysis. Responses are presented as annotated links that students can follow and rate for usefulness. The tool has been integrated into a live discussion board and has been used by an undergraduate computer science course for three semesters. We report current studies of PedaBot from its usages based on student viewings, student ratings, and a small survey. Initial results indicate that there is a high level of student interest in the feature and that its responses are moderately relevant to student discussions. We are exploring more opportunities to exposing the tool to students.
Similar content being viewed by others
References
Boyer K, Phillips R, Wallis M, Vouk M, Lester J (2008) Learner characteristics and feedback in tutorial dialogue. In: ACL workshop on innovative use of NLP for building educational applications
Feng D, Shaw E, Kim J, Hovy E (2006a) An intelligent discussion bot for answering student queries. In: Proceedings of IUI-06
Feng D, Kim J, Shaw E, Hovy E (2006b) Towards modeling threaded discussions through ontology-based analysis. In: Proceedings of national conference on artificial intelligence
Foltz PW, Laham D, Landauer TK (1999) Automated essay scoring: applications to educational technology. In: Proceedings of world conference on educational multimedia, hypermedia & telecommunications
Graddy DB (2006) Gender salience and the user of linguistic qualifiers and intensifiers in olnine course discussions. Am J Distance Educ 20(4): 195–210 Lawrence Erlbaum Associates, Inc
Graesser AC, Olney A, Ventura M, Jackson GT (2005) AutoTutor’s coverage of expectations during tutorial dialogue. Proc FLAIRS Conf 2005: 518–523
Hearst MA (1994) Multi-paragraph segmentation of expository text. In: Proceedings of the 32th annual meeting of the association for computational linguistics, pp 9–16, Las Cruces, New Mexico
Jeong A (2006) Gender interaction patterns and gender participation in computer-supported collaborative argumentation. Am J Distance Educ 20(4): 195–210 Lawrence Erlbaum Associates, Inc
Kakkonen T, Myller N, Sutinen E (2006) Applying part-of speech enhanced LSA to automatic essay grading. In: Proceedings of the 4th IEEE international conference on information technology: research and education
Kim J, Beal C (2006) Turning quantity into quality: supporting automatic assessment of on-line discussion contributions. In: Annual meetings of the American educational research association
Kim J, Shaw E, Ravi S, Tavano E, Arromratana A, Sarda P (2008) Scaffolding of on-line discussions with past discussions: an analysis and pilot study of PedaBot. In: Proceedings of intelligent tutoring systems conference
Knowlton DS (2001) Promoting durable knowledge construction through online discussion. In: Proceedings of 6th annual mid-south instructional technology conference
Lai M, Law N (2006) Peer scaffolding of knowledge building through collaborative groups with differential learning experiences. J Educ Comput Res 35: 123–144
Landauer TK, Dumais ST (1997) A solution to Plato’s problem: the Latent Semantic Analysis theory of acquisition, induction, and representation of knowledge. Psychol Rev 104(2): 211–240
McLaren B, Scheuer O, De Laat M, Hever R, De Groot R, Rose C (2007) Using machine learning techniques to analyze and support mediation of student E-discussions. In: Proceedings of AI in education conference, 2007
Painter C, Coffin C, Hewings A (2003) Impacts of directed tutorial activities in computer conferencing: a case Study. Distance Educ 4(2): 159–174
Palloff RM, Pratt K (1999) Building learning communities in cyberspace: effective strategies for the online classroom. San Francisco, CA: Jossey-Bass.
Pasca M, Harabagiu S (2001) High performance question/answering. In: Proceedings of SIGIR-2001, pp 366–374
Ravi S, Kim J (2007) Profiling student interactions in threaded discussions with speech act classifiers. In: Proceedings of AI in education
Salton G (1989) Automatic text processing, the transformation, analysis, and retrieval of information by computer
Shum BS (2000) Workshop report: computer supported collaborative argumentation for learning communities. In: SIGWEB newsletter, pp 27–30
Soller A, Lesgold A (2003) Computational approach to analyzing online knowledge sharing interaction. In: Proceedings of AI in education
Soricut R, Marcu D (2003) Sentence level discourse parsing using syntactic and lexical information. In: Proceedings of HLT/NAACL-2003
Sporleder C, Lapata M (2005) Discourse chunking and its application to sentence compression. In: Proceedings of human language technology conference—EMNLP
Stevens R, Soller A, Cooper M, Sprang M (2004) Modeling the development of problem solving skills in chemistry with a web-based tutor. In: Proceedings of the intelligent tutoring systems conference
Voorhees EM (1999) TREC-8 question answering track report. In: Proceedings of the 8th text retrieval conference
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kim, J., Shaw, E. Scaffolding student online discussions using past discussions: PedaBot studies. Artif Intell Rev 41, 97–112 (2014). https://doi.org/10.1007/s10462-011-9300-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10462-011-9300-4