skip to main content
10.1145/2505515.2507827acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
poster

Exploiting collaborative filtering techniques for automatic assessment of student free-text responses

Published: 27 October 2013 Publication History

Abstract

The automatic assessment of free-text responses of students is a relatively newer task in both computational linguistics and educational technology. The goal of the task is to produce an assessment of student answers to explanation and definition questions typically asked in problems seen in practice exercises or tests. Unlike some conventional methods which assess the student responses based on only information about their corresponding questions, this paper exploits idea of collaborative filtering to analyze student responses and used an effective collaborative filtering model -- feature-based matrix factorization model to deal with this challenge. The experimental results show that our feature-based matrix factorization model outperforms the baseline models and the model with a re-ranking phase can achieve a better and competitive performance -- 63.6% overall accuracy on the Beetle dataset.

References

[1]
Myroslava O Dzikovska, Rodney D Nielsen, and Chris Brew. Towards effective tutorial feedback for explanation questions: A dataset and baselines. In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 200--210. Association for Computational Linguistics, 2012.
[2]
Art Graesser, Phanni Penumatsa, Matthew Ventura, Zhiqiang Cai, and Xiangen Hu. Using lsa in autotutor: Learning through mixed-initiative dialogue in natural language. 2007.
[3]
Pamela W Jordan, Maxim Makatchev, and Kurt VanLehn. Combining competing language understanding approaches in an intelligent tutoring system. In Intelligent Tutoring Systems, pages 346--357. Springer, 2004.
[4]
R Nielsen, Wayne Ward, James H Martin, and Martha Palmer. Annotating students' understanding of science concepts. In Proc. LREC, 2008.
[5]
Rodney D Nielsen, Wayne Ward, and James H Martin. Learning to assess low-level conceptual understanding. In Proceedings 21st International FLAIRS Conference, Coconut Grove, Florida, May, 2008.
[6]
Myroslava O Dzikovska, Diana Bental, Johanna D Moore, Natalie B Steinhauser, Gwendolyn E Campbell, Elaine Farrow, and Charles B Callaway. Intelligent tutoring with natural language support in the beetle ii system. In Sustaining TEL: From Innovation to Learning and Practice, pages 620--625. Springer, 2010.
[7]
Yehuda Koren, Robert Bell, and Chris Volinsky. Matrix factorization techniques for recommender systems. Computer, 42(8):30--37, 2009.
[8]
Tianqi Chen, Zhao Zheng, Qiuxia Lu, Weinan Zhang, and Yong Yu. Feature-based matrix factorization. arXiv preprint arXiv:1109.2271, 2011.
[9]
Mark Hall, Eibe Frank, Geoffrey Holmes, Bernhard Pfahringer, Peter Reutemann, and Ian H Witten. The weka data mining software: an update. ACM SIGKDD Explorations Newsletter, 11(1):10--18, 2009.

Cited By

View all
  • (2023)The Analysis of Antioxidant Capacities and Sensory in Sea Grapes (Caulerpa racemosa) Powdered Drink as a Therapeutic ObesityAmerta Nutrition10.20473/amnt.v7i2.2023.175-1847:2(175-184)Online publication date: 9-Jun-2023
  • (2022)Estudio del paisaje del sistema lagunar México-Xochimilco-Campestre. Un sitio Ramsar dentro de una ciudad desértica del Noroeste de MéxicoREVISTA DE CIENCIAS TECNOLÓGICAS10.37636/recit.v5157795:1(57-79)Online publication date: 24-Jan-2022
  • (2022)Propuesta para el diseño de estrategias de control de las variables que afectan la calidad del servicio en grandes superficies ubicadas en Cartagena-ColombiaTeknos revista científica10.25044/25392190.1047(20-29)Online publication date: 30-Dec-2022
  • Show More Cited By

Index Terms

  1. Exploiting collaborative filtering techniques for automatic assessment of student free-text responses

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CIKM '13: Proceedings of the 22nd ACM international conference on Information & Knowledge Management
    October 2013
    2612 pages
    ISBN:9781450322638
    DOI:10.1145/2505515
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 October 2013

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. assessment of student response
    2. collaborative filtering
    3. feature-based matrix factorization

    Qualifiers

    • Poster

    Conference

    CIKM'13
    Sponsor:
    CIKM'13: 22nd ACM International Conference on Information and Knowledge Management
    October 27 - November 1, 2013
    California, San Francisco, USA

    Acceptance Rates

    CIKM '13 Paper Acceptance Rate 143 of 848 submissions, 17%;
    Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

    Upcoming Conference

    CIKM '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)7
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 25 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)The Analysis of Antioxidant Capacities and Sensory in Sea Grapes (Caulerpa racemosa) Powdered Drink as a Therapeutic ObesityAmerta Nutrition10.20473/amnt.v7i2.2023.175-1847:2(175-184)Online publication date: 9-Jun-2023
    • (2022)Estudio del paisaje del sistema lagunar México-Xochimilco-Campestre. Un sitio Ramsar dentro de una ciudad desértica del Noroeste de MéxicoREVISTA DE CIENCIAS TECNOLÓGICAS10.37636/recit.v5157795:1(57-79)Online publication date: 24-Jan-2022
    • (2022)Propuesta para el diseño de estrategias de control de las variables que afectan la calidad del servicio en grandes superficies ubicadas en Cartagena-ColombiaTeknos revista científica10.25044/25392190.1047(20-29)Online publication date: 30-Dec-2022
    • (2022)Pengaruh Substitusi Tepung Mocaf (Modified Cassava Flour) dan Rumput Laut (Eucheuma cottonii) pada Beras Analog Terhadap Uji Organoleptik dan Kandungan SeratJurnal Aplikasi Teknologi Pangan10.17728/jatp.1230111:1(40-45)Online publication date: 21-Mar-2022
    • (2021)Perkembangan Kemandirian dan Keterampilan Sosial Anak Usia 5-6 Tahun dalam Pengasuhan Dual Career FamilyJurnal Obsesi : Jurnal Pendidikan Anak Usia Dini10.31004/obsesi.v6i1.13196:1(389-400)Online publication date: 31-May-2021
    • (2021)Analysis And Evaluation Of Pharmacist Power Needs With The WISN Method In The Pharmaceutical Installation Of Haji Hospital SurabayaJBMP (Jurnal Bisnis, Manajemen dan Perbankan)10.21070/jbmp.v7i2.14767:2(89-106)Online publication date: 20-Sep-2021
    • (2021)Quantifying crop pollinator dependence and its heterogeneity using multi‐level meta‐analysisJournal of Applied Ecology10.1111/1365-2664.1383058:5(1030-1042)Online publication date: 15-Jan-2021
    • (2020)Volver para reconstruir el territorio y dignificar la vida: la experiencia del Consejo Comunitario de la Cuenca del Río CacaricaRevista Colombiana de Antropología10.22380/2539472X.80856:2(197-220)Online publication date: 1-Jul-2020
    • (2020)Hydroponic Effectiveness of Kana Flower, Apu Wood and Coffee Grounds in Domestic Greywater Wastewater TreatmentJurnal Presipitasi : Media Komunikasi dan Pengembangan Teknik Lingkungan10.14710/presipitasi.v17i3.272-28317:3(272-283)Online publication date: 30-Nov-2020
    • (2020)Proposal of maintenance methodology for pervious concrete (PC) after the phenomenon of cloggingConstruction and Building Materials10.1016/j.conbuildmat.2020.118672248(118672)Online publication date: Jul-2020
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media