skip to main content
10.1145/1832838.1832849acmotherconferencesArticle/Chapter ViewAbstractPublication PageschinzConference Proceedingsconference-collections
research-article

StudySieve: a tool that supports constructive evaluation for free-response questions

Published: 08 July 2010 Publication History

Abstract

StudySieve is an online tool in which students create and share assessment questions with their peers. The submitted questions can be answered, and all answers are visible to the entire community. Both the questions and answers are evaluated by students in a double-blind peer review process. This pedagogy, known as constructive evaluation, has been previously studied in the context of multiple-choice questions. The StudySieve tool described here, supports the construction and evaluation of free-response questions.

References

[1]
Arthur, N. Using student-generated assessment items to enhance teamwork, feedback and the learning process. Synergy, 24:21--23, 2006. www.itl.usyd.edu.au/synergy.
[2]
Barak, M., and Rafaeli, S. On-line question-posing and peer-assessment as means for web-based knowledge sharing in learning. International Journal of Human-Computer Studies, 61:84--103, 2004.
[3]
Denny, P., Hanks, B., and Simon, B. Peerwise: replication study of a student-collaborative self-testing web service in a U.S. setting. In Proceedings of the 41st ACM Technical Symposium on Computer Science Education 421--425, Milwaukee, Wisconsin, USA, 2010. ACM, New York, NY
[4]
Denny, P., Luxton-Reilly, A., and Hamer, J. Student use of the PeerWise system. In ITICSE '08: Proceedings of the 13th annual SIGCSE conference on Innovation and technology in computer science education, 73--77, Madrid, Spain, 2008. ACM.
[5]
Denny, P., Luxton-Reilly, A., and Hamer, J., and Purchase, H. Coverage of course topics in a student generated mcq repository. In ITiCSE '09: Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education, 11--15, 2009. ACM.
[6]
King, A. Enhancing peer interaction and learning in the classroom through reciprocal questioning. American Educational Research Journal, 27:664--687, 1990.
[7]
Luxton-Reilly, A. A systematic review of tools that support peer assessment. Computer Science Education, 19:209--232, 2009.
[8]
Luxton-Reilly, A., and Denny, P. Constructive evaluation: a pedagogy of student-contributed assessment. Computer Science Education, 2010. In Press.
[9]
Rosenshine, B., Meister, C., and Chapman, S. Teaching students to generate questions: A review of the intervention studies. Review of Educational Research, 66(2):181--221, Summer 1996.
[10]
Topping, K. Peer assessment between students in colleges and universities. Review of Educational Research, 68(3):249--276, 1998.
[11]
Webb, N. Peer interaction and learning in small groups. International Journal of Educational Research, 13:21--39, 1989.
[12]
Wilson, E. V. Examnet asynchronous learning network: augmenting face-to-face courses with student-developed exam questions. Computers & Education, 42(1):87--107, 2004.
[13]
Yu, F.-Y., Liu, Y.-H., and Chan, T.-W. A web-based learning system for question posing and peer assessment. Innovations in Education and Teaching International, 42(4):337--348, 2005.

Cited By

View all
  • (2023)Experiences from Learnersourcing SQL Exercises: Do They Cover Course Topics and Do Students Use Them?Proceedings of the 25th Australasian Computing Education Conference10.1145/3576123.3576137(123-131)Online publication date: 30-Jan-2023
  • (2022)Can Students Review Their Peers?Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 110.1145/3502718.3524762(12-18)Online publication date: 7-Jul-2022
  • (2022)A systematic review of published student question-generation systems: Supporting functionalities and design featuresJournal of Research on Technology in Education10.1080/15391523.2022.211944856:2(172-195)Online publication date: 13-Sep-2022
  • Show More Cited By

Index Terms

  1. StudySieve: a tool that supports constructive evaluation for free-response questions

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    CHINZ '10: Proceedings of the 11th International Conference of the NZ Chapter of the ACM Special Interest Group on Human-Computer Interaction
    July 2010
    95 pages
    ISBN:9781450301046
    DOI:10.1145/1832838
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    • New Zealand ACM Special Interest Group on Computer-Human Interaction

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 July 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. collaborative learning
    2. constructive evaluation
    3. contributing student pedagogy
    4. peer assessment
    5. peer review

    Qualifiers

    • Research-article

    Conference

    CHINZ '10
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 8 of 23 submissions, 35%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)6
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Experiences from Learnersourcing SQL Exercises: Do They Cover Course Topics and Do Students Use Them?Proceedings of the 25th Australasian Computing Education Conference10.1145/3576123.3576137(123-131)Online publication date: 30-Jan-2023
    • (2022)Can Students Review Their Peers?Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 110.1145/3502718.3524762(12-18)Online publication date: 7-Jul-2022
    • (2022)A systematic review of published student question-generation systems: Supporting functionalities and design featuresJournal of Research on Technology in Education10.1080/15391523.2022.211944856:2(172-195)Online publication date: 13-Sep-2022
    • (2021)Employing Peer Review to Evaluate the Quality of Student Generated Content at Scale: A Trust Propagation ApproachProceedings of the Eighth ACM Conference on Learning @ Scale10.1145/3430895.3460129(139-150)Online publication date: 8-Jun-2021
    • (2020)Fostering and supporting empirical research on evaluative judgement via a crowdsourced adaptive learning systemProceedings of the Tenth International Conference on Learning Analytics & Knowledge10.1145/3375462.3375532(83-88)Online publication date: 23-Mar-2020
    • (2018)Student‐Generated AssessmentThe TESOL Encyclopedia of English Language Teaching10.1002/9781118784235.eelt0385(1-7)Online publication date: 18-Jan-2018
    • (2011)Motivating all our students?Proceedings of the 16th annual conference reports on Innovation and technology in computer science education - working group reports10.1145/2078856.2078858(1-18)Online publication date: 27-Jun-2011
    • (2011)PeerWiseProceedings of the seventh international workshop on Computing education research10.1145/2016911.2016924(53-60)Online publication date: 8-Aug-2011

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media