Vineet Pandey
Krishnendu Chatterjee
ABSTRACT
To facilitate collaboration in massive online classrooms, instructors must make many decisions. For instance, the following parameters need to be decided when designing a peer-feedback system where students review each others' essays: the number of students each student must provide feedback to, an algorithm to map feedback providers to receivers, constraints that ensure students do not become free-riders (receiving feedback but not providing it), the best times to receive feedback to improve learning etc. While instructors can answer these questions by running experiments or invoking past experience, game-theoretic models with data from online learning platforms can identify better initial designs for further improvements. As an example, we explore the design space of a peer feedback system by modeling it using game theory. Our simulations show that incentivizing students to provide feedback requires the value obtained from receiving a feedback to exceed the cost of providing it by a large factor (greater than 7). Furthermore, hiding feedback from low-effort students incentivizes them to provide more feedback.
- D. Coetzee, Seongtaek Lim, Armando Fox, Bjorn Hartmann, and Marti A. Hearst. 2015. Structuring Interactions for Large-Scale Synchronous Peer Learning. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). 1139-1152. http://dx.doi.org/10.1145/2675133.2675251 Google Scholar
Digital Library
- Chinmay E. Kulkarni, Michael S. Bernstein, and Scott R. Klemmer. 2015. PeerStudio: Rapid Peer Feedback Emphasizes Revision and Improves Performance. In Proceedings of the Second (2015) ACM Conference on Learning @ Scale (L@S '15). 75-84. http://doi.acm.org/10.1145/2724660.2724670 Google ScholarDigital Library
- Bram Cohen. 2003. Incentives Build Robustness in BitTorrent. Retrieved Oct 29, 2015 from http://www.bittorrent.org/bittorrentecon.pdfGoogle Scholar
- Daniele Nosenzo and Simone Quercia, and Martin Sefton. 2015. Cooperation in small groups: the effect of group size. Experimental Economics. http://dx.doi.org/10.1007/s10683-013-9382-8Google Scholar
- William Wu, Constantinos Daskalakis, Nicolaas Kaashoek, Christos Tzamos, and Matthew Weinberg. 2015. Game Theory based Peer Grading Mechanisms for MOOCs. In Proceedings of the Second (2015) ACM Conference on Learning @ Scale (L@S '15). 281-286. http://doi.acm.org/10.1145/2724660.2728676 Google ScholarDigital Library
- González-Brenes, José P., Huang, Yun. 2015. Using Data from Real and Simulated Learners to Evaluate Adaptive Tutoring Systems. Proceedings of the Workshops at the 18th International Conference on Artificial Intelligence in Education AIED 2015.Google Scholar
Recommendations
Investigating Incentives for Students to Provide Peer Feedback in a Semi-Open Online Course: An Experimental Study
OpenSym '14: Proceedings of The International Symposium on Open CollaborationIn open online learning courses such as MOOCs, peer feedback has been regarded as a powerful method to give elaborated feedback on weekly assignments. Yet motivating students to invest effort in peer feedback on top of existing work load is difficult. ...
Peer feedback to support collaborative knowledge improvement: What kind of feedback feed-forward?
AbstractOnline peer feedback plays a critical role in collaborative learning. This process improves learning and helps both giver and receiver develop and refine their metacognitive knowledge. A deeper examination of the feedback types, ...
Highlights- Online peer feedback can support pre-service teachers in improving the quality of TEL design measured by the TPACK framework.
Online Learning: Improving the Learning Outcomes
SIGMIS-CPR '17: Proceedings of the 2017 ACM SIGMIS Conference on Computers and People ResearchThe use of Technology to facilitate better learning and training is gaining momentum worldwide, reducing the temporal and spatial problems associated with traditional learning. Despite its several benefits, retaining students in online platforms is ...
Comments