short-paper

Towards Scalable Gamified Assessment in Support of Collaborative Problem-Solving Competency Development in Online and Blended Learning

Authors:

Yigal Rosen,

Kristin Stoeffler,

Michael Yudelson,

Vanessa SimmeringAuthors Info & Claims

L@S '20: Proceedings of the Seventh ACM Conference on Learning @ Scale

Pages 369 - 372

https://doi.org/10.1145/3386527.3405946

Published: 12 August 2020 Publication History

Get Access

Abstract

Collaborative problem solving (CPS) is an important competency for life and career success. Promoting the development of CPS skills requires robust CPS assessment. This paper describes a gamified stealth CPS assessment used within a collaborative inquiry science curriculum. A pilot deployment included 196 middle school students from multiple schools in the United States. Results showed the sample was balanced in terms of measured skill performance and completion time. Future directions include the extension to teacher authoring and the deployment of this gamified assessment approach to additional contexts, such as workforce training and credentialing in large-scale online courses.

References

[1]

Judith Bennett, Sylvia Hogarth, Fred Lubben, Bob Campbell, and Alison Robinson. 2010. Talking science: The research evidence on the use of small group discussions in science teaching. International Journal of Science Education 32, 1: 69--95.

Crossref

Google Scholar

[2]

Wayne Camara, Ryan O'Connor, Krista Mattern, and Mary Ann Hanson. 2015. Beyond Academics: A Holistic Framework for Enhancing Education and Workplace Success. ACT Research Report Series. 2015 (4). ACT, Inc., Iowa City, IA.

Google Scholar

[3]

https://www.act.org/content/dam/act/unsecured/documents/ACT_RR2015--4.pdf

Google Scholar

[4]

Robyn M Gillies and Michael Boyle. 2010. Teachers' reflections on cooperative learning: Issues of implementation. Teaching and Teacher Education 26, 4: 933--940.

Crossref

Google Scholar

[5]

Friedrich Hesse, Esther Care, Juergen Buder, Kai Sassenberg, and Patrick Griffin. 2015. A framework for teachable collaborative problem solving skills. In Assessment and teaching of 21st century skills. Springer, 37--56.

Google Scholar

[6]

David W Johnson and Roger T Johnson. 2009. An educational psychology success story: Social interdependence theory and cooperative learning. Educational researcher 38, 5: 365--379.

Google Scholar

[7]

OECD. 2017. PISA 2015 assessment and analytical framework: Science, reading, mathematics, financial literacy, and collaborative problem solving. OECD Publishing, Paris.

Crossref

Google Scholar

[8]

OECD. 2017. PISA 2015 Results (Volume V): Collaborative Problem Solving. OECD Publishing, Paris.

Crossref

Google Scholar

[9]

Alandeom W Oliveira, Kristen C Wilcox, Janet Angelis, Arthur N Applebee, Vincent Amodeo, and Michele A Snyder. 2013. Best practice in middle-school science. Journal of Science Teacher Education 24, 2: 297--322.

Crossref

Google Scholar

[10]

Yigal Rosen. 2017. Assessing Students in Human-to-Agent Settings to Inform Collaborative Problem-Solving Learning: Human-to-Agent Collaborative Formative Assessment. Journal of Educational Measurement 54, 1: 36--53.

Crossref

Google Scholar

[11]

Yigal Rosen, Ilia Rushkin, Rob Rubin, et al. 2018. The effects of adaptive learning in a massive open online course on learners' skill development. Proceedings of the Fifth Annual ACM Conference on Learning at Scale, 1--8.

Digital Library

Google Scholar

[12]

Yigal Rosen, Iris Wolf, and Kristin Stoeffler. 2020. Fostering collaborative problem solving skills in science: The Animalia project. Computers in Human Behavior 104: 105922.

Digital Library

Google Scholar

[13]

Kristin Stoeffler, Yigal Rosen, Maria Bolsinova, and Alina A. von Davier. 2020. Gamified performance assessment of collaborative problem solving skills. Computers in Human Behavior 104: 106036.

Digital Library

Google Scholar

Cited By

View all

Costello R(2022)Gamification Design Principles and Mechanics to Improve RetentionHandbook of Research on Acquiring 21st Century Literacy Skills Through Game-Based Learning10.4018/978-1-7998-7271-9.ch040(788-809)Online publication date: 2022
https://doi.org/10.4018/978-1-7998-7271-9.ch040

Index Terms

Towards Scalable Gamified Assessment in Support of Collaborative Problem-Solving Competency Development in Online and Blended Learning
1. Applied computing
  1. Education
    1. Collaborative learning
    2. Interactive learning environments

Recommendations

Gamified performance assessment of collaborative problem solving skills
Abstract
In this paper we introduce a game-based approach for Collaborative Problem Solving (CPS) Skills assessment and provide preliminary evidence from a validation pilot study. To date, educational assessments have focused more heavily on ...
Highlights
- Initial validation for the five skills underlying the design of the game.
- ...
Interdisciplinary research agenda in support of assessment of collaborative problem solving

Evidence from labor-market economics and predictive validity studies in psychology suggests that collaborative problem solving (CPS) is an increasingly important skill for both academic and career success in the 21st century. While there is a general ...
EFL learners’ motivation in a gamified formative assessment: The case of Quizizz
Abstract
Over the past few years, the world’s attention has been focused on gaming systems and their application in education through gamification, incorporating game features into learning tools. Against this backdrop, this study aims to investigate the ...

Comments

Information & Contributors

Information

Published In

L@S '20: Proceedings of the Seventh ACM Conference on Learning @ Scale

August 2020

442 pages

ISBN:9781450379519

DOI:10.1145/3386527

General Chair:
David Joyner
Georgia Tech
,
Program Chairs:
Rene Kizilcec
Cornell University
,
Susan Singer
Rollins College

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 August 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

L@S '20

L@S '20: Seventh (2020) ACM Conference on Learning @ Scale

August 12 - 14, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 117 of 440 submissions, 27%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
150
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Costello R(2022)Gamification Design Principles and Mechanics to Improve RetentionHandbook of Research on Acquiring 21st Century Literacy Skills Through Game-Based Learning10.4018/978-1-7998-7271-9.ch040(788-809)Online publication date: 2022
https://doi.org/10.4018/978-1-7998-7271-9.ch040

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Gamified performance assessment of collaborative problem solving skills

Interdisciplinary research agenda in support of assessment of collaborative problem solving

EFL learners’ motivation in a gamified formative assessment: The case of Quizizz

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations