poster

Exploring the measurement of collaborative problem solving using a human-agent educational game

Authors:

Kristin Stoeffler,

Yigal Rosen,

Alina von DavierAuthors Info & Claims

LAK '17: Proceedings of the Seventh International Learning Analytics & Knowledge Conference

Pages 570 - 571

https://doi.org/10.1145/3027385.3029464

Published: 13 March 2017 Publication History

Get Access

Abstract

Collaborative problem solving (CPS) is a process that relies on both cognitive and social skills contributions by those involved in the joint activity. If a student is matched with a problematic group of peers, then there will be no valid measurement of the CPS skills. In the human-agent settings, CPS skills are measured by pairing each individual student with a computer agent or agents that can be programmed to act as team members with varying characteristics relevant to different CPS skills and contexts. This paper describes current research on measuring CPS skills through human-agent interactions in a prototype of a collaborative educational game.

References

[1]

Arya, Sunil, et al. An Optimal Algorithm for Approximate Nearest Neighbor Searching Fixed Dimensions. Journal of the ACM (JACM) 45.6 (1998): 891--923.

Digital Library

Google Scholar

[2]

Bauckhage, Christian, Anders Drachen, and Rafet Sifa. "Clustering Game Behavior Data." IEEE Transactions on Computational Intelligence and AI in Games 7.3 (2015): 266--278.

Crossref

Google Scholar

[3]

Camara W, O'Connor R, Mattern K, Hanson MA. Beyond Academics: A Holistic Framework for Enhancing Education and Workplace Success. ACT Research Report Series. 2015 (4). ACT, Inc.

Google Scholar

[4]

Kerr, Deirdre, and Gregory KWK Chung. "Identifying Key Features of Student Performance in Educational Video Games and Simulations Through Cluster Analysis." JEDM-Journal of Educational Data Mining 4.1 (2012): 144--182.

Google Scholar

[5]

McLachlan, G.J. and Basford, K.E., 1988. Mixture models: Inference and applications to clustering (Vol. 84). Marcel Dekker.

Google Scholar

[6]

Mitchell R, Nicholas S. Knowledge creation in groups: The value of cognitive diversity, transactive memory and open mindedness norms. Electronic Journal of Knowledge Management. 2006;4(1):67--74.

Google Scholar

[7]

OECD (2013). PISA 2015 Collaborative problem solving framework. OECD Publishing.

Google Scholar

[8]

Rosen Y. Computer-based assessment of collaborative problem solving: Exploring the feasibility of human-to-agent approach. International Journal of Artificial Intelligence in Education. 2015 Sep 1;25(3):380--406

Google Scholar

[9]

Scardamalia M. Collective cognitive responsibility for the advancement of knowledge. Liberal education in a knowledge society. 2002 Jun 28;97:67--98.

Google Scholar

[10]

Stahl G. (2006) Group Cognition: Computer Support for Building Collaborative Knowledge (Acting with Technology).

Digital Library

Google Scholar

[11]

Weinberger A, Fischer F. A framework to analyze argumentative knowledge construction in computer-supported collaborative learning. Computers & education. 2006 Jan 31;46(1):71--95.

Digital Library

Google Scholar

[12]

Von Davier, A. A., & Halpin, P. F. (2013). Collaborative problem solving and the assessment of cognitive skills: Psychometric considerations. ETS Research Report Series, 2013(2), 1--36

Crossref

Google Scholar

Cited By

View all

Rosen YStoeffler KSimmering VHao Jvon Davier A(2021)Development of Scalable Assessment for Collaborative Problem-SolvingInternational Handbook of Computer-Supported Collaborative Learning10.1007/978-3-030-65291-3_28(517-532)Online publication date: 9-Oct-2021
https://doi.org/10.1007/978-3-030-65291-3_28
Hazzan ORagonis NLapidot THazzan ORagonis NLapidot T(2020)Problem-Solving StrategiesGuide to Teaching Computer Science10.1007/978-3-030-39360-1_8(143-168)Online publication date: 6-Aug-2020
https://doi.org/10.1007/978-3-030-39360-1_8
von Davier ADeonovic BYudelson MPolyak SWoo A(2019)Computational Psychometrics Approach to Holistic Learning and Assessment SystemsFrontiers in Education10.3389/feduc.2019.000694Online publication date: 17-Jul-2019
https://doi.org/10.3389/feduc.2019.00069
Show More Cited By

Index Terms

Exploring the measurement of collaborative problem solving using a human-agent educational game
1. Applied computing
  1. Education
2. Human-centered computing

Recommendations

Analysis of learning effectiveness and behavioral patterns of cognitive scaffolding and collaborative problem-solving processes in a historical educational game
Abstract
The trend in history education is gradually emphasizing the development of historical thinking and collaborative problem-solving skills, which are expected to enhance the breadth and depth of learners' thinking. The integration of game-based ...
Fostering collaborative problem solving skills in science: The Animalia project
Abstract
Collaboration might not always be the best approach for problem solving in classroom learning setting. The purpose of this study is to determine what collaborative learning behaviors contribute to learning outcomes in collaborative ...
Highlights
- Log files of collaborative learning used to determine patterns related learning outcomes.
Gamified performance assessment of collaborative problem solving skills
Abstract
In this paper we introduce a game-based approach for Collaborative Problem Solving (CPS) Skills assessment and provide preliminary evidence from a validation pilot study. To date, educational assessments have focused more heavily on ...
Highlights
- Initial validation for the five skills underlying the design of the game.
- ...

Comments

Information & Contributors

Information

Published In

LAK '17: Proceedings of the Seventh International Learning Analytics & Knowledge Conference

March 2017

631 pages

ISBN:9781450348706

DOI:10.1145/3027385

General Chairs:
Alyssa Wise
New York University, USA
,
Phillip H. Winne
Simon Fraser University, Canada
,
Grace Lynch
Society for Learning Analytics Research
,
Program Chairs:
Xavier Ochoa
Escuela Superior Politecnica del Litoral, Ecuador
,
Inge Molenaar
Radboud University, The Netherlands
,
Shane Dawson
University of South Australia, Australia
,
Publications Chair:
Marek Hatala
Simon Fraser University, Canada

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 March 2017

Check for updates

Author Tags

Qualifiers

Poster

Conference

LAK '17

LAK '17: 7th International Learning Analytics and Knowledge Conference

March 13 - 17, 2017

British Columbia, Vancouver, Canada

Acceptance Rates

LAK '17 Paper Acceptance Rate 36 of 114 submissions, 32%;

Overall Acceptance Rate 236 of 782 submissions, 30%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
260
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)2

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rosen YStoeffler KSimmering VHao Jvon Davier A(2021)Development of Scalable Assessment for Collaborative Problem-SolvingInternational Handbook of Computer-Supported Collaborative Learning10.1007/978-3-030-65291-3_28(517-532)Online publication date: 9-Oct-2021
https://doi.org/10.1007/978-3-030-65291-3_28
Hazzan ORagonis NLapidot THazzan ORagonis NLapidot T(2020)Problem-Solving StrategiesGuide to Teaching Computer Science10.1007/978-3-030-39360-1_8(143-168)Online publication date: 6-Aug-2020
https://doi.org/10.1007/978-3-030-39360-1_8
von Davier ADeonovic BYudelson MPolyak SWoo A(2019)Computational Psychometrics Approach to Holistic Learning and Assessment SystemsFrontiers in Education10.3389/feduc.2019.000694Online publication date: 17-Jul-2019
https://doi.org/10.3389/feduc.2019.00069
Chopade PStoeffler KM Khan SRosen YSwartz Svon Davier A(2018)Human-Agent Assessment: Interaction and Sub-skills Scoring for Collaborative Problem SolvingArtificial Intelligence in Education10.1007/978-3-319-93846-2_10(52-57)Online publication date: 20-Jun-2018
https://doi.org/10.1007/978-3-319-93846-2_10

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Analysis of learning effectiveness and behavioral patterns of cognitive scaffolding and collaborative problem-solving processes in a historical educational game

Fostering collaborative problem solving skills in science: The Animalia project

Gamified performance assessment of collaborative problem solving skills

Comments

Information

Published In

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations