Effects of solo vs. collaborative play in a digital learning game on geometry: Results from a K12 experiment
Introduction
Around the world, educational technology is being introduced slowly into the classroom and holds the potential to have a transformative effect on the educational landscape Baumöl and Bockshecker (2017). One of the most prominent examples is the use of digital games for learning De Freitas (2006). Numerous authors Prensky (2003); Shaffer (2006); Gee (2003) have expressed that well designed digital games represent outstanding opportunities for learning through an enjoyable experience. Playing video games is essential part of young generation's daily life Buckingham and Willett (2013). A recent report on media consumption Ofcom (2019), builds profile snapshots by age, estimating that 40% of kids 3–4 years old play games for nearly 6 h a week, 66% of kids 5–7 for 9 h a week, 81% of kids 8–11 for around 10 h a week and 77% of kids 12–15 for 12 h a week. Many studies provide ample evidence that using video games with children and adolescents can support various skills and life outcomes such as academic domain-specific learning including science Li (2013); Council et al. (2011) and math Divjak and Tomić (2011); Starkey (2013), executive functions Homer et al. (2018), involvement in real life sports Adachi and Willoughby (2016) or for acquiring health knowledge Baranowski et al. (2016).
While many teachers report a positive attitude towards games being used in K12 classrooms and believe that they can improve learning and curriculum, the actual number of teachers who are implementing digital games in their curriculum is contrarily low De Grove et al. (2012); Pastore and Falvo (2010). One of the main implementation barriers reported by teachers is uncertainty and limited literature about how to actually effectively implement games in the classroom Watson and Yang (2016); An and Cao (2017), and thus there is a necessity to support evidence-based decision making regarding how different teachers' decisions impact students' experiences when implementing games in classrooms. One strong attraction for teachers to use games in classroom is because of the belief that it is a powerful tool to foster collaboration among students and develop 21st Century skills such as collaborative problem solving Kim and Shute (2015). In this experimental case study, we explore what the effect of having students play a game solo vs. with others is, with the ultimate goal of supporting teachers' implementation decisions for game-based curriculum. A few studies compared solo vs. social play in commercial gaming contexts Arellano et al. (2016, pp. 184–193); Kaye and Bryce (2014), but little work is done in educational games, especially using in-game analytics. Given that learning games are frequently introduced as classroom activities Squire (2005), the existence of barriers to effectively implementing game-based learning Watson and Yang (2016); An and Cao (2017) and the importance of collaboration to prepare younger generations for the future UNESCO Bangkok (2016), educators would have more confidence in using games in classrooms if they knew what to expect from having students play these games alone or collaboratively and the potential implications for their learning.
We organize the rest of the manuscript in the following sections. Next Section 2 reviews related literature and Section 3 presents the current case study. Section 4 details the methods of the study, including an overview of Shadowspect, the context, experimental design, data and metrics. Section 5 presents the results and in Section 6 we discuss those results. Finally, in Section 7 we finalize with conclusions and future follow-up ideas.
Section snippets
Collaboration in game-based learning
There are two related yet subtly different concepts for collaboration in the context of game-based learning. First, collaborative game, refers to a specific type of game that has explicit game mechanics that require two or more players to work on joint tasks or quests Berland and Lee (2011). Second, collaborative gameplay, is a broader category that describes non-competitive gameplay where two or more players socially engaging while playing together with a common objective in mind. Note that
Current study
To address the gap identified in the literature review, we conducted a 2 × 2 factorial experiment to investigate the influence of gameplay style (solo or collaborative gameplay) when using the geometry game Shadowspect, while also varying puzzle complexity with the second factor. The gameplay style condition entangles either having students play solo or collaboratively in pairs. The puzzle complexity condition involves one set of puzzle levels slightly more difficult than the other. All
Shadowspect overview
Shadowspect1 is a 3D digital educational game. Shadowspect lies within the category of puzzle games (like the Witness or Bridge Builder). Shadowspect has clearly-defined goals, rules, obstacles for the players to overcome and provides only intrinsic rewards (satisfaction for getting the right answer). Each puzzle presents a number of silhouette views for a 3D figure where each figure is built by using a series of 3D geometric primitives such
Results
The results section presents comparison between groups and conditions to respond the research questions. In order to find if a difference on a quantitative variable is statistically significant we report the difference between means of each group, Student's t-Test with its p-value, and the effect size via Cohen's d.
Differences between gameplay styles
Our initial hypothesis was that a Collaborative play mode could make students slightly less engaged with the game environment and tasks, due to more talking, switching controls, exchange of ideas and social interactions, which in turn could be helpful to actually make students more engaged with the overall activity and less prone to disengage due to problems solving puzzles, but at the same time could make students slower to solve simple tasks.
Based on the data-driven engagement analytics, we
Conclusions
We have performed a cohort-based factorial experiment focusing on the effect of solo vs. collaborative gameplay using the digital geometry game Shadowspect with high school first year students. The main findings include that students playing Solo had a higher in-game engagement and solved more levels, while Collaborative students were less linear in their gameplay patterns (i.e., skipping more tutorial levels and demonstrating more exploratory behaviors with Shadowspect features). Our results
Credit author statement
José A. Ruipérez-Valiente: Conceptualization, Methodology, Formal analysis, Investigation, Data Curation, Writing - Original Draft, Visualization. Yoon Jeon Kim: Conceptualization, Methodology, Investigation, Writing - Review & Editing, Project administration, Funding acquisition.
Acknowledgements
We want to acknowledge support from the MIT-SPAIN ''la Caixa'' Foundation SEED FUND and the Spanish Ministry of Economy and Competitiveness through the Juan de la Cierva Formaci\'on program (FJCI-2017-34926).
References (47)
- et al.
The concept of flow in collaborative game-based learning
Computers in Human Behavior
(2011) - et al.
Digital games in the classroom? A contextual approach to teachers adoption intention of digital games in formal education
Computers in Human Behavior
(2012) - et al.
Effects of representational guidance on domain specific reasoning in cscl
Computers in Human Behavior
(2005) - et al.
Exploring different technological platforms for supporting co-located collaborative games in the classroom
Computers in Human Behavior
(2012) Designing and evaluating collaboration in a virtual game environment for vocational learning
Computers & Education
(2008)- et al.
Improving high school students' executive functions through digital game play
Computers & Education
(2018) - et al.
Opportunities and challenges in assessing and supporting creativity in video games
- et al.
The influence of collaboration styles to children's cognitive performance in digital problem-solving game “william adventure”: A comparative case study
Computers & Education
(2010) - et al.
Does playing sports video games predict increased involvement in real-life sports over several years among older adolescents and emerging adults?
Journal of Youth and Adolescence
(2016) - et al.
The effects of game design experience on teachers attitudes and perceptions regarding the use of digital games in the classroom
TechTrends
(2017)
Measuring affective, physiological and behavioural differences in solo, competitive and collaborative games
Collaborative problem solving in five-year-old children: Evidence of social facilitation and social loafing
Educational Psychology
Games for health for children-current status and needed research
Games for Health Journal
Evolutionary change of higher education driven by digitalization
Collaborative strategic board games as a site for distributed computational thinking
International Journal of Game-Based Learning (IJGBL)
Inside, outside, and off-site: Social constructivism in mobile games
Digital generations: Children, young people, and the new media
Models of engagement: Intrinsically motivated interaction with multimedia learning software
Learning science through computer games and simulations
Learning in immersive worlds: A review of game-based learning
The impact of game-based learning on the achievement of learning goals and motivation for learning mathematics-literature review
Journal of Information and Organizational Sciences
Game learning analytics: Learning analytics for serious games
What video games have to teach us about learning and literacy
Computers in Entertainment (CIE)
Cited by (17)
Examining the effects of students' self-efficacy and prior knowledge on learning and visual behavior in a physics game
2022, Computers and EducationCitation Excerpt :Educational game is a game serving to create engaging learning experience for meeting certain educational goals and outcomes (Connolly et al., 2012; Hainey et al., 2016). Educational games have been designed to teach a variety of subjects (e.g., mathematics--Ruipérez-Valiente & Kim, 2020; Vanbecelaere et al., 2020; science--Clark et al., 2011; Lester et al., 2014; Martin et al., 2019) or to assist learners in developing cognitive skills (e.g., executive function--Homer et al., 2018; visuospatial skills--Wauck et al., 2017). There is a general consensus that educational games, if used appropriately, can contribute to positive cognitive and affective outcomes (Clark et al., 2016; Connolly et al., 2012; Hainey et al., 2016; Karakoç et al., 2020).
The use of a personalized learning approach to implementing self-regulated online learning
2022, Computers and Education: Artificial IntelligenceCitation Excerpt :Scholars have recognized the benefits of using computers and communication technologies to support students’ learning activities (Brezovszky et al., 2019; Hwang et al., 2012; McLaren et al., 2022; Ruipérez-Valiente & Kim, 2020).
The integration of corpus tools in the design and implementation of a novel analytical model for the learning of K12 classrooms
2023, Emergent Practices of Learning Analytics in K-12 ClassroomsA framework to support interoperable Game-based Assessments as a Service (GBAaaS): Design, development, and use cases
2023, Software - Practice and ExperienceAdapting Knowledge Inference Algorithms to Measure Geometry Competencies through a Puzzle Game
2023, ACM Transactions on Knowledge Discovery from DataInvestigating Students’ Engagement Patterns and Supporting Game Features in a Personalized Computerized Role-Playing Game Environment
2023, Journal of Educational Computing Research