Skip to main content
Springer Nature Link
Log in

Social-Emotional Competence for the Greater Good: Exploring the Use of Serious Game, Virtual Reality and Artificial Intelligence to Elicit Prosocial Behaviors and Strengthen Cognitive Abilities of Youth, Adolescents and Educators – A Systematic Review

  • Conference paper
  • First Online:
Virtual, Augmented and Mixed Reality: Design and Development (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13317))

Included in the following conference series:

  • 3036 Accesses

Abstract

This study sought to understand the learning benefits, impacts, and opportunities involved with the use of serious games (SG), extended reality (XR), Artificial Intelligence (AI) and other advanced technologies in the classroom and other educational settings. We conducted a systematic literature review focusing on the potential benefits of utilizing those technologies to build and strengthen prosocial behaviors and cognitive abilities of students and other learners. Results of the study reveal that those modern technologies can be used to improve students’ academic experiences and interactions with their peers while in school. In our rapidly changing global knowledge society, it is clear there is a need to develop and build the capacity of students to work effectively and cooperatively with all people including those from diverse socio-cultural and educational backgrounds. This paper highlights ways in which advanced technologies can support ongoing efforts to enhance students’ knowledge while building more inclusive and emotionally supportive learning environments in school settings.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Brownell, C.A., Hazen, N.: Early peer interaction: a research agenda. Early Educ. Dev. 10(3), 403–413 (1999)

    Google Scholar 

  2. Lewis, M., Michalson, L.: Children’s Emotions and Moods: Developmental Theory and Measurement. Plenum Press, New York (1983)

    Book  Google Scholar 

  3. Hyson, M.: The Emotional Development of Young Children: Building an Emotion-Centered Curriculum, 2nd edn. Teachers College Press, New York (2004)

    Google Scholar 

  4. Webster-Stratton, C.: How to Promote Children’s Social and Emotional Competence. P. Chapman, London (1999)

    Google Scholar 

  5. Dewar, G.: Raising helpful kids: the perils of rewarding good behavior. Parent. Sci. (2014 Aug 20)

    Google Scholar 

  6. Pizarro, D.A., Salovey, P.: Being and becoming a good person: the role of emotional intelligence in moral development and behavior. In Aronson, J., Cordova, D. (eds.) Improving Academic Achievement: Impact of Psychological Factors on Education, pp. 247–266. Academic Press, San Diego, CA (2002)

    Google Scholar 

  7. Kremenitzer, J.P., Miller, R.: Are you a highly qualified emotionally intelligent early childhood educator? Young Child. 63, 106–112 (2008)

    Google Scholar 

  8. Liew, J., Eisenberg, N., Losoya, S.H., Fabes, R.A., Guthrie, I.K., Murphy, B.C.: Children’s physiological indices of empathy and their socioemotional adjustment: does caregivers’ expressivity Matter?” J. Fam. Psychol. 17(4), 584–597 (2003)

    Google Scholar 

  9. Catalano, R.F., Oesterle, S., Fleming, C.B., Hawkins, J.D.: The importance of bonding to school for healthy development: findings from the social development research group. J. Sch. Health 74(7), 252–261 (2004)

    Google Scholar 

  10. Constantine, M.G.: Theoretical orientation, empathy, and multicultural counseling competence in school counselor trainees. Prof. Sch. Couns. 4(5), 342–348 (2001)

    Google Scholar 

  11. Gunawan, I., Wibowo, M.E., Purwanto, E., Sunawan, S.: Group counseling of values clarification to increase middle school students’ empathy. Psicología educativa (Madrid) 25(2), 169–174 (2019)

    Google Scholar 

  12. Osterman, K.F.: Students’ need for belonging in the school community. Rev. Educ. Res. 70(3), 323–367 (2000)

    Article  Google Scholar 

  13. Guilbaud, P., Bubar, E., Langran, E.: STEM excellence and equity in K-12 settings: use of augmented reality-based educational experiences to promote academic achievement and learner success. In: HCI International 2021 – Posters, pp. 45–50 (2021)

    Google Scholar 

  14. Patterson, T., Han, I.: Learning to teach with virtual reality: lessons from one elementary teacher. TechTrends 63(4), 463–469 (2019). https://doi.org/10.1007/s11528-019-00401-6

    Article  Google Scholar 

  15. Dalgarno, B., Lee, M.J.W.: What are the learning affordances of 3-D virtual environments? Br. J. Educ. Technol. 41(1), 10–32 (2010)

    Google Scholar 

  16. Hilvoorde, I.V., Pot, N.: Embodiment and fundamental motor skills in eSports. Sport Ethics Philos. 10(1), 14–27 (2016)

    Google Scholar 

  17. Taylor, T.L.: Raising the Stakes e-Sports and the Professionalization of Computer Gaming. MIT Press, Cambridge, Mass (2012)

    Book  Google Scholar 

  18. Martoncik, M.: e-Sports: playing just for fun or playing to satisfy life goals? Comput. Hum. Behav. 48, 208–211 (2015)

    Article  Google Scholar 

  19. Rueda, J., Lara, F.: Virtual reality and empathy enhancement: ethical aspects. Front. Robot. AI 7, 506984 (2020)

    Article  Google Scholar 

  20. Schaber, P., Wilcox, K., Whiteside, A., Marsh, L., Brooks, D.: Designing learning environments to foster affective learning: comparison of classroom to blended learning. Int. J. Scholarsh. Teach. Learn. 4(2) (2010)

    Google Scholar 

  21. James, A.: Childhood Identities: Self and Social Relationships in the Experience of the Child. Edinburgh University Press, Edinburgh (1993)

    Google Scholar 

  22. Yeager, D.S.: Social and emotional learning programs for adolescents. Future Child. 27(1), 73–94 (2017)

    Article  MathSciNet  Google Scholar 

  23. Koppelman, K.L., Goodhart, R.L.: Understanding Human Differences: Multicultural Education for a Diverse America. Pearson/Allyn and Bacon, Boston (2005)

    Google Scholar 

  24. Martin-Beltrán, M., Guzman, N.L., Kidwell, T.: Building a community of practice to counter the marginalisation of adolescent language learners. Lang. Cult. Curr. 32(2), 142–156 (2019)

    Google Scholar 

  25. Cutter-Mackenzie, A.: Multicultural school gardens: creating engaging garden spaces in learning about language, culture, and environment. Can. J. Environ. Educ. 14, 122–135 (2009)

    Google Scholar 

  26. Angel, B.Ø.: Foster children’s sense of sibling belonging: the significance of biological and social ties. SAGE Open 4(1) (2014)

    Google Scholar 

  27. Brownell, C.A., Hazen, N.: Early peer interaction: a research agenda. Early Educ. Dev. 10(3), 403–413 (1999)

    Google Scholar 

  28. Penn, H.: Unequal Childhoods: Young Children’s Lives in Poor Countries, 1st edn. Routledge, London (2005)

    Book  Google Scholar 

  29. Ackerman, P.L., Kanfer, R., Beier, M.E.: Trait complex, cognitive ability, and domain knowledge predictors of Baccalaureate success, STEM persistence, and gender differences. J. Educ. Psychol. 105(3), 911–927 (2013)

    Google Scholar 

  30. Del Missier, F., Mäntylä, T., de Bruin, W.B.: Decision-making competence, executive functioning, and general cognitive abilities. J. Behav. Dec. Mak. 25(4), 331–351 (2012). https://doi.org/10.1002/bdm.731

  31. Bloom, B.S.: Taxonomy of Educational Objectives; the Classification of Educational Goals, 1st edn. Longmans, Green, New York (1956)

    Google Scholar 

  32. Carroll, J.B.: Human Cognitive Abilities: A Survey of Factor-Analytic Studies. Cambridge University Press, Cambridge (1993)

    Book  Google Scholar 

  33. Krathwohl, D.R.: A revision of bloom’s taxonomy: an overview. Theory Pract. 41(4), 212–218 (2002)

    Article  Google Scholar 

  34. Bandura, A.: Self-efficacy: toward a unifying theory of behavioral change. Psychol. Rev. 84(2), 191–215 (1977)

    Article  Google Scholar 

  35. Ackerman, P.L., Heggestad, E.D.: Intelligence, personality, and interests: evidence for overlapping traits. Psychol. Bull. 121(2), 219–245 (1997)

    Google Scholar 

  36. Hagenauer, G., Hascher, T.: Early adolescents’ enjoyment experienced in learning situations at school and its relation to student achievement. J. Educ. Train. Stud. 2, 20–30 (2014). https://doi.org/10.11114/jets.v2i2.254

    Article  Google Scholar 

  37. Murayama, K., Pekrun, R., Lichtenfeld, S., vom Hofe, R.: Predicting long-term growth in students’ mathematics achievement: the unique contributions of motivation and cognitive strategies. Child Dev. 84(4), 1475–1490 (2013). https://doi.org/10.1111/cdev.12036

  38. Jin, M., Ji, L., Peng, H.: The relationship between cognitive abilities and the decision-making process: the moderating role of self-relevance. Front. Psychol. 10, 1892 (2019). https://doi.org/10.3389/fpsyg.2019.01892

    Article  Google Scholar 

  39. Eccles, J.S., Wigfield, A.: In the mind of the actor: the structure of adolescents’ achievement task values and expectancy-related beliefs. Person. Soc. Psychol. Bull. 21(3) 215–225 (1995)

    Google Scholar 

  40. Garcia, S., Ferguson, C.J., Wang, C.K.J.: Prosocial video game content, empathy and cognitive ability in a large sample of youth. J. Youth Adolesc. 51(1), 62–73 (2021). https://doi.org/10.1007/s10964-021-01512-1

    Article  Google Scholar 

  41. Garner, P.W., Mahatmya, D., Brown, E.L., Vesely, C.K.: Promoting desirable outcomes among culturally and ethnically diverse children in social emotional learning programs: a multilevel heuristic model. Educ. Psychol. Rev. 26(1), 165–189 (2014)

    Google Scholar 

  42. Yoder, N.: Teaching the Whole Child: Instructional Practices that Support Social and Emotional Learning in Three Teacher Evaluation Frameworks. American Institutes for Research Center on Great Teachers and Leaders, Washington, DC (2013)

    Google Scholar 

  43. Dobyns, K.: Building Empathy through Social-Emotional Learning in Advisory. Education: Student Scholarship & Creative Works (2019)

    Google Scholar 

  44. Bronfenbrenner, U.: The Ecology of Human Development Experiments by Nature and Design. Harvard University Press, Cambridge, MA (1996)

    Google Scholar 

  45. DeAnn Marsh, A.K., et al.: What is Bronfenbrenner’s ecological systems theory? The Psychology Notes Headquarters, 27 Jul 2021

    Google Scholar 

  46. Collaborative for Academic Social and Emotional Learning.: Fundamentals of SEL. CASEL, 26 Oct 2021

    Google Scholar 

  47. Durlak, J.A., Weissberg, R.P., Dymnicki, A.B., Taylor, R.D., Schellinger, K.B: The impact of enhancing students’ social and emotional learning: a meta-analysis of school-based universal interventions. Child Dev. 82(1), 405–432 (2011)

    Google Scholar 

  48. Dweck, C.: Mindset: The New Psychology of Success, p. 2016. Ballantine Books, New York, NY (2016)

    Google Scholar 

  49. American School Counselor Association (ASCA).: ASCA Student Standards; Mindsets and Behaviors for Student Success. Alexandria, VA; Author (2021)

    Google Scholar 

  50. Corcoran, R.P., Tormey, R.: How emotionally intelligent are pre-service teachers? Teach. Teacher Educ. 28(5), 750–759 (2012)

    Google Scholar 

  51. Halberstadt, A.G., Denham, S.A., Dunsmore, J.C.: Affective social competence. Soc. Dev. 10(1), 79–119 (2001)

    Article  Google Scholar 

  52. Calaguas, G.M., Dizon, C.S.: Development and initial validation of the social competency inventory for tertiary level faculty members. Int. J. Hum. Soc. Sci. 5, 1043–1048 (2011)

    Google Scholar 

  53. Daccord, T.: Using Virtual Reality for Social and Emotional Learning, 5 Mar 2020

    Google Scholar 

  54. Nazerian, T.: How VR is Being Used to Teach SEL, 29 May 2018

    Google Scholar 

  55. Bailenson, J.: Experience on Demand: What Virtual Reality Is, How It Works, and What It Can Do. W.W. Norton & Co. (2018)

    Google Scholar 

  56. Murphy, R., Gallagher, L., Krumm, A., Mislevy, J., Haer, A.: Research on the Use of Khan Academy in Schools – Sri. Research on the Use of Khan Academy in Schools, Mar 2014

    Google Scholar 

  57. Juhasz, A.: Learning from YouTube. The MIT Press, Cambridge, MA (2011)

    Google Scholar 

  58. De Gloria, A., Bellotti, F., Berta, R.: Serious games for education and training. Int. J. Ser. Games 1(1) (2014)

    Google Scholar 

  59. Shaban, H.: Playing War: How the Military Uses Video Games. The Atlantic, 10 Oct 2013

    Google Scholar 

  60. Romaniuk, S., Burgers, T.: How the US military is using ‘violent, chaotic, beautiful’ video games to train soldiers. The Conversation, 7 Mar 2017

    Google Scholar 

  61. Asai, K.: Visualization based on geographic information in augmented reality. In: Maad, S. (ed.) Augmented Reality, pp. 185–204 (2010)

    Google Scholar 

  62. Bardi, J.: What is Virtual Reality? (Definition and Examples), 21 Sep 2020

    Google Scholar 

  63. Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach, 2nd edn. Prentice Hall (2002)

    Google Scholar 

  64. Hua, W., Cuiqin, M., Lijuan, Z.: A brief review of machine learning and its application. In: Proc. of the International Conference on Information Engineering and Computer Science (2009)

    Google Scholar 

  65. van Loon, A., Bailenson, J., Zaki, J., Bostick, J., Willer, R.: Virtual reality perspective-taking increases cognitive empathy for specific others. PLoS ONE 18(8) (2018)

    Google Scholar 

  66. Dewey, A., Drahota, A.: Introduction to systematic reviews: online learning module cochrane training (2016)

    Google Scholar 

  67. MacKenzie, H., et al.: Systematic reviews: what they are, why they are important, and how to get involved. J. Clin. Prevent. Cardiol. 1(4), 193–202 (2012)

    Google Scholar 

  68. Page, M.J., et al.: Explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. BMJ (Online) 372(2021), n160–n160 (2020)

    Google Scholar 

  69. Harris, J.D., Quatman, C.E., Manring, M.M., Siston, R.A., Flanigan, D.C.: How to write a systematic review. Am. J. Sports Med. 42(11), 2761–2768 (2014)

    Article  Google Scholar 

  70. Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G.: Reprint—preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Phys. Ther. 89(9), 873–880 (2009)

    Google Scholar 

  71. Bruno, C., Donaldson, C.: Combining the best aspects of humanity with the best of technology. Child. Educ. 94(6), 25–32 (2018)

    Article  Google Scholar 

  72. Habig, S.: Who can benefit from augmented reality in chemistry? Sex differences in solving stereochemistry problems using augmented reality. Br. J. Edu. Technol. 51(3), 629–644 (2020)

    Article  Google Scholar 

  73. Alizadeh, M.: Virtual Reality in the Language Classroom: Theory and Practice (2019)

    Google Scholar 

  74. Kirschner, P.A., Kreijns, K., Phielix, C., Fransen, J.: Awareness of cognitive and social behaviour in a CSCL environment. J. Comput. Assist. Learn. 31(1), 59–77 (2015)

    Google Scholar 

  75. Schutte, N.S., Stilinović, E.J.: Facilitating empathy through virtual reality. Motiv. Emot. 41(6), 708–712 (2017)

    Google Scholar 

  76. Southgate, E., et al.: Embedding immersive virtual reality in classrooms: ethical, organisational and educational lessons in bridging research and practice. Int. J. Child Comput. Interact. 19, 19–29 (2019)

    Google Scholar 

  77. Allcoat, D., von Mühlenen, A.: Learning in virtual reality: effects on performance, emotion and engagement. Res. Learn. Technol. 26, 1–13 (2018)

    Google Scholar 

  78. Flogie, A., Aberšek, B., Pesek, I.: The impact of innovative learning environments on social competences of youth. Res. Learn. Technol. 27 (2019)

    Google Scholar 

  79. Salas-Pilco, S.Z.: The impact of AI and robotics on physical, social-emotional and intellectual learning outcomes: an integrated analytical framework. Br. J. Edu. Technol. 51(5), 1808–1825 (2020)

    Article  Google Scholar 

  80. Hafner, M., Jansz, J.: The players‘ experience of immersion in persuasive games. Int. J. Serious Games 5(4), 63–79 (2018)

    Article  Google Scholar 

  81. Bogost, I.: Persuasive Games: The Expressive Power of Videogames. MIT Press (2007)

    Google Scholar 

  82. Barrera, U., Monaco, E., Postigo-Zegarra, S., Gil-Gomez, J., Montoya-Castilla, I.: EmoTIC: impact of a game-based social-emotional programme on adolescents. PloS ONE 16(4) (2021)

    Google Scholar 

  83. Hirsch, M.: Situation alignment for distributed operations. In: IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA), pp. 7–11 (2020)

    Google Scholar 

  84. Cooper, B.: Empathy, emotion, technology, and learning. In: Tettegah, S.Y., McCreery, M.P. (eds.) Emotions, Technology, and Learning, pp. 265–88. Elsevier Academic Press (2016)

    Google Scholar 

  85. Jones, D.E., Greenberg, M., Crowley, M.: Early social-emotional functioning and public health: the relationship between kindergarten social competence and future wellness. Am. J. Public Health 105(11), 2283–2290

    Google Scholar 

  86. Summers, L.L.: The right blend: SEL skills support teacher learning in person and online. Learn. Professional 41(4), 32–36 (2020)

    Google Scholar 

  87. Taylor, R.D., Oberle, E., Durlak, J.A., Weissberg, R.P.: Promoting positive youth development through school‐based social and emotional learning interventions: a meta‐analysis of follow‐up effects. Child Dev. 88(4) 1156–1171 (2017)

    Google Scholar 

  88. Stavroulia, K.E., Christofi, M., Baka, E., Michael-Grigoriou, D., Magnenat-Thalmann, N., Lanitis, A.: Assessing the emotional impact of virtual reality-based teacher training. Int. J. Inf. Learn. Technol. 36(3), 192–217 (2019)

    Google Scholar 

  89. McIntosh, N.A., Nenonene, R.L.: In this spirit: helping preservice teachers thrive during the pandemic through adaptation and change. J. Catholic Educ. 23(1), 162–174 (2020)

    Google Scholar 

  90. Noel, L.A., Liu, T.: Using design thinking to create a new education paradigm for elementary level children for higher student engagement and success. In: Lloyd, P., Bohemia, E. (eds.) Future Focused Thinking – DRS International Conference 2016, 27–30 June, Brighton, United Kingdom

    Google Scholar 

  91. Wigelsworth, M., et al.: The impact of trial stage, developer involvement and international transferability on universal social and emotional learning programme outcomes: a meta-analysis. Cambridge J. Educ. 46(3), 347–376 (2016)

    Google Scholar 

  92. Han, J., Jo, M., Hyun, E., So, H.-J.: Examining young children’s perception toward augmented reality-infused dramatic play. Educ. Tech. Res. Dev. 63(3), 455–474 (2015)

    Article  Google Scholar 

  93. Vossen, H.G.M, Valkenburg, P.M.: Do social media foster or curtail adolescents’ empathy? A longitudinal study. Comput. Human Behav. 63, 118–124 (2016)

    Google Scholar 

  94. Flecha, R., Pulido, C., Villarejo, B., Racionero, S., Redondo, S., Torras, E.: Effects of the Use of Digital Technology on Children’s Empathy and Attention Capacity: Analytical Report. Vol. 4/2019. Luxembourg: Publications Office (2020)

    Google Scholar 

  95. Parong, J., Wells, A., Mayer, R.E.: Replicated evidence towards a cognitive theory of game-based training. J. Educ. Psychol. 112(5), 922–937 (2020)

    Google Scholar 

  96. Arnab, S., Clarke, S., Morini, L.: Co-creativity through play and game design thinking. Elect. J. e-Learn. 17(3), 184–198 (2019)

    Google Scholar 

  97. Avgousti, M.I., Hadjistassou, S.: ReDesign: Redesigning Learning through a New Learning Management System (2019)

    Google Scholar 

  98. Blau, I., Weiser, O., Eshet-Alkalai, Y.: How do medium naturalness and personality traits shape academic achievement and perceived learning? An experimental study of face-to-face and synchronous e-learning. Res. Learn. Technol. 25, 1–23 (2017)

    Article  Google Scholar 

  99. Bower, M., DeWitt, D., Lai, J.W.M.: Reasons associated with preservice teachers’ intention to use immersive virtual reality in education. Brit. J. Educ. Technol. 51(6), 2214–2232 (2020)

    Google Scholar 

  100. Scholtes, V., van Hout, M., van Koppen, L.: Can people develop a sense of belonging through playing league of legends?” In: Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology, pp. 1–6. ACM (2016)

    Google Scholar 

  101. Wimmer, S., Denk, N., Pfeiffer, A., Fleischhacker, M.: On the use of esports in educational settings. How can esports serve to increase interest in traditional school subjects and improve the ability to use 21st century skills? In: ICERI2021 Proceedings, IATED, vol. 8, pp. 5782–5787 (2021)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Winthrop University, Rock Hill, SC, USA

    Patrick Guilbaud

  2. Radford University, Radford, VA, USA

    Carrie Sanders

  3. ISEA TEK LLC, Maitland, FL, USA

    Michael J. Hirsch

  4. UNC at Charlotte, Charlotte, NC, USA

    T. Christa Guilbaud

Authors
  1. Patrick Guilbaud
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carrie Sanders
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michael J. Hirsch
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. T. Christa Guilbaud
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Patrick Guilbaud .

Editor information

Editors and Affiliations

  1. U.S. Army Research Laboratory, Aberdeen Proving Ground, MD, USA

    Jessie Y. C. Chen

  2. U.S. Army Combat Capabilities Development Command Soldier Center, Orlando, FL, USA

    Gino Fragomeni

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Guilbaud, P., Sanders, C., Hirsch, M.J., Guilbaud, T.C. (2022). Social-Emotional Competence for the Greater Good: Exploring the Use of Serious Game, Virtual Reality and Artificial Intelligence to Elicit Prosocial Behaviors and Strengthen Cognitive Abilities of Youth, Adolescents and Educators – A Systematic Review. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality: Design and Development. HCII 2022. Lecture Notes in Computer Science, vol 13317. Springer, Cham. https://doi.org/10.1007/978-3-031-05939-1_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-05939-1_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-05938-4

  • Online ISBN: 978-3-031-05939-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics