A Framework for the Assessment and Training of Collaborative Problem-Solving Social Skills
Authors: 
Jennifer Hamet Bagnou, Elise Prigent, Jean-Claude Martin, Jieyeon Woo, Liu Yang, Catherine Achard, 
Catherine Pelachaud, Céline ClavelAuthors Info & Claims
Jennifer Hamet Bagnou, Elise Prigent, Jean-Claude Martin, Jieyeon Woo, Liu Yang, Catherine Achard, Catherine Pelachaud, Céline ClavelAuthors Info & ClaimsPages 381 - 384
Abstract
In this article, we describe a new experimental protocol. We propose to collect social interactions and the associated scales were selected to annotate the collected interactions. Three collaborative games were defined to support the study of social interaction during Collaborative Problem Solving. Three dyads of participants were recorded while solving these three collaborative games via a video conferencing system. We explain how the collected behaviors and social interactions were annotated using two scales and three human raters. The results indicate moderate to excellent reliability of these scales. We intend to use the resulting corpus by recruiting more subjects to explore the relations between attention and social interactions, and also for inspiring the design and validation of virtual characters for social skills training.
References
[1]
Ali, M.R., Crasta, D., Jin, L., Baretto, A., Pachter, J., Rogge, R.D., Hoque, M.E.: LISSA - live interactive social skill assistance. In: 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2013, pp. 173–179 (2015)
[2]
Andrews-Todd, J., & Forsyth, C. M. (2018). Exploring social and cognitive dimensions of collaborative problem solving in an open online simulation-based task. Computers in Human Behavior. https://doi.org/10.1016/j.chb.2018.10.025.
[3]
Bland A.R., Roiser, J.P., Mehta, M.A., Schei, T., Sahakian, B.J., Robbins, T.W., and Elliott, R. (2017). Cooperative Behavior in the Ultimatum Game and Prisoner's Dilemma Depends on Players’ Contributions. Front. Psychol. 8:1017.
[4]
Barron, B. (2003). When smart groups fail. The Journal of the Learning Sciences. https://doi.org/10.1207/S15327809JLS1203_1.
[5]
Bellack, A. S. (2004). Skills Training for People with Severe Mental Illness. Psychiatric Rehabilitation Journal, 27(4), 375–391. https://doi.org/10.2975/27.2004.375.391
[6]
Bellack, A. S., Mueser, K. T., Gingerich, S., & Agresta, J. (2013). Social skills training for schizophrenia: A step-by-step guide(2nd ed.). Guilford Press.
[7]
Casner-Lotto, J., & Barrington, L. (2006). Are they really ready for work? Employers' perspectives on the basic knowledge and applied skills of new entrants to the 21st century U.S. Workforce. Washington, DC: The conference board, partnership for 21st century skills, corporate voices for working families, and society for human resource management. Retrieved from http://eric.ed.gov/?id=ED519465.
[8]
Chollet, M., Neubauer, C., Ghate, P., & Scherer, S. (2018). Influence of individual differences when training public speaking with virtual audiences. Proceedings of the 18th International Conference on Intelligent Virtual Agents, IVA 2018, 1–7. https://doi.org/10.1145/3267851.3267874
[9]
Coffey, A. J., Kamhawi, R., Fishwick, P., & Henderson, J. (2017). The efficacy of an immersive 3D virtual versus 2D web environment in intercultural sensitivity acquisition. Educational Technology Research & Development, 65(2), 455–479.
[10]
Dindar, M., Järvelä, S., Järvenoja, H.(2020). Interplay of Metacognitive Experiences and Performance in Collaborative Problem Solving. Comput. Educ, 154, 103922.
[11]
Fydrich, T., Chambless, D. L., Perry, K. J., Buergener, F., & Beazley, M. B. (1998). Behavioral assessment of social performance: a rating system for social phobia. Behaviour research and therapy, 36(10), 995–1010. https://doi.org/10.1016/s0005-7967(98)00069-2
[12]
Graesser, A. C., Dowell, N., Hampton, A. J., Lippert, A. M., Li, H., & Shaffer, D. W. (2018). Building intelligent conversational tutors and mentors for team collaborative problem solving: Guidance from the 2015 Program for International Student Assessment. In Building intelligent tutoring systems for teams: What matters (pp. 173–211). Emerald Publishing Limited.
[13]
Gresham, F. M., & Elliott, S. N. (1984). Assessment and classification of children's social skills: A review of methods and issues. School Psychology Review, 13, 292-3011.
[14]
Grover, R. L., Nangle, D. W., Buffie, M., & Andrews, L. A. (2020). Defining social skills. In Social Skills Across the Life Span (pp. 3–24). Elsevier. https://doi.org/10.1016/b978-0-12-817752-5.00001-9
[15]
Hesse F., Care E., Buder J., Sassenberg K., Griffin P. (2015). A Framework for Teachable Collaborative Problem Solving Skills. In: Griffin P., Care E. (eds) Assessment and Teaching of 21st Century Skills. Educational Assessment in an Information Age. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-9395-7_2
[16]
Hops, H. (1983). Children's social competence and skill: Current research practices and future directions. Behavior Therapy, 14, 3–18. s0005-7894(83)80084-7
[17]
Hoque, M.E., Courgeon, M., Martin, J., Mutlu, B., Picard, R.W.: Mach: My automated conversation coach. In: Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2013 (to appear, 2013)
[18]
Howard, M. C., & Gutworth, M. B. (2020). A meta-analysis of virtual reality training programs for social skill development. Computers and Education, 144, [103707].https://doi.org/10.1016/j.compedu.2019.103707
[19]
Janssen, J., Erkens, G., Kirschner, P. A., & Kanselaar, G. (2012). Task-related and social regulation during online collaborative learning. Metacognition and Learning, 7 (1), 25–43. https://doi.org/10.1007/s11409-010-9061-5
[20]
Klaassen, R. G., de Vries, P., & Ceulemans, D. S. (2018). The applicability of feedback of virtual speech app metrics in a presentation technique course SEFI 2018 conference.
[21]
Kingery, J. N., Erdley, C. A., & Scarpulla, E. (2020). Developing social skills. In D. W. Nangle, C. A. Erdley & R. A. Schwartz-Mette (Eds), Social skills across the life span (pp. 25–45). London, UK: Academic Press.
[22]
Little S.G., Swangler J., Akin-Little A. (2017) Defining Social Skills. In: Matson J. (eds) Handbook of Social Behavior and Skills in Children. Autism and Child Psychopathology Series. Springer,Cham. https://doi.org/10.1007/978-3-319-64592-6_2
[23]
Milligan, K., Sibalis, A., Morgan, A., & Phillips, M. (2017). Social competence: Consideration of behavioral, cognitive, and emotional factors. In J. L. Matson (Ed.), Handbook of social behav-ior and skills in children (pp. 63–82). Cham: Springer International Publishing. https://doi. org/10.1007/978-3-319-64592-6_5.
[24]
Moody, C. T., & Laugeson, E. A. (2020). Social Skills Training in Autism Spectrum Disorder Across the Lifespan. Child and adolescent psychiatric clinics of North America, 29(2), 359–371. https://doi.org/10.1016/j.chc.2019.11.001
[25]
OECD (2017). PISA 2015 collaborative problem-solving framework. Retrieved fromJuly https://www.oecd.org/pisa/pisaproducts/Draft%20PISA%202015%20Collaborative%20Problem%20Solving%20Framework%20.pdf.
[26]
OECD (2017). PISA 2015 results (volume V): Collaborative problem solving, PISA. Paris: OECD Publishing. https://doi.org/10.1787/9789264285521-en.
[27]
O'Neil, H.F., S.H. Chuang, E.L. Baker (2010), "Computer-based feedback for computer-based collaborative problem-solving", in Ifenthaler, D., P. Pirnay-Dummer and N.M. Seel (eds.), Computer-based diagnostics and systematic analysis of knowledge, Springer-Verlag, New York, NY.
[28]
Ramdhonee-Dowlot, K., Balloo, K., & Essau, C. A. (2021). Effectiveness of the Super Skills for Life programme in enhancing the emotional wellbeing of children and adolescents in residential care institutions in a low-and middle-income country: A randomised waitlist-controlled trial. Journal of Affective Disorders, 278, 327–338.
[29]
Rogers, S. A. (2017). A massively multiplayer online role-playing game with language learning strategic activities to improve English grammar, listening, reading, and vocabulary. University of South Alabama.
[30]
Rosen, Y., & Foltz, P. (2014). Assessing collaborative problem solving through automated technologies. Research and Practice in Technology Enhanced Learning, 9(3), 389–410.
[31]
Scoular, C., Care, E., & Hesse, F. W. (2017). Designs for operationalizing collaborative problem solving for automated assessment. Journal of Educational Measurement, 54, 12–35.
[32]
Slof, B., Erkens, G., Kirschner, P. A., Janssen, J., & Phielix, C. (2010). Fostering complex learning-task performance through scripting student use of computer supported representational tools. Computers & Education. https://doi.org/10.1016/j.compedu.2010.07.016.
[33]
Shrout, P.E., & Fleiss, J.L. (1979). Intraclass Correlation: Uses in Assessing Rater Reliability. Psychological Bulletin 86: 420–28.
[34]
Stadler, M., Herborn, K., Mustafi,ć, M., and Greiff, S. (2020). The assessment of collaborative problem solving in PISA 2015: an investigation of the validity of the PISA 2015 CPS tasks. Comput. Educat. 157:103964.
[35]
Wang, C. X., Calandra, B., Hibbard, S. T., & Lefaiver, M. L. M. (2012). Learning effects of an experimental EFL program in Second Life. Educational Technology Research & Development, 60(5), 943–961.
[36]
Zimmerman, B. J., & Schunk, D. H. (2011). Self-regulated learning and performance: An introduction and an overview. In B. Zimmerman, & D. H. Schunk (Eds.), Handbook of self-regulation of learning and performance. New York: Routledge.
Index Terms
- A Framework for the Assessment and Training of Collaborative Problem-Solving Social Skills
Index terms have been assigned to the content through auto-classification.
Recommendations
Fostering collaborative problem solving skills in science: The Animalia project
AbstractCollaboration might not always be the best approach for problem solving in classroom learning setting. The purpose of this study is to determine what collaborative learning behaviors contribute to learning outcomes in collaborative ...
Highlights- Log files of collaborative learning used to determine patterns related learning outcomes.
Supporting social and adaptive interaction in collaborative rehabilitation training
CHIuXiD '15: Proceedings of the International HCI and UX Conference in IndonesiaCollaborative training can be considered as a way to support social interaction and enhance training motivation of patients during their rehabilitation. When performing collaborative training exercises as part of the rehabilitation program, a patient ...
Designing for collaborative creative problem solving
C&C '07: Proceedings of the 6th ACM SIGCHI conference on Creativity & cognitionCollaborative creativity is traditionally supported by formal techniques, such as brainstorming. These techniques improve the idea-generation process by creating group synergies, but also suffer from a number of negative effects. Current electronic ...
Comments
Information & Contributors
Information
Published In
October 2021
418 pages
ISBN:9781450384711
DOI:10.1145/3461615
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 17 December 2021
Check for updates
Qualifiers
- Short-paper
- Research
- Refereed limited
Funding Sources
- ANR
Conference
ICMI '21
Sponsor:
ICMI '21: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
October 18 - 22, 2021
QC, Montreal, Canada
Acceptance Rates
Overall Acceptance Rate 453 of 1,080 submissions, 42%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 88Total Downloads
- Downloads (Last 12 months)14
- Downloads (Last 6 weeks)2
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format