skip to main content
10.1145/3025453.3026011acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article
Public Access

You Want Me to Work with Who?: Stakeholder Perceptions of Automated Team Formation in Project-based Courses

Published: 02 May 2017 Publication History

Abstract

Instructors are increasingly using algorithmic tools for team formation, yet little is known about how these tools are applied or how students and instructors perceive their use. We studied a representative team formation tool (CATME) in eight project-based courses. An instructor uses the tool to form teams by surveying students' working styles, skills, and demographics; then configuring these criteria as input into an algorithm that assigns teams. We surveyed students (N=277) in the courses to gauge their perceptions of the strengths and weaknesses of the tool and ideas for improving it. We also interviewed instructors (N=13) different from those who taught the eight courses to learn about their criteria selections and perceptions of the tool. Students valued the rational basis for forming teams but desired a stronger voice in criteria selection and explanations as to why they were assigned to a particular team. Instructors appreciated the efficiency of team formation but wanted to view exemplars of criteria used in similar courses. This work contributes recommendations for deploying team formation tools in educational settings and for better satisfying the goals of all stakeholders.

Supplementary Material

MP4 File (p3201-jahanbakhsh.mp4)

References

[1]
CATME Smarter Teamwork. Available from: http://info.catme.org/.
[2]
ABET. Criteria for Accrediting Computing Programs: Effective for Reviews During the 2014-2015 Accreditation Cycle. Available from: http://www.abet.org/wpcontent/uploads/2015/04/E001-14-15-EACCriteria.pdf.
[3]
Anthony Lising Antonio, Mitchell J Chang, Kenji Hakuta, David A Kenny, Shana Levin and Jeffrey F Milem. 2004. Effects of racial diversity on complex thinking in college students. Psychological Science, 15 (8): 507--510. http://dx.doi.org/10.1111/j.09567976.2004.00710.x
[4]
Ernesto Arias, Hal Eden, Gerhard Fischer, Andrew Gorman and Eric Scharff. 2000. Transcending the individual human mind - creating shared understanding through collaborative design. ACM Transactions on Computer-Human Interaction, 7 (1): 84--113. http://dx.doi.org/10.1145/344949.345015
[5]
Donald R Bacon, Kim A Stewart and William S Silver. 1999. Lessons from the best and worst student team experiences: How a teacher can make the difference. Journal of Management Education, 23 (5): 467--488. http://dx.doi.org/10.1177/105256299902300503
[6]
Donald R Bacon, Kim A Stewart and Sue StewartBelle. 1998. Exploring predictors of student team project performance. Journal of Marketing Education, 20 (1): 63--71. http://dx.doi.org/10.1177/027347539802000108
[7]
Julia B Bear and Anita Williams Woolley. 2011. The role of gender in team collaboration and performance. Interdisciplinary Science Reviews, 36 (2): 146--153. http://dx.doi.org/10.1179/030801811X1301318196147
[8]
James L Brickell, David B Porter, Michael F Reynolds and Richard D Cosgrove. 1994. Assigning students to groups for engineering design projects: A comparison of five methods. Journal of Engineering Education, 83 (3): 259--262. http://dx.doi.org/10.1002/j.21689830.1994.tb01113.x
[9]
Rupert Brown. 2000. Group Processes: Dynamics Within and Between Groups. Blackwell Publishing.
[10]
Kenneth J Chapman, Matthew Meuter, Dan Toy and Lauren Wright. 2006. Can't we pick our own groups? The influence of group selection method on group dynamics and outcomes. Journal of Management Education, 30 (4): 557--569. http://dx.doi.org/10.1177/1052562905284872
[11]
Dawn R Deeter-Schmelz, Karen Norman Kennedy and Rosemary P Ramsey. 2002. Enriching our understanding of student team effectiveness. Journal of Marketing Education, 24 (2): 114--124. http://dx.doi.org/10.1177/0273475302242004
[12]
Amy Edmondson. 1999. Psychological Safety and Learning Behavior in Work Teams. Administrative Science Quarterly, 44 (2): 350--383. http://dx.doi.org/10.2307/2666999
[13]
Motahhare Eslami, Karrie Karahalios, Christian Sandvig, Kristen Vaccaro, Aimee Rickman, Kevin Hamilton and Alex Kirlik. 2016. First I "like" it, then I hide it: Folk Theories of Social Feeds. Proceedings of the ACM Conference on Human Factors in Computing Systems, ACM, 2371--2382. http://dx.doi.org/10.1145/2858036.2858494
[14]
Motahhare Eslami, Aimee Rickman, Kristen Vaccaro, Amirhossein Aleyasen, Andy Vuong, Karrie Karahalios, Kevin Hamilton and Christian Sandvig. 2015. I always assumed that I wasn't really that close to [her]: Reasoning about Invisible Algorithms in News Feeds. Proceedings of the ACM Conference on Human Factors in Computing Systems, ACM, 153--162. http://dx.doi.org/10.1145/2702123.2702556
[15]
Graham D Fenwick and Derrick J Neal. 2001. Effect of gender composition on group performance. Gender, Work & Organization, 8 (2): 205--225. http://dx.doi.org/10.1111/1468-0432.00129
[16]
Daniel Goleman. 1998. Working with emotional intelligence. Bantam.
[17]
Narasimhaiah Gorla and Yan Wah Lam. 2004. Who should work with whom?: building effective software project teams. Communications of the ACM, 47 (6): 7982. http://dx.doi.org/10.1145/990680.990684
[18]
J. Richard Hackman (ed.). 1990. Groups That Work (and Those That Don't): Creating Conditions for Effective Teamwork. Jossey-Bass Publishers, San Francisco.
[19]
Sujin K Horwitz and Irwin B Horwitz. 2007. The effects of team diversity on team outcomes: A metaanalytic review of team demography. Journal of Management, 33 (6): 987--1015. http://dx.doi.org/10.1177/0149206307308587
[20]
Roland Hübscher. 2010. Assigning students to groups using general and context-specific criteria. IEEE Transactions on Learning Technologies, 3 (3): 178189. http://dx.doi.org/10.1109/TLT.2010.17
[21]
David Hunkeler and Julie E Sharp. 1997. Assigning functional groups: The influence of group size, academic record, practical experience, and learning style. Journal of Engineering Education, 86 (4): 321332. http://dx.doi.org/10.1002/j.21689830.1997.tb00305.x
[22]
David S Jalajas and Robert I Sutton. 1984. Feuds in student groups: Coping with whiners, martyrs, saboteurs, bullies, and deadbeats. Journal of Management Education, 9 (4): 94--102. http://dx.doi.org/10.1177/105256298400900413
[23]
Irving Lester Janis. 1982. Groupthink: Psychological studies of policy decisions and fiascoes. Houghton Mifflin Boston.
[24]
Karen A Jehn, Gregory B Northcraft and Margaret A Neale. 1999. Why differences make a difference: A field study of diversity, conflict and performance in workgroups. Administrative Science Quarterly, 44 (4): 741--763. http://dx.doi.org/10.2307/2667054
[25]
George Lakoff and Mark Johnson. 2008. Metaphors we live by. University of Chicago press.
[26]
J. Richard Landis and Gary G. Koch. 1977. The Measurement of Observer Agreement for Categorical Data. Biometrics, 33 (1): 159--174. http://dx.doi.org/10.1145/2675133.267516610.2307/25
[27]
Richard A Layton, Misty L Loughry, Matthew W Ohland and George D Ricco. 2010. Design and validation of a web-based system for assigning members to teams using instructor-specified criteria. Advances in Engineering Education, 2 (1): 1--28.
[28]
Ioanna Lykourentzou, Angeliki Antoniou, Yannick Naudet and Steven P Dow. 2016. Personality Matters: Balancing for Personality Types Leads to Better Outcomes for Crowd Teams. Proceedings of the ACM Conference on Computer-Supported Cooperative Work & Social Computing, ACM, 260--273. http://dx.doi.org/10.1145/2818048.2819979
[29]
Ioanna Lykourentzou, Robert Kraut and Steven P. Dow. 2017. Team Dating Leads to Better Online Ad Hoc Collaborations. Proceedings of the ACM Conference on Computer Supported Cooperative Work & Social Computing, to appear.
[30]
Sakthi Mahenthiran and Pamela J Rouse. 2000. The impact of group selection on student performance and satisfaction. International Journal of Educational Management, 14 (6): 255--265. http://dx.doi.org/10.1108/09513540010348043
[31]
Barbara Oakley, Richard M Felder, Rebecca Brent and Imad Elhajj. 2004. Turning student groups into effective teams. Journal of Student Centered Learning, 2 (1): 9--34.
[32]
Michael A Redmond. 2001. A computer program to aid assignment of student project groups. ACM SIGCSE Bulletin, 134--138. http://dx.doi.org/10.1145/366413.364562
[33]
Marcel M Robles. 2012. Executive perceptions of the top 10 soft skills needed in today's workplace. Business Communication Quarterly, 75 (4): 453--465. http://dx.doi.org/10.1177/1080569912460400
[34]
Timothy S Schoenecker, Kathryn D Martell and Joseph F Michlitsch. 1997. Diversity, performance, and satisfaction in student group projects: An empirical study. Research in Higher Education, 38 (4): 479--495. http://dx.doi.org/10.1023/A:1024966627400
[35]
Greg L Stewart. 2006. A meta-analytic review of relationships between team design features and team performance. Journal of Management, 32 (1): 29--55. http://dx.doi.org/10.1177/0149206305277792
[36]
A.L. Strauss. 1987. Qualitative Analysis for Social Scientists. Cambridge University Press.
[37]
James T Strong and Rolph E Anderson. 1990. Freeriding in group projects: Control mechanisms and preliminary data. Journal of Marketing Education, 12 (2): 61--67. http://dx.doi.org/10.1177/027347539001200208
[38]
Anya Tafliovich, Andrew Petersen and Jennifer Campbell. 2016. Evaluating Student Teams: Do Educators Know What Students Think? Proceedings of the ACM Technical Symposium on Computing Science Education, ACM, 181--186. http://dx.doi.org/10.1145/2839509.2844647
[39]
Martin Wessner and Hans-Rüdiger Pfister. 2001. Group formation in computer-supported collaborative learning. Proceedings of the ACM Conference on Supporting Group Work, ACM, 24--31. http://dx.doi.org/10.1145/500286.500293
[40]
Anita Williams Woolley, I. Aggarwal and Thomas W. Malone. 2015. Collective intelligence in teams and organizations. Malone, T.W. and Bernstein, M.S. eds. The handbook of collective intelligence, MIT Press, Cambridge, MA, in press.
[41]
Anita Williams Woolley, Christopher F. Chabris, Alex Pentland, Nada Hashmi and Thomas W. Malone. 2010. Evidence for a Collective Intelligence Factor in the Performance of Human Groups. Science, 330 (6004): 686--688. http://dx.doi.org/10.1126/science.1193147

Cited By

View all
  • (2024)Forming Shared Interest Pods: Barriers to Self-Assembly of Interest-Based Small Groups, and Dynamics of Retaining and Giving up Control to Find Collective FitProceedings of the ACM on Human-Computer Interaction10.1145/36869848:CSCW2(1-50)Online publication date: 8-Nov-2024
  • (2024)It was(n’t) me: vignette experiments on managers’ responsibility attribution in AI-advised decision-makingBehaviour & Information Technology10.1080/0144929X.2024.2431050(1-30)Online publication date: 26-Nov-2024
  • (2023)Collaborative Writing Skills Enhancement through the Use of Story JumperLATAM Revista Latinoamericana de Ciencias Sociales y Humanidades10.56712/latam.v4i5.13904:5Online publication date: 24-Nov-2023
  • Show More Cited By

Index Terms

  1. You Want Me to Work with Who?: Stakeholder Perceptions of Automated Team Formation in Project-based Courses

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
    May 2017
    7138 pages
    ISBN:9781450346559
    DOI:10.1145/3025453
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 May 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Badges

    • Best Paper

    Author Tags

    1. algorithms
    2. catme
    3. education
    4. team formation

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    CHI '17
    Sponsor:

    Acceptance Rates

    CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)201
    • Downloads (Last 6 weeks)21
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Forming Shared Interest Pods: Barriers to Self-Assembly of Interest-Based Small Groups, and Dynamics of Retaining and Giving up Control to Find Collective FitProceedings of the ACM on Human-Computer Interaction10.1145/36869848:CSCW2(1-50)Online publication date: 8-Nov-2024
    • (2024)It was(n’t) me: vignette experiments on managers’ responsibility attribution in AI-advised decision-makingBehaviour & Information Technology10.1080/0144929X.2024.2431050(1-30)Online publication date: 26-Nov-2024
    • (2023)Collaborative Writing Skills Enhancement through the Use of Story JumperLATAM Revista Latinoamericana de Ciencias Sociales y Humanidades10.56712/latam.v4i5.13904:5Online publication date: 24-Nov-2023
    • (2023)Composing Team Compositions: An Examination of Instructors' Current Algorithmic Team Formation PracticesProceedings of the ACM on Human-Computer Interaction10.1145/36100967:CSCW2(1-24)Online publication date: 4-Oct-2023
    • (2023)Retrospector: Rapid collaborative reflection to improve collaborative practicesProceedings of the ACM on Human-Computer Interaction10.1145/36100847:CSCW2(1-20)Online publication date: 4-Oct-2023
    • (2023)A systematic mapping study on group work research in computing education projectsJournal of Systems and Software10.1016/j.jss.2023.111795204:COnline publication date: 1-Oct-2023
    • (2023)The methodology of studying fairness perceptions in Artificial IntelligenceInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102954170:COnline publication date: 8-Feb-2023
    • (2023)CCTFv1: Computational Modeling of Cyber Team Formation StrategiesSocial, Cultural, and Behavioral Modeling10.1007/978-3-031-43129-6_20(199-208)Online publication date: 16-Sep-2023
    • (2023)Analysis of teamwork skill development in a flipped civil engineering courseComputer Applications in Engineering Education10.1002/cae.2268032:1Online publication date: 23-Sep-2023
    • (2022)In search of diverse and connected teams: A computational approach to assemble diverse teams based on members’ social networksPLOS ONE10.1371/journal.pone.027606117:11(e0276061)Online publication date: 9-Nov-2022
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media