ABSTRACT
Computer-mediated communication is being adopted in work and personal life around the world. Measuring collaborative performance would be useful for evaluating and optimizing social computing applications, but there is a lack of methods for it. For this purpose, we have developed a collaborative block design task, which requires collaboration and depends on simple and abstract rules. The task is about constructing three-dimensional structures out of primitive shapes based on cards representing two-dimensional flat projections of the complete structure. The task is presented as a physical version, which can be manufactured using a 3D printer and a laser cutter, as well as a virtual version which is released as an open source VRChat world created in Unity, and as task components which can be imported into any virtual 3D environment. The task can be used for evaluating systems and augmentations for their fitness for collaboration, as well as to investigate other phenomena which seem to be linked with better cooperation, such as inter-individual and inter-brain synchronization.
Supplemental Material
Available for Download
- Jeremy Bailenson. 2018. Bringing social back to the network. In Experience on demand: What virtual reality is, how it works, and what it can do. WW Norton & Company, New York, NY, USA.Google Scholar
- Aruna D. Balakrishnan, Susan R. Fussell, and Sara Kiesler. 2008. Do visualizations improve synchronous remote collaboration?. In Proceedings of the 2008 SIGCHI Conference on Human Factors in Computing Systems (CHI ’08). ACM, New York, NY, USA, 1227–1236. https://doi.org/10.1145/1357054.1357246Google ScholarDigital Library
- Merja Bauters, Jana Pejoska, Eva Durall, Katri Saarikivi, Valtteri Wikström, Mari Falcon, and Silja Martikainen. 2021. Are you there? Presence in collaborative distance work. Human Technology 17, 3 (Dec. 2021), 261–293. https://doi.org/10.14254/1795-6889.2021.17-3.5Google ScholarCross Ref
- Rahul Bhargava. 2010. BoxDesigner. Northeastern University, MIT Media Lab, and Connection Lab. https://boxdesigner.connectionlab.org/Accessed: 8 Jan 2022.Google Scholar
- Irina R. Brich, Inga M. Bause, Friedrich W. Hesse, and Ann-Katrin Wesslein. 2019. Working memory affine technological support functions improve decision performance. Computers in Human Behavior 92 (2019), 238–249. https://doi.org/10.1016/j.chb.2018.11.014Google ScholarDigital Library
- Prerna Chikersal, Maria Tomprou, Young Ji Kim, Anita W. Woolley, and Laura Dabbish. 2017. Deep Structures of Collaboration. In Proceedings of the 2017 ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW ’17). ACM, New York, NY, USA, 873–888. https://doi.org/10.1145/2998181.2998250Google ScholarDigital Library
- VRChat documentation. 2022. Worlds. VRChat. https://docs.vrchat.com/docs/worldsAccessed: 8 Jan 2022.Google Scholar
- David Engel, Anita W. Woolley, Lisa X. Jing, Christopher F. Chabris, and Thomas W. Malone. 2014. Reading the Mind in the Eyes or Reading between the Lines? Theory of Mind Predicts Collective Intelligence Equally Well Online and Face-To-Face. PLoS ONE 9, 12 (December 2014), e115212. https://doi.org/10.1371/journal.pone.0115212Google ScholarCross Ref
- Milou A. Feijt, Joyce H.D.M. Westerink, Yvonne A.W. De Kort, and Wijnand A. IJsselsteijn. 2021. Sharing biosignals: An analysis of the experiential and communication properties of interpersonal psychophysiology. Human–Computer Interaction 0, 0 (2021), 1–30. https://doi.org/10.1080/07370024.2021.1913164Google Scholar
- Shaun Gallagher. 2008. Direct perception in the intersubjective context. Consciousness and Cognition 17, 2 (2008), 535–543. https://doi.org/10.1016/j.concog.2008.03.003Google ScholarCross Ref
- William Gibson. 1984. Neuromancer. Ace Books, New York, NY, USA.Google Scholar
- Martin D. Hassell and John L. Cotton. 2017. Some things are better left unseen: Toward more effective communication and team performance in video-mediated interactions. Computers in Human Behavior 73 (2017), 200–208. https://doi.org/10.1016/j.chb.2017.03.039Google ScholarDigital Library
- Samuel C. Kohs. 1920. The Block-Design Tests.Journal of Experimental Psychology 3, 5 (1920), 357–376. https://doi.org/10.1037/h0074466Google Scholar
- J. E. McGrath. 1984. A Typology of Tasks. In Groups: Interaction and Performance. Prentice-Hall, Englewood Cliffs, NJ, USA, 53–66.Google Scholar
- Meta. 2021. The Metaverse and How We’ll Build It Together – Connect 2021. Youtube. https://www.youtube.com/watch?v=Uvufun6xer8Accessed: 8 Jan 2022.Google Scholar
- Henrike Moll, Ellyn Pueschel, Qianhui Ni, and Alexandra Little. 2021. Sharing Experiences in Infancy: From Primary Intersubjectivity to Shared Intentionality. Frontiers in Psychology 12 (2021), 2437. https://doi.org/10.3389/fpsyg.2021.667679Google ScholarCross Ref
- Diego A. Reinero, Suzanne Dikker, and Jay J. Van Bavel. 2020. Inter-brain synchrony in teams predicts collective performance. Social Cognitive and Affective Neuroscience 16, 1-2 (09 2020), 43–57. https://doi.org/10.1093/scan/nsaa135Google Scholar
- Fazilat Siddiq and Ronny Scherer. 2017. Revealing the processes of students’ interaction with a novel collaborative problem solving task: An in-depth analysis of think-aloud protocols. Computers in Human Behavior 76 (2017), 509–525. https://doi.org/10.1016/j.chb.2017.08.007Google ScholarDigital Library
- Caroline Szymanski, Ana Pesquita, Allison A. Brennan, Dionysios Perdikis, James T. Enns, Timothy R. Brick, Viktor Müller, and Ulman Lindenberger. 2017. Teams on the same wavelength perform better: Inter-brain phase synchronization constitutes a neural substrate for social facilitation. NeuroImage 152(2017), 425 – 436. https://doi.org/10.1016/j.neuroimage.2017.03.013Google ScholarCross Ref
- Valtteri Wikström, Silja Martikainen, Mari Falcon, Juha Ruistola, and Katri Saarikivi. 2020. Collaborative block design task for assessing pair performance in virtual reality and reality. Heliyon 6, 9 (2020), e04823. https://doi.org/10.1016/j.heliyon.2020.e04823Google ScholarCross Ref
Recommendations
Team collaboration in virtual worlds
Are virtual worlds more or less effective for virtual team collaboration? We suggest that the answer to this question is complicated and dependent upon a number of factors, and we propose a research agenda with theoretical bases to guide researchers in ...
Gender Effects on Collaborative Online Brainstorming Teamwork
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsIt is common for individuals with diverse demographic backgrounds to collaborate through computer-mediated communication (CMC) technologies. Groups with internal diversity are typically considered to be advantageous to group performance due to the ...
Experiments comparing face-to-face with virtual collaborative learning
CSCL '99: Proceedings of the 1999 conference on Computer support for collaborative learningWe report on set of studies conducted over two years involving over 1000 students at two universities. The main study compares three conditions: conventional classroom lecture, a face-to-face collaborative learning technique called Tutored Video ...
Comments