Augmenting Embodied Sensemaking using VR-Enabled New and Unusual perspectives
Pages 917 - 923
Abstract
Since the launch of the first Oculus Developer Kit in 2013, consumer and commercial adoption of VR and AR technology has arrived beyond the early-adopter stage. This widespread availability of VR and AR headsets raises challenging and exciting questions for researchers in the field of embodied interaction: how do we design embodied interactions in VR? Can we improve (social) sensemaking beyond the natural body? What new opportunities for embodied interaction have presented themselves, thanks to this new technology, and how can we best use them? To address these questions, my research focuses on designing new interactions with VR systems that go beyond the (digital) gaming context, especially including tangible interactions from new and unusual perspectives, made possible by the new developments in the field of VR technologies. In my thesis, I aspire to present a framework of embodied sensemaking informed by new and unusual perspectives, enabled by virtual reality technology, developed in a Research through Design process.
References
[1]
Raul Altosaar, Adam Tindale, and Judith Doyle. 2019. Physically Colliding with Music: Full-body Interactions with an Audio-only Virtual Reality Interface. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '19). ACM, New York, NY, USA, 553--557. https://doi.org/10.1145/3294109.3301256 event-place: Tempe, Arizona, USA.
[2]
F. Argelaguet, L. Hoyet, M. Trico, and A. Lecuyer. 2016. The role of interaction in virtual embodiment: Effects of the virtual hand representation. In 2016 IEEE Virtual Reality (VR). 3--10. https://doi.org/10.1109/VR.2016.7504682
[3]
E. Bastug, M. Bennis, M. Medard, and M. Debbah. 2017. Toward Interconnected Virtual Reality: Opportunities, Challenges, and Enablers. IEEE Communications Magazine 55, 6 (June 2017), 110--117. https://doi.org/10.1109/MCOM.2017. 1601089
[4]
Susanne Bodker. 1995. Applying activity theory to video analysis: how to make sense of video data in human-computer interaction. In Context and consciousness, Bonnie A. Nardi (Ed.). Massachusetts Institute of Technology, Cambridge, MA, USA, 147--174.
[5]
Matthew Botvinick and Jonathan Cohen. 1998. Rubber hands 'feel' touch that eyes see. Nature 391, 6669 (Feb. 1998), 756. https://doi.org/10.1038/35784
[6]
Lucilla Cardinali, Claudio Brozzoli, and Alessandro Farn. 2009. Peripersonal Space and Body Schema: Two Labels for the Same Concept? Brain Topography 21, 3--4 (May 2009), 252--260. https://doi.org/10.1007/s10548-009-0092--7
[7]
Hanne De Jaegher and Ezequiel Di Paolo. 2007. Participatory sense-making. Phenomenology and the Cognitive Sciences 6, 4 (Dec. 2007), 485--507. https://doi.org/10.1007/s11097-007--9076--9
[8]
Paul Dourish. 2001. Where the action is: the foundations of embodied interaction. MIT Press, Cambridge, Mass.
[9]
Jan Gugenheimer, Evgeny Stemasov, Julian Frommel, and Enrico Rukzio. 2017. ShareVR: Enabling Co-Located Experiences for Virtual Reality between HMD and Non-HMD Users. ACM Press, 4021--4033. https://doi.org/10.1145/3025453.3025683
[10]
N. Henze and K. Kunze. 2017. A Dagstuhl Seminar Looks beyond Virtual and Augmented Reality. IEEE MultiMedia 24, 2 (April 2017), 14--17. https://doi.org/10.1109/MMUL.2017.35
[11]
Eva Hornecker and Jacob Buur. 2006. Getting a Grip on Tangible Interaction: A Framework on Physical Space and Social Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). ACM, New York, NY, USA, 437--446. https://doi.org/10.1145/1124772.1124838
[12]
Matthew Hudson and Paul Cairns. 2016. The effects of winning and losing on social presence in team-based digital games. Computers in Human Behavior 60 (2016), 1--12.
[13]
Caroline Hummels and Jelle van Dijk. 2015. Seven Principles to Design for Embodied Sensemaking. ACM Press, 21--28. https://doi.org/10.1145/2677199. 2680577
[14]
Ezequiel A. Di Paolo; Elena Clare Cuffari; Hanne De Jaegher. 2018. Linguistic Bodies: The Continuity Between Life and Language. MIT Press.
[15]
Shunichi Kasahara, Mitsuhito Ando, Kiyoshi Suganuma, and Jun Rekimoto. 2016. Parallel Eyes: Exploring Human Capability and Behaviors with Paralleled First Person View Sharing. In ACM SIGGRAPH 2016 VR Village (SIGGRAPH '16). ACM, New York, NY, USA, 16:1--16:2. https://doi.org/10.1145/2929490.2929495
[16]
S. Kasahara, S. Nagai, and J. Rekimoto. 2017. JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera. IEEE Transactions on Visualization and Computer Graphics 23, 3 (March 2017), 1222--1234. https://doi.org/10.1109/TVCG.2016.2642947
[17]
Konstantina Kilteni, Jean-Marie Normand, Maria V. Sanchez-Vives, and Mel Slater. 2012. Extending Body Space in Immersive Virtual Reality: A Very Long Arm Illusion. PLoS ONE 7, 7 (July 2012), e40867. https://doi.org/10.1371/journal.pone.0040867
[18]
Seungwon Kim, Gun Lee, Weidong Huang, Hayun Kim, Woontack Woo, and Mark Billinghurst. 2019. Evaluating the Combination of Visual Communication Cues for HMD-based Mixed Reality Remote Collaboration. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 173:1--173:13. https://doi.org/10.1145/3290605.3300403 event-place: Glasgow, Scotland Uk.
[19]
Elena Kokkinara, Mel Slater, and Joan LÃpez-Moliner. 2015. The Effects of Visuomotor Calibration to the Perceived Space and Body, Through Embodiment in Immersive Virtual Reality. ACM Trans. Appl. Percept. 13, 1 (Oct. 2015), 3:1--3:22. https://doi.org/10.1145/2818998
[20]
Tiffany C.K. Kwok, Peter Kiefer, Victor R. Schinazi, Benjamin Adams, and Martin Raubal. 2019. Gaze-Guided Narratives: Adapting Audio Guide Content to Gaze in Virtual and Real Environments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 491:1--491:12. https://doi.org/10.1145/3290605.3300721 event-place: Glasgow, Scotland Uk.
[21]
U. Lahiri, E. Bekele, E. Dohrmann, Z. Warren, and N. Sarkar. 2013. Design of a Virtual Reality Based Adaptive Response Technology for Children With Autism. IEEE Transactions on Neural Systems and Rehabilitation Engineering 21, 1 (Jan. 2013), 55--64. https://doi.org/10.1109/TNSRE.2012.2218618
[22]
Antonella Maselli and Mel Slater. 2013. The building blocks of the full body ownership illusion. Frontiers in Human Neuroscience 7 (March 2013). https: //doi.org/10.3389/fnhum.2013.00083
[23]
Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. ACM Press, 2143--2152. https://doi.org/10.1145/2702123.2702382
[24]
Maurice Merleau-Ponty and Colin Smith. 2002. Phenomenology of perception. Routledge, London; New York. OCLC: 70743537.
[25]
E. C. De Oliveira, P. Bertrand, M. E. R. Lesur, P. Palomo, M. Demarzo, A. Cebolla, R. Banos, and R. Tori. 2016. Virtual Body Swap: A New Feasible Tool to Be Explored in Health and Education. In 2016 XVIII Symposium on Virtual and Augmented Reality (SVR). 81--89. https://doi.org/10.1109/SVR.2016.23
[26]
Anne Pasek. 2014. Seeing Yourself Strangely: Media Mirroring and The Third Eye Project. (2014).
[27]
Thammathip Piumsomboon, Youngho Lee, Gun Lee, and Mark Billinghurst. 2017. CoVAR: A Collaborative Virtual and Augmented Reality System for Remote Collaboration. In SIGGRAPH Asia 2017 Emerging Technologies (SA '17). ACM, New York, NY, USA, 3:1--3:2. https://doi.org/10.1145/3132818.3132822
[28]
Karolien Poels, Yvonne AW de Kort, and Wijnand A IJsselsteijn. 2007. D3. 3: Game Experience Questionnaire: development of a self-report measure to assess the psychological impact of digital games. (2007).
[29]
Dorothé Smit, Thomas Grah, Martin Murer, Vincent van Rheden, and Manfred Tscheligi. 2018. MacroScope: First-Person Perspective in Physical Scale Models. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '18). ACM, New York, NY, USA, 253--259. https://doi.org/10.1145/3173225.3173276
[30]
Dorothé Smit, Andreas Lindlbauer, Martin Murer, Bart Hengeveld, and Manfred Tscheligi. 2019. Let the Bot Take Care of It: Exploring# CapIt, a Whiteboard Table Capture System. In Proceedings of 17th European Conference on Computer- Supported Cooperative Work. European Society for Socially Embedded Technologies (EUSSET).
[31]
Dorothé Smit, Bernhard Maurer, Martin Murer, Jens Reinhardt, and Katrin Wolf. 2019. Be the Meeple: New Perspectives on Traditional Board Games. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '19). ACM, New York, NY, USA, 695--698. https://doi.org/10.1145/3294109.3295657 event-place: Tempe, Arizona, USA.
[32]
Dorothé Smit, Martin Murer, Vincent van Rheden, Thomas Grah, and Manfred Tscheligi. 2017. The Evolution of a Scale Model as an Impromptu Design Tool. ACM Press, 233--245. https://doi.org/10.1145/3064663.3064797
[33]
Lucy Suchman. 1987. Plans and Situated Actions: the Problem of Human-Machine Communication. Cambridge University Press, New York.
[34]
Jakub Sypniewski, Jakub Rybar, Steven Beck Klingberg, and Robb Mitchell. 2018. Towards Dynamic Perspective Exchange in Physical Games. In CHI'18 Extended Abstracts. ACM, Montreal, Canada.
[35]
Luma Tabbaa, Chee Siang Ang, Vienna Rose, Panote Siriaraya, Inga Stewart, Keith G. Jenkins, and Maria Matsangidou. 2019. Bring the Outside In: Providing Accessible Experiences Through VR for People with Dementia in Locked Psychiatric Hospitals. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 236:1--236:15. https://doi.org/10.1145/3290605.3300466 event-place: Glasgow, Scotland Uk.
[36]
Balasaravanan Thoravi Kumaravel, Cuong Nguyen, Stephen DiVerdi, and Bjorn Hartmann. 2019. TutoriVR: A Video-Based Tutorial System for Design Applications in Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 284:1--284:12. https://doi.org/10.1145/3290605.3300514 event-place: Glasgow, Scotland Uk.
[37]
Manos Tsakiris, Matthew R. Longo, and Patrick Haggard. 2010. Having a body versus moving your body: Neural signatures of agency and bodyownership. Neuropsychologia 48, 9 (July 2010), 2740--2749. https://doi.org/10.1016/j.neuropsychologia.2010.05.021
[38]
Francisco J. Varela, Evan Thompson, and Eleanor Rosch. 1993. The embodied mind: cognitive science and human experience. MIT Press, Cambridge, Mass.
[39]
Karl E. Weick, Kathleen M. Sutcliffe, and David Obstfeld. 2005. Organizing and the Process of Sensemaking. Organization Science 16, 4 (2005), 409--421. https://doi.org/.https://doi.org/10.1287/orsc.1050.0133
[40]
Julie R. Williamson, Mark McGill, and Khari Outram. 2019. PlaneVR: Social Acceptability of Virtual Reality for Aeroplane Passengers. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, 80:1--80:14. https://doi.org/10.1145/3290605.3300310 event-place: Glasgow, Scotland Uk.
[41]
Margaret Wilson. 2002. Six views of embodied cognition. Psychonomic bulletin & review 9, 4 (2002), 625--636.
[42]
Terry Winograd. 1986. A language/action perspective on the design of cooperative work. In Proceedings of the 1986 ACM conference on Computer-supported cooperative work. ACM, New York, NY, USA? 203--220. https://doi.org/10.1145/637069.637096
[43]
Bob G Witmer and Michael J Singer. 1998. Measuring presence in virtual environments: A presence questionnaire. Presence 7, 3 (1998), 225--240.
[44]
Teser Wong and Denise Y. P. Henriques. 2009. Visuomotor Adaptation Does Not Recalibrate Kinesthetic Sense of Felt Hand Path. Journal of Neurophysiology 101, 2 (Feb. 2009), 614--623. https://doi.org/10.1152/jn.90544.2008
[45]
Pawel Wozniak, Nitesh Goyal, Przemyslaw Kucharski, Lars Lischke, Sven Mayer, and Morten Fjeld. 2016. RAMPARTS: Supporting Sensemaking with Spatially- Aware Mobile Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2447--2460.
[46]
John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 493--502
Index Terms
- Augmenting Embodied Sensemaking using VR-Enabled New and Unusual perspectives
Recommendations
Three Perspectives on Embodied Learning in Virtual Reality: Opportunities for Interaction Design
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing SystemsWith the fast evolution of Virtual Reality (vr) technology, new prospects opened for embodied learning. Learners can now manipulate digital representations of abstract concepts and make sense of them through sensorimotor stimulation. However, in ...
Immersive Analytics 2.0: Spatial and Embodied Sensemaking
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing SystemsImmersive Analytics is now a fully emerged research topic that spans several research communities, including Human-Computer Interaction, Data Visualisation, Virtual Reality and Augmented Reality. Immersive Analytics research has identified and ...
Charged Utopia VR: Exploring Embodied Sense-making in the Virtual Space
TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied InteractionThis paper reports on preliminary results of a design research project that explores how spaces in virtual reality may be designed to build on qualities of embodied sensemaking. The project forms a basis for the exploration of an ethical dimension to ...
Comments
Information & Contributors
Information
Published In
February 2020
978 pages
ISBN:9781450361071
DOI:10.1145/3374920
- General Chairs:
- Elise van den Hoven,
- Lian Loke,
- Program Chairs:
- Orit Shaer,
- Jelle van Dijk,
- Andrew Kun
Copyright © 2020 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 February 2020
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
TEI '20
Sponsor:
TEI '20: Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction
February 9 - 12, 2020
Sydney NSW, Australia
Acceptance Rates
TEI '20 Paper Acceptance Rate 37 of 132 submissions, 28%;
Overall Acceptance Rate 393 of 1,367 submissions, 29%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 384Total Downloads
- Downloads (Last 12 months)26
- Downloads (Last 6 weeks)2
Reflects downloads up to 08 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in