research-article

Immersive Video Sketching: Low-Fidelity Extended Reality Prototyping for Everyone

Authors:

Oğuz Turan Buruk,

Juho HamariAuthors Info & Claims

Academic Mindtrek '21: Proceedings of the 24th International Academic Mindtrek Conference

Pages 165 - 175

https://doi.org/10.1145/3464327.3464330

Published: 07 September 2021 Publication History

Abstract

As the extended reality (XR) field advance, the need for tools assisting designers in the early-design phases for these immersive environments also increases. Although several tools exist, we still need a method that allows non-experts to engage in designing for XR, especially for collaborative contexts such as participatory design (PD) workshops. In this paper, we introduce Immersive Video Sketching (IVS), a low-cost prototyping method for early-phase XR design that can be easily employed by novice and non-expert designers. IVS combines body storming, paper prototyping and video sketching for XR environments. We tested IVS with 23 participants in a PD session focusing on XR game wearables. Our results showed that IVS can help non-experts to grasp the immersive nature of XR environments easily. On the other hand, a 4-hour design session might not be enough for iterations on design ideas and different design skills might create discrepancies in the outcomes.

Supplementary Material

p165-buruk-supplement (p165-buruk-supplement.pdf)

Transcripts and the coding of the user feedback, Answers of participants to ease of use and usefulness questions, Spatial usage analysis of each frame in projects

Download
30.22 MB

References

[1]

Telmo Adão, Luís Pádua, Miguel Fonseca, Luís Agrellos, Joaquim J Sousa, Luís Magalhães, and Emanuel Peres. 2018. A rapid prototyping tool to produce 360° video-based immersive experiences enhanced with virtual/multimedia elements. Procedia computer science 138 (2018), 441–453.

[2]

Rahul Arora, Rubaiat Habib Kazi, Tovi Grossman, George Fitzmaurice, and Karan Singh. 2018. Symbiosissketch: Combining 2d & 3d sketching for designing detailed 3d objects in situ. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–15.

Digital Library

[3]

Narges Ashtari, Andrea Bunt, Joanna McGrenere, Michael Nebeling, and Parmit K. Chilana. 2020. Creating Augmented and Virtual Reality Applications: Current Practices, Challenges, and Opportunities. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376722

Digital Library

[4]

Marie Beuthel and Anne Wohlauf. 2017. Participatory Design 101: Co-Creating Tangible User Interfaces to Enrich a Business Trip Experience. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (Yokohama, Japan) (TEI ’17). Association for Computing Machinery, New York, NY, USA, 781–784. https://doi.org/10.1145/3024969.3025052

Digital Library

[5]

Frank Biocca and Ben Delaney. 1995. Immersive virtual reality technology. Communication in the age of virtual reality 15, 32 (1995), 10–5555.

[6]

Costas Boletsis, Amela Karahasanovic, and Annita Fjuk. 2017. Virtual bodystorming: Utilizing virtual reality for prototyping in service design. In International Conference on Augmented Reality, Virtual Reality and Computer Graphics. Springer, 279–288.

[7]

Marion Buchenau and Jane Fulton Suri. 2000. Experience prototyping. In Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques. 424–433.

Digital Library

[8]

Oğuz Turan Buruk and Oğuzhan Özcan. 2018. Extracting Design Guidelines for Wearables and Movement in Tabletop Role-Playing Games via a Research Through Design Process. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 513.

Digital Library

[9]

Bill Buxton. 2010. Sketching user experiences: getting the design right and the right design. Morgan kaufmann.

[10]

Arzu Çöltekin, Ian Lochhead, Marguerite Madden, Sidonie Christophe, Alexandre Devaux, Christopher Pettit, Oliver Lock, Shashwat Shukla, Lukáš Herman, Zdeněk Stachoň, 2020. Extended Reality in Spatial Sciences: A Review of Research Challenges and Future Directions. ISPRS International Journal of Geo-Information 9, 7(2020), 439.

[11]

Michela Cozza, Linda Tonolli, and Vincenzo D’Andrea. 2016. Subversive Participatory Design: Reflections on a Case Study. In Proceedings of the 14th Participatory Design Conference: Short Papers, Interactive Exhibitions, Workshops - Volume 2 (Aarhus, Denmark) (PDC ’16). Association for Computing Machinery, New York, NY, USA, 53–56. https://doi.org/10.1145/2948076.2948085

Digital Library

[12]

Nils Dahlbäck, Arne Jönsson, and Lars Ahrenberg. 1993. Wizard of Oz studies: why and how. In Proceedings of the 1st international conference on Intelligent user interfaces. 193–200.

Digital Library

[13]

Scott Davidoff, Min Kyung Lee, Anind K Dey, and John Zimmerman. 2007. Rapidly exploring application design through speed dating. In International Conference on Ubiquitous Computing. Springer, 429–446.

[14]

Rhian Davies, Skip Marcella, Joanna McGrenere, and Barbara Purves. 2003. The ethnographically informed participatory design of a PD application to support communication. ACM SIGACCESS Accessibility and Computing77-78 (2003), 153–160.

[15]

Tobias Drey, Jan Gugenheimer, Julian Karlbauer, Maximilian Milo, and Enrico Rukzio. 2020. VRSketchIn: Exploring the Design Space of Pen and Tablet Interaction for 3D Sketching in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[16]

Eivind Flobak, Jo D Wake, Joakim Vindenes, Smiti Kahlon, Tine Nordgreen, and Frode Guribye. 2019. Participatory Design of VR Scenarios for Exposure Therapy. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[17]

Laura Freina and Michela Ott. 2015. A literature review on immersive virtual reality in education: state of the art and perspectives. In The international scientific conference elearning and software for education, Vol. 1. 10–1007.

[18]

Alexandra Fuchs, Miriam Sturdee, and Johannes Schöning. 2018. Foldwatch: using origami-inspired paper prototypes to explore the extension of output space in smartwatches. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction. 47–59.

Digital Library

[19]

Çağlar Genç, Oğuz Turan Buruk, Sejda İnal Yılmaz, Kemal Can, and Oğuzhan Özcan. 2018. Exploring computational materials for fashion: Recommendations for designing fashionable wearables. International Journal of Design 12, 3 (2018), 1–19.

[20]

Kristina Höök, Martin P Jonsson, Anna Ståhl, and Johanna Mercurio. 2016. Somaesthetic appreciation design. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3131–3142.

Digital Library

[21]

Hsiu-Fang Hsieh and Sarah E Shannon. 2005. Three approaches to qualitative content analysis. Qualitative health research 15, 9 (2005), 1277–1288.

[22]

Charlene Jennett, Anna L Cox, Paul Cairns, Samira Dhoparee, Andrew Epps, Tim Tijs, and Alison Walton. 2008. Measuring and defining the experience of immersion in games. International journal of human-computer studies 66, 9 (2008), 641–661.

Digital Library

[23]

Julia M Juliano, Ryan P Spicer, Athanasios Vourvopoulos, Stephanie Lefebvre, Kay Jann, Tyler Ard, Emiliano Santarnecchi, David M Krum, and Sook-Lei Liew. 2020. Embodiment is related to better performance on a brain–computer interface in immersive virtual reality: A pilot study. Sensors 20, 4 (2020), 1204.

[24]

Saara Kamppari-Miller. 2017. VR Paper Prototyping. https://blog.prototypr.io/vr-paper-prototyping-9e1cab6a75f3

[25]

Giorgio Klauer, Annalisa Metus, and Pietro Polotti. 2017. Sonic Interaction Design for Paper Wearables. In Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences(London, United Kingdom) (AM ’17). Association for Computing Machinery, New York, NY, USA, Article 49, 7 pages. https://doi.org/10.1145/3123514.3123533

Digital Library

[26]

Felix Lauber, Claudius Böttcher, and Andreas Butz. 2014. Papar: Paper prototyping for augmented reality. In Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 1–6.

Digital Library

[27]

Gun A. Lee, Gerard J. Kim, and Mark Billinghurst. 2005. Immersive Authoring: What You EXperience Is What You Get (WYXIWYG). Commun. ACM 48, 7 (July 2005), 76–81. https://doi.org/10.1145/1070838.1070840

Digital Library

[28]

Ji-hye Lee, Lily Diaz-Kommonen, and Yu Xiao. 2019. Applying Embodied Design Improvisation for Physical Interaction in Augmented and Virtual Reality. Archives of Design Research 32, 2 (2019), 5–17.

[29]

Germán Leiva, Cuong Nguyen, Rubaiat Habib Kazi, and Paul Asente. 2020. Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and Enaction. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[30]

Elena Márquez Segura, Laia Turmo Vidal, Asreen Rostami, and Annika Waern. 2016. Embodied sketching. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 6014–6027.

Digital Library

[31]

Joshua McVeigh-Schultz, Max Kreminski, Keshav Prasad, Perry Hoberman, and Scott S. Fisher. 2018. Immersive Design Fiction: Using VR to Prototype Speculative Interfaces and Interaction Rituals within a Virtual Storyworld. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS ’18). Association for Computing Machinery, New York, NY, USA, 817–829. https://doi.org/10.1145/3196709.3196793

Digital Library

[32]

Vangelis Metsis, Grayson Lawrence, Mark Trahan, Kenneth S Smith, Dan Tamir, and Katherine Selber. 2019. 360 Video: A prototyping process for developing virtual reality interventions. Journal of Technology in Human Services 37, 1 (2019), 32–50.

[33]

Mei Miao, Wiebke Köhlmann, Maria Schiewe, and Gerhard Weber. 2009. Tactile paper prototyping with blind subjects. In International Conference on Haptic and Audio Interaction Design. Springer, 81–90.

Digital Library

[34]

Michael Nebeling, Katy Lewis, Yu-Cheng Chang, Lihan Zhu, Michelle Chung, Piaoyang Wang, and Janet Nebeling. 2020. XRDirector: A Role-Based Collaborative Immersive Authoring System. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[35]

Michael Nebeling and Katy Madier. 2019. 360proto: Making Interactive Virtual Reality & Augmented Reality Prototypes from Paper. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[36]

Michael Nebeling, Janet Nebeling, Ao Yu, and Rob Rumble. 2018. Protoar: Rapid physical-digital prototyping of mobile augmented reality applications. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[37]

Michael Nebeling and Maximilian Speicher. 2018. The trouble with augmented reality/virtual reality authoring tools. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, 333–337.

[38]

Helen Oliver. 2019. Participatory design fiction for innovation in everyday wearable IoT systems: demo abstract. In Proceedings of the International Conference on Internet of Things Design and Implementation. 285–286.

Digital Library

[39]

Antti Oulasvirta, Esko Kurvinen, and Tomi Kankainen. 2003. Understanding contexts by being there: case studies in bodystorming. Personal and ubiquitous computing 7, 2 (2003), 125–134.

[40]

René Petersen. 2015. BODYSTORMING morphing chair. https://www.youtube.com/watch?v=4FH_6k6jVWc

[41]

David Porfirio, Evan Fisher, Allison Sauppé, Aws Albarghouthi, and Bilge Mutlu. 2019. Bodystorming Human-Robot Interactions. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 479–491. https://doi.org/10.1145/3332165.3347957

Digital Library

[42]

Maria Roussou, Elina Kavalieratou, and Michael Doulgeridis. 2007. Children designers in the museum: applying participatory design for the development of an art education program. In Proceedings of the 6th international conference on Interaction design and children. 77–80.

Digital Library

[43]

Donald A Schon. 1984. The reflective practitioner: How professionals think in action. Vol. 5126. Basic books.

[44]

Carolyn Snyder. 2003. Paper prototyping: The fast and easy way to design and refine user interfaces. Morgan Kaufmann.

[45]

Melissa Qingqing Teng, James Hodge, and Eric Gordon. 2019. Participatory Design of a Virtual Reality-Based Reentry Training with a Women’s Prison. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1–8.

Digital Library

[46]

Mamello Thinyane, Karthik Bhat, Lauri Goldkind, and Vikram Kamath Cannanure. 2018. Critical Participatory Design: Reflections on Engagement and Empowerment in a Case of a Community Based Organization. In Proceedings of the 15th Participatory Design Conference: Full Papers - Volume 1 (Hasselt and Genk, Belgium) (PDC ’18). Association for Computing Machinery, New York, NY, USA, Article 2, 10 pages. https://doi.org/10.1145/3210586.3210601

Digital Library

[47]

Ashley Williams. 2002. Assessing prototypes’ role in design. In Proceedings of the 20th annual international conference on Computer documentation. 248–257.

Digital Library

[48]

Karl DD Willis, Juncong Lin, Jun Mitani, and Takeo Igarashi. 2010. Spatial sketch: bridging between movement & fabrication. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction. 5–12.

Digital Library

[49]

Mike Wu, Brian Richards, and Ron Baecker. 2004. Participatory Design with Individuals Who Have Amnesia. In Proceedings of the Eighth Conference on Participatory Design: Artful Integration: Interweaving Media, Materials and Practices - Volume 1 (Toronto, Ontario, Canada) (PDC 04). Association for Computing Machinery, New York, NY, USA, 214–223. https://doi.org/10.1145/1011870.1011895

Digital Library

[50]

Mah Zai. 2014. Bodystorming movie ticket prototype. https://www.youtube.com/watch?v=AoWAnY2La5k&t=99s

[51]

J. Zauner, M. Haller, A. Brandl, and W. Hartman. 2003. Authoring of a mixed reality assembly instructor for hierarchical structures. In The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings.237–246.

[52]

John Zimmerman. 2005. Video Sketches: Exploring pervasive computing interaction designs. IEEE pervasive computing 4, 4 (2005), 91–94.

Cited By

Pohl HHornbæk K(2024)Integrated Calculators: Moving Calculation into the WorldProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661523(343-355)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661523
Nguyen QWindisch AKriglstein S(2024)Between Two Worlds: Analysing the Effects of Immersive and Non-Immersive Prototyping for Participatory DesignProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660715(2198-2212)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660715
Lyu QWatanabe KUmemura HMurai A(2023)Design-thinking skill enhancement in virtual reality: A literature studyFrontiers in Virtual Reality10.3389/frvir.2023.11372934Online publication date: 4-Apr-2023
https://doi.org/10.3389/frvir.2023.1137293
Show More Cited By

Recommendations

Shared Reconstructed Environments in Extended Reality
SVR '24: Proceedings of the 26th Symposium on Virtual and Augmented Reality

Modern extended reality headsets can identify the geometry of the physical surrounding space, which can be shared and synchronized with remote users, allowing them to view the space through their own extended reality headsets from different points of ...
An Exploration of Low-Fidelity Prototyping Methods for Augmented and Virtual Reality
Design, User Experience, and Usability. Design for Contemporary Interactive Environments
Abstract
Low-fidelity prototyping is well-established method of developing concepts for traditional two-dimensional user interfaces. This paper considers the techniques and methods that can be used for simulating and early testing of augmented and virtual ...
User Experience Guidelines for Designing HMD Extended Reality Applications
Human-Computer Interaction – INTERACT 2019
Abstract
With the rise of Extended Reality (XR) technologies, such as head mounted displays (HMD) for Virtual Reality (VR), Mixed Reality (MR), and Augmented Reality (AR), designers are presented with many unique challenges and opportunities when creating ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

Academic Mindtrek '21: Proceedings of the 24th International Academic Mindtrek Conference

June 2021

229 pages

ISBN:9781450385145

DOI:10.1145/3464327

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

European Union?s Horizon 2020 - Marie Sklodowska-Curie Individual Fellowship

Conference

Mindtrek '21

Mindtrek '21: Academic Mindtrek 2021

June 1 - 3, 2021

Tampere/Virtual, Finland

Acceptance Rates

Overall Acceptance Rate 110 of 207 submissions, 53%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
320
Total Downloads

Downloads (Last 12 months)62
Downloads (Last 6 weeks)13

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Pohl HHornbæk K(2024)Integrated Calculators: Moving Calculation into the WorldProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661523(343-355)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661523
Nguyen QWindisch AKriglstein S(2024)Between Two Worlds: Analysing the Effects of Immersive and Non-Immersive Prototyping for Participatory DesignProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660715(2198-2212)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660715
Lyu QWatanabe KUmemura HMurai A(2023)Design-thinking skill enhancement in virtual reality: A literature studyFrontiers in Virtual Reality10.3389/frvir.2023.11372934Online publication date: 4-Apr-2023
https://doi.org/10.3389/frvir.2023.1137293
Börütecene A(2023)Bodystorming for VR in the Dark: Using Glow Sticks for Ideation and Rapid Prototyping2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW58643.2023.00121(547-550)Online publication date: Mar-2023
https://doi.org/10.1109/VRW58643.2023.00121
Madariaga LAllendes CNussbaum MBarrios GAcevedo N(2023)Offline and online user experience of gamified robotics for introducing computational thinkingComputers & Education10.1016/j.compedu.2022.104664193:COnline publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1016/j.compedu.2022.104664

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten