skip to main content
10.1145/3461778.3462088acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article

Vivian: A Technical Framework for Deploying and Operating Virtual Prototypes in XR

Published: 28 June 2021 Publication History

Abstract

In this paper, we describe Vivian, a technical framework for deploying and operating Virtual Prototypes (VPs) in Virtual and Augmented Reality (XR). Vivian is based on a static model of a VP, e.g., a microwave oven. We extend this model with a functionality specification describing the intended functionality of the VP. Based on this, the Vivian Framework is capable of deploying the VP in XR, i.e., on a desktop PC, in mobile AR, and in VR, as well as providing an interaction with it. Through this, it lays the basis for fast and efficient usability evaluations of VPs, which may also take place in a remote fashion. We evaluated the Vivian Framework by modeling and interacting with four VPs. Our study shows that the principles of Vivian cover many aspects to model VPs and their functionality, but that it also has some limitations, e.g., regarding the modeling complexity.

Supplementary Material

Vivian replication kit (vivian-replication-kit.zip)
MP4 File (VivianVideoFigure.mp4)
Supplemental video

References

[1]
Susanna Aromaa, Simo-Pekka Leino, and J Viitaniemi. 2014. Virtual prototyping in human-machine interaction design. VTT Technology 185(2014).
[2]
Loris Barbieri, Agostino Angilica, Fabio Bruno, and Maurizio Muzzupappa. 2013. Mixed prototyping with configurable physical archetype for usability evaluation of product interfaces. Computers in Industry 64, 3 (2013), 310 – 323. https://doi.org/10.1016/j.compind.2012.11.010
[3]
Monica Bordegoni, Umberto Cugini, Giandomenico Caruso, and Samuele Polistina. 2009. Mixed prototyping for product assessment: a reference framework. International Journal on Interactive Design and Manufacturing (IJIDeM) 3, 3 (01 Aug 2009), 177–187. https://doi.org/10.1007/s12008-009-0073-9
[4]
Monica Bordegoni and Francesco Ferrise. 2013. Designing interaction with consumer products in a multisensory virtual reality environment. Virtual and Physical Prototyping 8, 1 (2013), 51–64. https://doi.org/10.1080/17452759.2012.762612 arXiv:https://doi.org/10.1080/17452759.2012.762612
[5]
Fabio Bruno and Maurizio Muzzupappa. 2010. Product interface design: A participatory approach based on virtual reality. International Journal of Human-Computer Studies 68, 5 (2010), 254 – 269. https://doi.org/10.1016/j.ijhcs.2009.12.004
[6]
Marina Carulli, Monica Bordegoni, and Umberto Cugini. 2013. An approach for capturing the Voice of the Customer based on Virtual Prototyping. Journal of Intelligent Manufacturing 24, 5 (01 Oct 2013), 887–903. https://doi.org/10.1007/s10845-012-0662-5
[7]
Julien Casarin, Dominique Bechmann, and Marilyn Keller. 2017. A Unified Model for Interaction in 3D Environment. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology (Gothenburg, Sweden) (VRST ’17). Association for Computing Machinery, New York, NY, USA, Article 23, 7 pages. https://doi.org/10.1145/3139131.3139140
[8]
Julien Casarin, Nicolas Pacqueriaud, and Dominique Bechmann. 2018. UMI3D: A Unity3D Toolbox to Support CSCW Systems Properties in Generic 3D User Interfaces. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 29 (Nov. 2018), 20 pages. https://doi.org/10.1145/3274298
[9]
HTC Corporation. 2020. Vive. https://www.vive.com/ retrieved 3/2020.
[10]
Microsoft Corporation. 2020. HoloLens 2. https://www.microsoft.com/en-CY/hololens retrieved 03/2020.
[11]
G. Di Gironimo, G. Matrone, A. Tarallo, M. Trotta, and A. Lanzotti. 2013. A virtual reality approach for usability assessment: case study on a wheelchair-mounted robot manipulator. Engineering with Computers 29, 3 (2013), 359–373. https://doi.org/10.1007/s00366-012-0274-x
[12]
Blender Foundation. 2020. Blender. https://www.blender.org/ retrieved 3/2020.
[13]
Metaverse Technologies FRANCE. 2020. PiXYZ Software. https://www.pixyz-software.com/ retrieved 3/2020.
[14]
Sascha Gebhardt, Till Petersen-Krau, Sebastian Pick, Dominik Rausch, Christian Nowke, Thomas Knott, Patric Schmitz, Daniel Zielasko, Bernd Hentschel, and Torsten W. Kuhlen. 2016. Vista Widgets: A Framework for Designing 3D User Interfaces from Reusable Interaction Building Blocks. In Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology (Munich, Germany) (VRST ’16). ACM, New York, NY, USA, 251–260. https://doi.org/10.1145/2993369.2993382
[15]
Google LLC. 2020. ARCore. https://developers.google.com/ar/ retrieved 03/2020.
[16]
Patrick Harms, Nico Funke, and Chris Warin. 2021. Vivifly. https://gitlab.com/usability-engineering-ar-mr-vr/vivian-ui/vivifly retrieved 4/2021.
[17]
Quinate Chioma Ihemedu-Steinke, Rainer Erbach, Prashanth Halady, Gerrit Meixner, and Michael Weber. 2017. Virtual Reality Driving Simulator Based on Head-Mounted Displays. Springer International Publishing, Cham, 401–428. https://doi.org/10.1007/978-3-319-49448-7_15
[18]
Dong-Sik Jo, Ung-Yeon Yang, and Wook-Ho Son. 2008. Design Evaluation System with Visualization and Interaction of Mobile Devices Based on Virtual Reality Prototypes. ETRI Journal 30, 6 (2008), 757–764. https://doi.org/10.4218/etrij.08.0108.0209 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.4218/etrij.08.0108.0209
[19]
Satoshi Kanai, Taiga Higuchi, and Yukiaki Kikuta. 2009. 3D digital prototyping and usability enhancement of information appliances based on UsiXML. International Journal on Interactive Design and Manufacturing (IJIDeM) 3, 3 (01 Aug 2009), 201–222. https://doi.org/10.1007/s12008-009-0075-7
[20]
C. Kecher and A. Salvanos. 2015. UML 2.5: das umfassende Handbuch ; [UML lernen und effektiv in Projekten einsetzen; alle Diagramme und Notationselemente im Überblick; mit zahlreichen Praxisbeispielen in Java und C#; inkl. Poster mit allen Diagrammtypen]. Rheinwerk Verlag.
[21]
M. Kerttula, M. Salmela, and M. Heikkinen. 1997. Virtual reality prototyping-a framework for the development of electronics and telecommunication products. In Proceedings 8th IEEE International Workshop on Rapid System Prototyping Shortening the Path from Specification to Prototype. 2–11. https://doi.org/10.1109/IWRSP.1997.618812
[22]
K. Kuutti, K. Battarbee, S. Sade, T. Mattelmaki, T. Keinonen, T. Teirikko, and A. M. Tornberg. 2001. Virtual prototypes in usability testing. In Proceedings of the 34th Annual Hawaii International Conference on System Sciences. 7 pp.–. https://doi.org/10.1109/HICSS.2001.926545
[23]
Alyona Morozova, Verena Rheinstädter, and Dieter Wallach. 2019. MixedUX: A Mixed Prototyping Framework for Usability Testing in Augmented Reality. In Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion (San Diego, CA, USA) (DIS ’19 Companion). Association for Computing Machinery, New York, NY, USA, 41–44. https://doi.org/10.1145/3301019.3325146
[24]
David Navarre, Philippe Palanque, Jean-Francois Ladry, and Eric Barboni. 2009. ICOs: A Model-Based User Interface Description Technique Dedicated to Interactive Systems Addressing Usability, Reliability and Scalability. ACM Trans. Comput.-Hum. Interact. 16, 4, Article 18 (Nov. 2009), 56 pages. https://doi.org/10.1145/1614390.1614393
[25]
M. Nebeling and M. Speicher. 2018. The Trouble with Augmented Reality/Virtual Reality Authoring Tools. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 333–337.
[26]
Alex Olwal and Steven Feiner. 2004. Unit: Modular Development of Distributed Interaction Techniques for Highly Interactive User Interfaces. In Proceedings of the 2nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia (Singapore) (GRAPHITE ’04). Association for Computing Machinery, New York, NY, USA, 131–138. https://doi.org/10.1145/988834.988857
[27]
Hyungjun Park, Hee-Cheol Moon, and Jae Yeol Lee. 2009. Tangible augmented prototyping of digital handheld products. Computers in Industry 60, 2 (2009), 114–125. https://doi.org/10.1016/j.compind.2008.09.001
[28]
Fabio Paternò. 2003. Tools for Remote Web Usability Evaluation. In HCI International 2003. Proceedings of the 10th International Conference on Human-Computer Interaction. Vol.1, Vol. 1. Erlbaum, 828–832. http://giove.isti.cnr.it/attachments/publications/2003-A2-95.pdf retrieved 9/2017.
[29]
Diana Reich, Christian Buchholz, and Rainer Stark. 2017. Methods to Validate Automotive User Interfaces Within Immersive Driving Environments. Springer International Publishing, 429–454. https://doi.org/10.1007/978-3-319-49448-7_16
[30]
Michael Richter and Markus D. Flückiger. 2013. Usability Engineering kompakt: Benutzbare Software gezielt entwickeln. Springer Berlin, Heidelberg.
[31]
Florian Sarodnick and Henning Brau. 2006. Methoden der Usability Evaluation: Wissenschaftliche Grundlagen und praktische Anwendung (1ed.). Huber, Bern.
[32]
Werner Schweibenz and Frank Thissen. 2003. Qualität im Web: Benutzerfreundliche Webseiten durch Usability-Evaluation (1 ed.). Springer, Berlin.
[33]
The FreeCAD Team. 2020. FreeCAD. https://www.freecadweb.org/ retrieved 3/2020.
[34]
Ultraleap. 2020. Leap Motion Controller. https://www.ultraleap.com/product/leap-motion-controller/ retrieved 3/2020.
[35]
Unity Technologies. 2019. Unity 3D. https://unity3d.com retrieved 3/2019.
[36]
Jouke Verlinden, Willem Van Den Esker, Liesbet Wind, and Imre Horváth. 2004. Qualitative comparison of virtual and augmented prototyping of handheld products. In DS 32: Proceedings of DESIGN 2004, the 8th International Design Conference, Dubrovnik, Croatia, D. Marjanovic(Ed.). 533–538.
[37]
Benjamin Weyers, Dina Burkolter, Wolfram Luther, and Annette Kluge. 2012. Formal Modeling and Reconfiguration of User Interfaces for Reduction of Errors in Failure Handling of Complex Systems. International Journal of Human–Computer Interaction 28, 10(2012), 646–665. https://doi.org/10.1080/10447318.2011.654199

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
DIS '21: Proceedings of the 2021 ACM Designing Interactive Systems Conference
June 2021
2082 pages
ISBN:9781450384766
DOI:10.1145/3461778
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. XR
  2. augmented reality
  3. framework
  4. virtual prototypes
  5. virtual reality

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

DIS '21
Sponsor:
DIS '21: Designing Interactive Systems Conference 2021
June 28 - July 2, 2021
Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 242
    Total Downloads
  • Downloads (Last 12 months)39
  • Downloads (Last 6 weeks)6
Reflects downloads up to 12 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media