skip to main content
10.1145/3025453.3025935acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Design and Evaluation of a Handheld-based 3D User Interface for Collaborative Object Manipulation

Published: 02 May 2017 Publication History

Abstract

Object manipulation in 3D virtual environments demands a combined coordination of rotations, translations and scales, as well as the camera control to change the user's viewpoint. Then, for many manipulation tasks, it would be advantageous to share the interaction complexity among team members. In this paper we propose a novel 3D manipulation interface based on a collaborative action coordination approach. Our technique explores a smartphone -- the touchscreen and inertial sensors -- as input interface, enabling several users to collaboratively manipulate the same virtual object with their own devices. We first assessed our interface design on a docking and an obstacle crossing tasks with teams of two users. Then, we conducted a study with 60 users to understand the influence of group size in collaborative 3D manipulation. We evaluated teams in combinations of one, two, three and four participants. Experimental results show that teamwork increases accuracy when compared with a single user. The accuracy increase is correlated with the number of individuals in the team and their work division strategy.

Supplementary Material

suppl.mov (pn3827.mp4)
Supplemental video

References

[1]
Laurent Aguerreche, Thierry Duval, and Anatole Lécuyer. 2010. Reconfigurable Tangible Devices for 3D Virtual Object Manipulation by Single or Multiple Users. In Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology (VRST '10). ACM, NY, NY, USA, 227--230.
[2]
Laurent Aguerreche, Thierry Duval, and Anatole Lécuyer. 2011. Evaluation of a reconfigurable tangible device for collaborative manipulation of objects in virtual reality. In Theory and Practice of Computer Graphics. 81--88.
[3]
Louis-pierre Bergé, Emmanuel Dubois, and Mathieu Raynal. 2015. Design and Evaluation of an "Around the SmartPhone" Technique for 3D Manipulations on Distant Display. In SUI15. 69--78.
[4]
Louis-Pierre Bergé, Marcos Serrano, Gary Perelman, and Emmanuel Dubois. 2014. Exploring Smartphone - Based Interaction with Overview + Detail Interfaces on 3D Public Displays. MobileHCI 2014 (2014), 125--134.
[5]
Doug A Bowman, Ernst Kruijff, Joseph J LaViola, and Ivan Poupyrev. 2004. 3D User Interfaces: Theory and Practice. Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, USA.
[6]
Elizabeth F Churchill and Dave Snowdon. 1998. Collaborative virtual environments: an introductory review of issues and systems. Virtual Reality 3, 1 (1998), 3--15.
[7]
Henrique Debarba, Luciana Nedel, and Anderson MacIel. 2012. LOP-cursor: Fast and precise interaction with tiled displays using one hand and levels of precision. IEEE Symposium on 3D User Interfaces 2012, 3DUI 2012 Proceedings (2012), 125--132.
[8]
Henrique G. Debarba, Jerônimo G. Grandi, Anderson Maciel, Luciana Nedel, and Ronan Boulic. 2013. Disambiguation Canvas: A Precise Selection Technique for Virtual Environments. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 8119 LNCS. 388--405.
[9]
Thierry Duval, Anatole Lécuyer, and Sébastien Thomas. 2006. SkeweR: A 3D interaction technique for 2-user collaborative manipulation of objects in virtual environments. In 3DUI 2006: IEEE Symposium on 3D User Interfaces 2006 - Proceedings, Vol. 2006. 69--72.
[10]
Alan G Ingham, George Levinger, James Graves, and Vaughn Peckham. 1974. The Ringelmann effect: Studies of group size and group performance. Journal of Experimental Social Psychology 10, 4 (1974), 371--384.
[11]
Nicholas Katzakis and Masahiro Hori. 2009. Mobile phones as 3-dof controllers: A comparative study. In Dependable, Autonomic and Secure Computing, 2009. DASC'09. Eighth IEEE International Conference on. IEEE, 345--349.
[12]
Nicholas Katzakis, Robert J Teather, Kiyoshi Kiyokawa, and Haruo Takemura. 2015. INSPECT: extending plane-casting for 6-DOF control. Human-centric Computing and Information Sciences 5, 1 (dec 2015), 22.
[13]
Patrick R. Laughlin. 2011. Group Problem Solving. Princeton University Press.
[14]
Hai Ning Liang, Cary Williams, Myron Semegen, Wolfgang Stuerzlinger, and Pourang Irani. 2013. An investigation of suitable interactions for 3D manipulation of distant objects through a mobile device. International Journal of Innovative Computing, Information and Control 9, 12 (2013), 4737--4752.
[15]
David Lopez, Lora Oehlberg, Candemir Doger, and Tobias Isenberg. 2016. Towards An Understanding of Mobile Touch Navigation in a Stereoscopic Viewing Environment for 3D Data Exploration. IEEE Transactions on Visualization and Computer Graphics 22, 5 (may 2016), 1616--1629.
[16]
Geoff Norman. 2010. Likert scales, levels of measurement and the IJlaws of statistics. Advances in health sciences education 15, 5 (2010), 625--632.
[17]
Krzysztof Pietroszek, James R. Wallace, and Edward Lank. 2015. Tiltcasting: 3D interaction on large displays using a mobile device. Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST '15 (2015), 57--62.
[18]
Marcio S Pinho, Doug A Bowman, and Carla M Dal Sasso Freitas. 2008. Cooperative object manipulation in collaborative virtual environments. Journal of the Brazilian Computer Society 14 (2008), 54--67. http://www.scielo.br/scielo.php'script=sci
[19]
Mike Robinson. 1993. Designing for Unanticipated Use.... In ECSCW '93. 187--202.
[20]
Roy A Ruddle, Justin C D Savage, and Dylan M Jones. 2002. Symmetric and asymmetric action integration during cooperative object manipulation in virtual environments. ACM Transactions on Computer-Human Interaction (TOCHI) 9, 4 (2002), 285--308.
[21]
H. Salzmann, J. Jacobs, and B. Froehlich. 2009. Collaborative interaction in co-located two-user scenarios. In Proc. of JVRC 2009 (Joint Virtual Reality Conference of EGVE ICAT - EuroVR). 85--92.
[22]
Steven Smith. 2013. Digital signal processing: a practical guide for engineers and scientists. Newnes.
[23]
Peng Song, Wooi Boon Goh, Chi-Wing Fu, Qiang Meng, and Pheng-ann Heng. 2011. WYSIWYF: Exploring and Annotating Volume Data with a Tangible Handheld Device. In Proceedings of the 2011 annual conference on Human factors in computing systems CHI '11, Vol. D. ACM Press, NY, NY, USA, 1333.
[24]
Wolfgang Stuerzlinger and Chadwick A. Wingrave. 2011. The value of constraints for 3d user interfaces. Virtual Realities: Dagstuhl Seminar 2008 (2011), 203--223.
[25]
Manuel Veit, Antonio Capobianco, and Dominique Bechmann. 2009. Influence of degrees of freedom's manipulation on performances during orientation tasks in virtual reality environments. Proceeding VRST '09 Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology 1, 212 (2009), 51--58.
[26]
Vinayak, Devarajan Ramanujan, Cecil Piya, and Karthik Ramani. 2016. MobiSweep: Exploring Spatial Design Ideation Using a Smartphone as a Hand-held Reference Plane. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction - TEI '16. ACM Press, NY, NY, USA, 12--20.
[27]
Shumin Zhai and Paul Milgram. 1998. Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices. Proceedings of the SIGCHI conference on Human factors in computing systems CHI '98 (1998), 320--327.
[28]
Shumin Zhai, Paul Milgram, and William Buxton. 1996. The influence of muscle groups on performance of multiple degree-of-freedom input. Proceedings of the SIGCHI conference on Human factors in computing systems common ground CHI '96 (1996), 308--315.

Cited By

View all
  • (2024)Object Selection and Manipulation in VR Headsets: Research Challenges, Solutions, and Success MeasurementsACM Computing Surveys10.1145/370641757:4(1-34)Online publication date: 30-Nov-2024
  • (2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
  • (2024)Multi-User Mobile Augmented Reality for Cardiovascular Surgical Planning2024 IEEE Visualization and Visual Analytics (VIS)10.1109/VIS55277.2024.00048(201-205)Online publication date: 13-Oct-2024
  • Show More Cited By

Index Terms

  1. Design and Evaluation of a Handheld-based 3D User Interface for Collaborative Object Manipulation

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
      May 2017
      7138 pages
      ISBN:9781450346559
      DOI:10.1145/3025453
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 02 May 2017

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. 3D user interfaces
      2. collaborative manipulation
      3. user studies

      Qualifiers

      • Research-article

      Funding Sources

      Conference

      CHI '17
      Sponsor:

      Acceptance Rates

      CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
      Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

      Upcoming Conference

      CHI 2025
      ACM CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2025
      Yokohama , Japan

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)72
      • Downloads (Last 6 weeks)8
      Reflects downloads up to 13 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Object Selection and Manipulation in VR Headsets: Research Challenges, Solutions, and Success MeasurementsACM Computing Surveys10.1145/370641757:4(1-34)Online publication date: 30-Nov-2024
      • (2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
      • (2024)Multi-User Mobile Augmented Reality for Cardiovascular Surgical Planning2024 IEEE Visualization and Visual Analytics (VIS)10.1109/VIS55277.2024.00048(201-205)Online publication date: 13-Oct-2024
      • (2024)Spatial Computing Through an HCI Lens - UX Evaluation Based on SituatednessHCI International 2024 Posters10.1007/978-3-031-61950-2_12(102-113)Online publication date: 7-Jun-2024
      • (2024)Conceptualizing Collaborative Team Learning in XR for Medical Education and TrainingVirtual, Augmented and Mixed Reality10.1007/978-3-031-61047-9_3(44-63)Online publication date: 1-Jun-2024
      • (2023)Blended Collaboration: Communication and Cooperation Between Two Users Across the Reality-Virtuality ContinuumExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585881(1-8)Online publication date: 19-Apr-2023
      • (2023)ConeSpeech: Exploring Directional Speech Interaction for Multi-Person Remote Communication in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324708529:5(2647-2657)Online publication date: 1-May-2023
      • (2023)Providing Dual Awareness using Multimodal Cues for Collaborative Manipulation in Virtual EnvironmentsInternational Journal of Human–Computer Interaction10.1080/10447318.2023.218853340:12(3298-3312)Online publication date: 3-Apr-2023
      • (2023)Mixed Reality Interaction TechniquesSpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_5(109-129)Online publication date: 1-Jan-2023
      • (2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media