skip to main content
10.1145/3613905.3650988acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Work in Progress

Bimanual Interactions for Surfacing Curve Networks in VR

Published: 11 May 2024 Publication History

Abstract

We propose an interactive system for authoring 3D curve and surface networks using bimanual interactions in virtual reality (VR) inspired by physical wire bending and film wrapping. In our system, the user can intuitively author 3D shapes by performing a rich vocabulary of interactions arising from a minimal gesture grammar based on hand poses and firmness of hand poses for constraint definition and object manipulation. Through a pilot test, we found that the user can quickly and easily learn and use our system and become immersed in 3D shape authoring.

Supplemental Material

MP4 File - Video Preview
Video Preview
Transcript for: Video Preview

References

[1]
Adobe. 2016. Quill.
[2]
Rahul Arora, Rubaiat Habib Kazi, Tovi Grossman, George Fitzmaurice, and Karan Singh. 2018. SymbiosisSketch: combining 2D & 3D sketching for designing detailed 3D objects in situ. In Proc. CHI ’18. 1–15. https://doi.org/10.1145/3173574.3173759
[3]
Rahul Arora, Rubaiat Habib Kazi, Fraser Anderson, Tovi Grossman, Karan Singh, and George Fitzmaurice. 2017. Experimental evaluation of sketching on surfaces in VR. In Proc. CHI ’17. 5643–5654. https://doi.org/10.1145/3025453.3025474
[4]
Seok-Hyung Bae, Takahiro Kobayash, Ryugo Kijima, and Won-Sup Kim. 2004. Tangible NURBS-curve manipulation techniques using graspable handles on a large display. In Proc. UIST ’04. 81–90. https://doi.org/10.1145/1029632.1029646
[5]
Ravin Balakrishnan, George Fitzmaurice, Gordon Kurtenbach, and William Buxton. 1999. Digital tape drawing. In Proc. UIST ’99. 161–169. https://doi.org/10.1145/320719.322598
[6]
Bruno R. De Araùjo, Géry Casiez, and Joaquim A. Jorge. 2012. Mockup builder: direct 3D modeling on and above the surface in a continuous interaction space. In Proc. GI ’12. 173–180. https://doi.org/10.5555/2305276.2305305
[7]
Tobias Drey, Jan Gugenheimer, Julian Karlbauer, Maximilian Milo, and Enrico Rukzio. 2020. VRSketchIn: exploring the design space of pen and tablet interaction for 3D sketching in virtual reality. In Proc. CHI ’20. 1–14. https://doi.org/10.1145/3313831.3376628
[8]
Google. 2016. TiltBrush.
[9]
Tovi Grossman, Ravin Balakrishnan, Gordon Kurtenbach, George Fitzmaurice, Azam Khan, and Bill Buxton. 2001. Interaction techniques for 3D modeling on large displays. In Proc. I3D ’01. 17–23. https://doi.org/10.1145/364338.364341
[10]
Tovi Grossman, Ravin Balakrishnan, Gordon Kurtenbach, George Fitzmaurice, Azam Khan, and Bill Buxton. 2002. Creating principal 3D curves with digital tape drawing. In Proc. CHI ’02. 121–128. https://doi.org/10.1145/503376.503398
[11]
Yves Guiard. 1987. Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. Journal of Motor Behavior 19, 4 (1987), 486–517. https://doi.org/10.1080/00222895.1987.10735426
[12]
Devamardeep Hayatpur, Seongkook Heo, Haijun Xia, Wolfgang Stuerzlinger, and Daniel Wigdor. 2019. Plane, ray, and point: enabling precise spatial manipulations with shape constraints. In Proc. UIST ’19. 1185–1195. https://doi.org/10.1145/3332165.3347916
[13]
Bret Jackson and Daniel F. Keefe. 2016. Lift-Off: using reference imagery and freehand sketching to create 3D models in VR. TVCG 22, 4 (2016), 1442–1451. https://doi.org/10.1109/TVCG.2016.2518099
[14]
Ying Jiang, Congyi Zhang, Hongbo Fu, Alberto Cannavò, Fabrizio Lamberti, Henry Y K Lau, and Wenping Wang. 2021. HandPainter - 3D sketching in VR with hand-based physical proxy. In Proc. CHI ’21. Article 412, 13 pages. https://doi.org/10.1145/3411764.3445302
[15]
Daniel F. Keefe, Daniel Acevedo Feliz, Tomer Moscovich, David H. Laidlaw, and Joseph J. LaViola. 2001. CavePainting: a fully immersive 3D artistic medium and interactive experience. In Proc. I3D ’01. 85–93. https://doi.org/10.1145/364338.364370
[16]
Daniel F. Keefe, Robert Zeleznik, and David Laidlaw. 2007. Drawing on air: input techniques for controlled 3D line illustration. TVCG 13, 5 (2007), 1067–1081. https://doi.org/10.1109/TVCG.2007.1060
[17]
Hyosun Kim, Georgia Albuquerque, Sven Havemann, and Dieter W Fellner. 2005. Tangible 3D: hand gesture interaction for immersive 3D modeling. IPT/EGVE 2005, 2005 (2005), 191–199. https://doi.org/10.2312/EGVE/IPT_EGVE2005/191-199
[18]
Kin Chung Kwan and Hongbo Fu. 2019. Mobi3DSketch: 3D sketching in mobile AR. In Proc. CHI ’19. 1–11. https://doi.org/10.1145/3290605.3300406
[19]
Kit Yung Lam, Lik-Hang Lee, and Pan Hui. 2022. 3DeformR: freehand 3D model editing in virtual environments considering head movements on mobile headsets. In Proc. MMSys ’22. 52–61. https://doi.org/10.1145/3524273.3528180
[20]
Celine Latulipe, Craig S. Kaplan, and Charles L. A. Clarke. 2005. Bimanual and unimanual image alignment: an evaluation of mouse-based techniques. In Proc. UIST ’05. 123–131. https://doi.org/10.1145/1095034.1095057
[21]
Sang-Hyun Lee, Taegyu Jin, Joon Hyub Lee, and Seok-Hyung Bae. 2022. WireSketch: bimanual interactions for 3D curve networks in VR. In UIST ’22 Adjunct. Article 37, 3 pages. https://doi.org/10.1145/3526114.3558726
[22]
Mayra D. Barrera Machuca, Paul Asente, Wolfgang Stuerzlinger, Jingwan Lu, and Byungmoon Kim. 2018. Multiplanes: assisted freehand VR sketching. In Proc. SUI ’18. 36–47. https://doi.org/10.1145/3267782.3267786
[23]
Mayra D. Barrera Machuca, Wolfgang Stuerzlinger, and Paul Asente. 2019. Smart3DGuides: making unconstrained immersive 3D drawing more accurate. In Proc. VRST ’19. Article 37, 13 pages. https://doi.org/10.1145/3359996.3364254
[24]
Tim McGraw, Esteban Garcia, and Drew Sumner. 2017. Interactive swept surface modeling in virtual reality with motion-tracked controllers. In Proc. SBIM ’17. Article 4, 9 pages. https://doi.org/10.1145/3092907.3092908
[25]
Brian P. Perles and Judy M. Vance. 2002. Interactive virtual tools for manipulating NURBS surfaces in a virtual environment. Journal of Mechanical Design 124, 2 (2002), 158–163. https://doi.org/10.1115/1.1464132
[26]
Les Piegl and Wayne Tiller. 2012. The NURBS Book. Springer Science & Business Media.
[27]
Steven Schkolne, Michael Pruett, and Peter Schröder. 2001. Surface drawing: creating organic 3D shapes with the hand and tangible tools. In Proc. CHI ’01. 261–268. https://doi.org/10.1145/365024.365114
[28]
Gravity Sketch. 2016. Gravity Sketch.
[29]
Tijana Vuletic, Alex Duffy, Chris McTeague, Laura Hay, Ross Brisco, Gerard Campbell, and Madeleine Grealy. 2021. A novel user-based gesture vocabulary for conceptual design. International Journal of Human-Computer Studies 150 (2021), 102609. https://doi.org/10.1016/j.ijhcs.2021.102609
[30]
Gerold Wesche and Hans-Peter Seidel. 2001. FreeDrawer: a free-form sketching system on the responsive workbench. In Proc. VRST ’01. 167–174. https://doi.org/10.1145/505008.505041
[31]
Min Xin, Ehud Sharlin, and Mario Costa Sousa. 2008. Napkin sketch: handheld mixed reality 3D sketching. In Proc. VRST ’08. 223–226. https://doi.org/10.1145/1450579.1450627
[32]
Xinchi Xu, Yang Zhou, Bingchan Shao, Guihuan Feng, and Chun Yu. 2023. GestureSurface: VR sketching through assembling scaffold surface with non-dominant hand. TVCG 29, 5 (2023), 2499–2507. https://doi.org/10.1109/TVCG.2023.3247059
[33]
T. P. Yeh and J. M. Vance. 1998. Applying virtual reality techniques to sensitivity-based structural shape design. Journal of Mechanical Design 120, 4 (1998), 612–619. https://doi.org/10.1115/1.2829323
[34]
Emilie Yu, Rahul Arora, Tibor Stanko, J. Andreas Bærentzen, Karan Singh, and Adrien Bousseau. 2021. CASSIE: curve and surface sketching in immersive environments. In Proc. CHI ’21. Article 190, 14 pages. https://doi.org/10.1145/3411764.3445158
[35]
Xue Yu, Stephen DiVerdi, Akshay Sharma, and Yotam Gingold. 2021. ScaffoldSketch: accurate industrial design drawing in VR. In Proc. UIST ’21. 372–384. https://doi.org/10.1145/3472749.3474756

Index Terms

  1. Bimanual Interactions for Surfacing Curve Networks in VR

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems
    May 2024
    4761 pages
    ISBN:9798400703317
    DOI:10.1145/3613905
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 11 May 2024

    Check for updates

    Author Tags

    1. Bézier curve network
    2. VR
    3. bimanual gesture
    4. surface modeling

    Qualifiers

    • Work in progress
    • Research
    • Refereed limited

    Conference

    CHI '24

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 279
      Total Downloads
    • Downloads (Last 12 months)279
    • Downloads (Last 6 weeks)50
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media