Abstract
Sketch design is generally a feasible concept within virtual reality (VR). However, VR controllers suffer from a fundamental problem that limits operability and immersion, which is the difficulty of imitating the texture of natural materials. To solve these challenges, we developed a tablet-based design system named Pressure-Sketch (PSK) around the tactile features of the digital tablet and stylus. PSK could provide an intuitive design workflow for VR. The digital tablet is covered with natural wood to give a more realistic feel. In addition, utilizing the pressure property, users can directly touch the material by the stylus to create lines with varying widths. An evaluated user study revealed that PSK could significantly improve designs’ accuracy and aesthetic quality. Moreover, the system has a better sense of immersion. We are willing to explore the differences between more types of materials on sketching in VR.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Arora R, Singh K (2021) Mid-air drawing of curves on 3D surfaces in virtual reality. ACM Trans Graph 40(3):1–17
Callens E, Danieau F, CosPSK A, Guillotel P (2018) A tangible surface for digital sculpting in virtual environments. In: Proceedings of the international conference on human haptic sensing and touch enabled computer applications.
Cherry E, Celine L (2014) Quantifying the creativity support of digital tools through the creativity support index. ACM Trans Graph 21(4):1–25
Chu SH, Tai CL (2005) MoXi: real-time ink dispersion in absorbent paper. ACM Trans Graph 24(3):504–511
Deering MF (1995) HoloSketch: a virtual reality sketching/animation tool. ACM Trans Comput Hum Interact 2(3):220–238
Elsayed H, Barrera MD, Schaarschmidt C, Marky K, Müller F, Riemann J, Matviienko A, Schmitz M, Weigel M, Mühlhäuser M (2020) VRSketchPen: unconstrained haptic assistance for sketching in virtual 3D environments. In: The proceeding of VRST 2020.
Emilie Y, Rahul A, et al (2021) CASSIE: curve and surface sketching in immersive environments. In: Proceedings of the 2021 CHI conference on human factors in computing system.
Eroglu S, Gebhardt S, Schmitz P, Rausch D, Kuhlen TW. 2018. Fluid sketching-immersive sketching based on fluid flow. In: Proceedings of the 2018 IEEE conference on virtual reality and 3D user interfaces (VR).
Gravity sketch: bringing virtual reality into your design workflow. https://www.gravitysketch.com/
Hook J, Taylor S, Butler A, Villar N, Izadi S (2009) A reconfigurable ferromagnetic input device. In: Proceedings of the 22nd annual ACM symposium on user interface software and technology.
Ishii H, Ratti C, Piper B, Wang Y, Biderman A, Ben-Joseph E (2004) Bringing clay and sand into digital design: continuous tangible user interfaces. BT Technol J 22(4):287–299
Israel JH, Wiese E, Mateescu M, Zöllner C, Stark R (2009) Investigating three-dimensional sketching for early conceptual design: results from expert discussions and user studies. Comput Graph 33(4):462–473
Jackson B, Keefe DF (2016) Lift-off: using reference imagery and freehand sketching to create 3D models in VR. IEEE Trans Visual Comput Graph
Keefe DF, Feliz DA, Mos-covich T, Laidlaw David H, Laviola Joseph J (2001) CavePainting: a fully immersive 3D artistic medium and interactive experience. In: Proceedings of the ACM symposium on interactive 3d graphics.
Kim Y, An SG, Lee JH, Bae SH (2018) Agile 3D sketching with air scaffolding. In: Proceedings of the extended abstracts of the 2018 CHI conference on human factors in computing systems.
Krum DM, Phan T, Dukes LC, Wang P, Bolas M (2014) Tablet-based interaction panels for immersive. In: Proceeding of IEEE virtual reality (VR)
Kuester F, Duchaineau MA, Hamann B, Joy KI, Uva AE (1999) 3DIVS:3-dimensional immersive virtual sculpting. Workshop on new paradigms in information visualization and manipulation in conjunction with the eighth Acm internation conference on information and knowledge management.
Leal A, Bowman DA, Schaefer L, Stiles C (2011) 3D sketching using interactive fabric for tangible and bimanual input. Proc Graph Interface 15(3):49–56
Massie T (1998) A tangible goal for 3D modeling. IEEE Comput Graph Appl
Meredith H (2009) Super sketch sisters melee: designing for 2D VS designing for a 3D VR space.
Mizuno S, Okada M, Toriwaki J (1998) Virtual sculpting and virtual woodcut printing. Visual Comput
Panda P, Ho C, Ham D (2021) Morphaces: exploring morphable surfaces for tangible sketching in VR. In: Creativity and cognition.
Paperlike. https://paperlike.com/#krwgmyj1i5-
Poupyrev I, Tomokazu N, Weghorst S (1998) Virtual notepad: handwriting in immersive VR. In: Proceedings of the IEEE virtual reality international symposium.
Quill. https://quill.fb.com/
Rahul A, Habib KR, Anderson F, Grossman T, Singh K, Fitzmaurice G (2017) Experimental evaluation of sketching on surfaces in VR. In: Proceeding of ACM CHI 2017
Regenbrecht H, Kruijff E, Donath D, Seichter H, Beetz J (2000) VRAM-a virtual reality aided modeler. eCAADe.
Flying Shapes. https://www.flyingshapes.com/
Shi L (2015) Real-time dynamic and pressure-sensitive brush rendering. Master's thesis. University of Science and Technology of China, Hefei, Anhui province, China.
Simens NX. https://www.plm.automation.siemens.com/
Sugihara K, Otsuki M, Kimura A, Fumihisa S, Hideyuki T (2011) MAI painting brush++: augmenting the feeling of painting with new visual and tactile feedback mechanisms. In: Proceeding of the ACM symposium adjunct on user interface software and technology.
Surale HB, Gupta A, Hancock M (2019) TabletInVR: exploring the design space for using a multi-touch tablet in virtual reality. In: Proceeding of ACM CHI 2019.
Tilt brush tutorials: environments. https://www.youtube.com/watch?v=S4LO3NXVvh4&list=PLjhgRr1fomj0pHdrXVQrvKRWV1rVtElPz&index=2&t=0s.
Wacom. https://www.wacom.com/
Wang J, Lindeman RW (2015) Object impersonation: towards effective interaction in tablet and HMD based hybrid virtual environments. In: Proceeding of IEEE virtual reality (VR).
Wang S, He W, Zheng B, Feng S, Wang S, Bai X, Billinghurst M (2019) Holding virtual objects using a tablet for tangible 3D sketching in VR. In: Proceedings of the 2019 IEEE international symposium on mixed and augmented reality adjunct (ISMAR-Adjunct).
Whitmire E., et al. 2018. Haptic revolver: touch, shear, texture, and shape rendering on a reconfgurable virtual reality controller. In: Proceedings of the 2018 CHI.
Acknowledgements
This work is partly supported by the National Key R&D Program of China (Grant No. 2019YFB1703800).
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of interest
This article does not address conflicts of interest. This paper includes user experiments, and the user experiments involved are subject to my consent. Besides, all authors are informed and agree.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Feng, S., He, W., Wang, S. et al. Pressure-sketch: a tablet-based design system in immersive VR. Virtual Reality 26, 1207–1215 (2022). https://doi.org/10.1007/s10055-022-00627-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-022-00627-5