Abstract
We present RealPot, an immersive virtual pottery system with haptic feedback for pottery simulation training using hand-held motion controllers. Our system consists of two major components: an automatic mesh generator and an interactive model editor. The mesh generator can procedurally generate realistic clay meshes by adding Perlin Noise. With the interactive pottery model editor, the user can shape the virtual clay intuitively with a series of bimanual interactions. Based on real-life pottery, a high realism pottery creation workflow was developed and a haptic model was proposed. Our user study investigated how haptic fidelity can impact usability in virtual pottery, and compared our system with a representative work of barehand-based virtual pottery systems. The results of our study reveal that haptic fidelity significantly affects performance and user experience. In addition, the results indicate that our system offers significantly accuracy, presence and usability compared with barehand-based virtual pottery experience.
Similar content being viewed by others
References
Agrawala M, Beers AC, Levoy M (1995) 3d painting on scanned surfaces. In: Proceedings of the 1995 symposium on Interactive 3D graphics. ACM, pp 145–ff
Autodesk 3ds max. http://www.autodesk.com/products/3ds-max/overview
Autodesk maya. http://www.autodesk.com/products/maya/overview
Bastug E, Bennis M, Medard M, Debbah M (2017) Toward interconnected virtual reality: opportunities, challenges, and enablers. IEEE Commun Mag 55(6):110–117
Botsch M, Kobbelt L, Pauly M, Alliez P, Lévy B (2010) Polygon mesh processing. CRC Press, Boca Raton
Choudhary R, Dewan P (1995) A general multi-user undo/redo model. In: Proceedings of the fourth European conference on computer-supported cooperative work ECSCW’95, Springer, pp 231–246
Cui J, Kuijper A, Sourin A (2016) Exploration of natural free-hand interaction for shape modeling using leap motion controller. In: 2016 international conference on cyberworlds (CW), IEEE, pp 41–48
Gao Z, Li J, Wang H, Feng G (2018) Digiclay: an interactive installation for virtual pottery using motion sensing technology. In: Proceedings of the 4th international conference on virtual reality. ACM, pp 126–132
Han G, Hwang J, Choi S, Kim GJ (2007) Ar pottery: experiencing pottery making in the augmented space. In: International conference on virtual reality. Springer, pp 642–650
Han YC, Han BJ (2014) Virtual pottery: a virtual 3d audiovisual interface using natural hand motions. Multimed Tools Appl 73(2):917–933
Hinckley K, Pausch R, Proffitt D, Kassell NF (1998) Two-handed virtual manipulation. ACM Transactions on Computer-Human Interaction (TOCHI) 5 (3):260–302
Htc vive. http://www.vive.com
Jacob RJK, Girouard A, Hirshfield LM, Horn MS, Shaer O, Solovey ET, Zigelbaum J (2008) Reality-based interaction:a framework for post-wimp interfaces. In: Proceeding of the twenty-sixth sigchi conference on human factors in computing systems, pp 201–210
Keefe DF, Feliz DA, Moscovich T, Laidlaw DH, LaViola JJ Jr (2001) Cavepainting: a fully immersive 3d artistic medium and interactive experience. In: Proceedings of the 2001 symposium on interactive 3D graphics. ACM, pp 85–93
Korida K, Nishino H, Utsumiya K (1997) An interactive 3d interface for a virtual ceramic art work environment. In: International Conference on virtual systems and multimedia, 1997. VSMM’97. Proceedings. IEEE, pp 227–234
Koutsoudis A, Pavlidis G, Arnaoutoglou F, Tsiafakis D, Chamzas C (2009) Qp: a tool for generating 3d models of ancient greek pottery. J Cult Herit 10 (2):281–295
Kumar G, Sharma NK, Bhowmick P (2011) Wheel-throwing in digital space using number-theoretic approach. International Journal of Arts and Technology 4(2):196–215
LaViola JJ, Keefe DF (2011) 3d spatial interaction: applications for art, design, and science. In: ACM Siggraph 2011 courses. ACM, p 1
LaViola JJ Jr, Kruijff E, McMahan RP, Bowman D, Poupyrev IP (2017) 3D user interfaces: theory and practice. Addison-Wesley Professional, Reading
McDonnell KT, Qin H, Wlodarczyk RA (2001) Virtual clay: a real-time sculpting system with haptic toolkits. In: Proceedings of the 2001 symposium on interactive 3D graphics. ACM, pp 179–190
McMahan RP, Bowman DA, Zielinski DJ, Brady RB (2012) Evaluating display fidelity and interaction fidelity in a virtual reality game. IEEE Trans Vis Comput Graph (4):626–633
Murugappan S, Piya C, Ramani K, et al (2013) Handy-potter: Rapid exploration of rotationally symmetric shapes through natural hand motions. J Comput Inf Sci Eng 13(2):021,008
Niehorster DC, Li L, Lappe M (2017) The accuracy and precision of position and orientation tracking in the htc vive virtual reality system for scientific research. i-Perception 8(3):2041669517708,205
Otsuki M, Sugihara K, Toda A, Shibata F, Kimura A (2017) A brush device with visual and haptic feedback for virtual painting of 3d virtual objects. Virtual Reality, pp 1–15
Perlin K (1985) An image synthesizer. Acm Siggraph Computer Graphics 19(3):287–296
Ramani K, Lee K Jr, Jasti R, et al (2014) zpots: a virtual pottery experience with spatial interactions using the leap motion device. In: CHI’14 extended abstracts on human factors in computing systems. ACM, pp 371–374
Ramani K, et al (2015) A gesture-free geometric approach for mid-air expression of design intent in 3d virtual pottery. Comput Aided Des 69:11–24
Ramani K, et al (2016) Extracting hand grasp and motion for intent expression in mid-air shape deformation: a concrete and iterative exploration through a virtual pottery application. Comput Graph 55:143–156
Schkolne S, Pruett M, Schröder P (2001) Surface drawing: creating organic 3d shapes with the hand and tangible tools. In: Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, pp 261–268
Sheng J, Balakrishnan R, Singh K (2006) An interface for virtual 3d sculpting via physical proxy. In: GRAPHITE, vol 6, pp 213–220
Slater M, Usoh M, Steed A (1994) Depth of presence in virtual environments. Presence Teleop Virt 3(2):130–144
Unity3d. http://www.unity3d.com
Walter R, Bailly G, Valkanova N, Müller J (2014) Cuenesics: using mid-air gestures to select items on interactive public displays. In: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services. ACM, pp 299–308
Wang T, Zhang G, Liu A, Bhuiyan ZA, Jin Q (2018) A secure iot service architecture with an efficient balance dynamics based on cloud and edge computing. IEEE Internet Things J, pp 1–1
Wingcrave C, Williamson B, Varcholik P, Rose J, Miller A, Charbonneau E, Bott J, Laviola J (2010) Wii remote and beyond: Using spatially convenient devices for 3d uis. IEEE Comput Graph Appl 30(2):71–85
Acknowledgments
We thank the reviewers for their valuable feedback and comments. We also thank all the people participated in the user studies. This work is supported by the Natural Science Foundation of China (No. 61872104), the Natural Science Foundation of Heilongjiang Province in China (No. F2016009), the Fundamental Research Fund for the Central Universities in China (No. HEUCF180602 and HEUCFM180604) and the National Science and Technology Major Project (No. 2016ZX03001023-005).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix: Usability questionnaire
Appendix: Usability questionnaire
-
1.
Rate how easy it was for you to shape the virtual clay (1 = extremely difficult, 7 = extremely easy).
-
2.
Rate how natural it was for you to shape the virtual clay (1 = extremely unnatural, 7 = extremely unnatural).
-
3.
Rate how much fun you had creating the virtual clay (1 = extremely frustrating, 7 = extremely fun).
-
4.
Rate how creative it was for you to shape the virtual clay (1 = extremely little, 7 = extremely much).
-
5.
Rate how tiring it was for you to shape the virtual clay (1 = extremely exhausting, 7 = not tiring at all).
-
6.
Rate how much skills you gain from the virtual pottery training (1 = extremely little, 7 = extremely much).
Rights and permissions
About this article
Cite this article
Gao, Z., Wang, H., Feng, G. et al. RealPot: an immersive virtual pottery system with handheld haptic devices. Multimed Tools Appl 78, 26569–26596 (2019). https://doi.org/10.1007/s11042-019-07843-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-019-07843-3