Naoki Okamoto
ABSTRACT
We propose WeightMorphy, a hand-mounted system designed to improve teleoperation manipulation’s operability and immersive experience by changing the moment of inertia. This system reduces the discrepancy between the shape of the virtual hand and its corresponding moment of inertia, enabling instantaneous control by the user while maintaining accuracy. We have provided a detailed description of the design and concept of our system and conducted experiments to examine the effect of shifting the center of gravity on the operability of the deformable virtual hand using WeightMorphy.
- Ferran Argelaguet, Ludovic Hoyet, Michael Trico, and Anatole Lecuyer. 2016. The role of interaction in virtual embodiment: Effects of the virtual hand representation. In 2016 IEEE Virtual Reality (VR). 3–10. https://doi.org/10.1109/VR.2016.7504682Google Scholar
- Lazar Bibin, Anatole Lécuyer, Jean-Marie Burkhardt, Alain Delbos, and Madeleine Bonnet. 2008. SAILOR: A 3-D Medical Simulator of Loco-Regional Anaesthesia Based on Desktop Virtual Reality and Pseudo-Haptic Feedback. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (Bordeaux, France) (VRST ’08). Association for Computing Machinery, New York, NY, USA, 97–100. https://doi.org/10.1145/1450579.1450600Google ScholarDigital Library
- Kevin Fan, Akihiko Murai, Natsuki Miyata, Yuta Sugiura, and Mitsunori Tada. [n.d.]. Multi-Embodiment of Digital Humans in Virtual Reality for Assisting Human-Centered Ergonomics Design. Augment Hum Res 2, 7 ([n. d.]). https://doi.org/10.1007/s41133-017-0010-6Google Scholar
- Eisuke Fujinawa, Shigeo Yoshida, Yuki Koyama, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2017. Computational Design of Hand-Held VR Controllers Using Haptic Shape Illusion. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology (Gothenburg, Sweden) (VRST ’17). Association for Computing Machinery, New York, NY, USA, Article 28, 10 pages. https://doi.org/10.1145/3139131.3139160Google ScholarDigital Library
- Shlomi Haar, Guhan Sundar, and A. Aldo Faisal. 2021. Embodied virtual reality for the study of real-world motor learning. PLOS ONE 16, 1 (01 2021), 1–17. https://doi.org/10.1371/journal.pone.0245717Google Scholar
- Masaharu Hirose and Masahiko Inami. 2021. Balanced Glass Design: A Flavor Perception Changing System by Controlling the Center-of-Gravity. In ACM SIGGRAPH 2021 Emerging Technologies (Virtual Event, USA) (SIGGRAPH ’21). Association for Computing Machinery, New York, NY, USA, Article 3, 4 pages. https://doi.org/10.1145/3450550.3465344Google ScholarDigital Library
- Masaharu Hirose, Karin Iwazaki, Kozue Nojiri, Minato Takeda, Yuta Sugiura, and Masahiko Inami. 2015. Gravitamine Spice: A System That Changes the Perception of Eating through Virtual Weight Sensation. In Proceedings of the 6th Augmented Human International Conference (Singapore, Singapore) (AH ’15). Association for Computing Machinery, New York, NY, USA, 33–40. https://doi.org/10.1145/2735711.2735795Google ScholarDigital Library
- Brent Edward Insko. 2001. Passive Haptics Significantly Enhances Virtual Environments. Ph.D. Dissertation. Advisor(s) Brooks, Frederick P. AAI3007820.Google Scholar
- Intuitive. 2014. Da Vinci.https://www.intuitive.com/.Google Scholar
- Atsushi Izumihara, Tomoya Sasaki, Masahiro Ogino, Reona Takamura, and Masahiko Inami. 2019. Transfantome: Transformation into Bodies of Various Scale and Structure in Multiple Spaces. In ACM SIGGRAPH 2019 Emerging Technologies (Los Angeles, California) (SIGGRAPH ’19). Association for Computing Machinery, New York, NY, USA, Article 27, 2 pages. https://doi.org/10.1145/3305367.3327980Google ScholarDigital Library
- Konstantina Kilteni, Raphaela Groten, and Mel Slater. 2012. The Sense of Embodiment in Virtual Reality. Presence 21, 4 (2012), 373–387. https://doi.org/10.1162/PRES_a_00124Google ScholarDigital Library
- Chih-Hung King*, Martin O. Culjat, Miguel L. Franco, James W. Bisley, Erik Dutson, and Warren S. Grundfest. 2008. Optimization of a Pneumatic Balloon Tactile Display for Robot-Assisted Surgery Based on Human Perception. IEEE Transactions on Biomedical Engineering 55, 11 (2008), 2593–2600. https://doi.org/10.1109/TBME.2008.2001137Google ScholarCross Ref
- Masaya Kitagawa, Daniell Dokko, Allison M. Okamura, and David D. Yuh. 2005. Effect of sensory substitution on suture-manipulation forces for robotic surgical systems. The Journal of Thoracic and Cardiovascular Surgery 129, 1 (2005), 151 – 158. https://doi.org/10.1016/j.jtcvs.2004.05.029Google ScholarCross Ref
- Masaya Kitagawa, Allison M. Okamura, Brian T. Bethea, Vincent L. Gott, and William A. Baumgartner. 2002. Analysis of Suture Manipulation Forces for Teleoperation with Force Feedback. In Medical Image Computing and Computer-Assisted Intervention — MICCAI 2002, Takeyoshi Dohi and Ron Kikinis (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 155–162.Google ScholarCross Ref
- Jess McIntosh, Hubert Dariusz Zajac, Andreea Nicoleta Stefan, Joanna Bergström, and Kasper Hornbæk. 2020. Iteratively Adapting Avatars Using Task-Integrated Optimisation. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 709–721. https://doi.org/10.1145/3379337.3415832Google ScholarDigital Library
- Romain Nith, Jacob Serfaty, Samuel G Shatzkin, Alan Shen, and Pedro Lopes. 2023. JumpMod: Haptic Backpack That Modifies Users’ Perceived Jump. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 82, 15 pages. https://doi.org/10.1145/3544548.3580764Google ScholarDigital Library
- Nami Ogawa, Yuki Ban, Sho Sakurai, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2016. Metamorphosis Hand: Dynamically Transforming Hands. In Proceedings of the 7th Augmented Human International Conference 2016 (Geneva, Switzerland) (AH ’16). Association for Computing Machinery, New York, NY, USA, Article 51, 2 pages. https://doi.org/10.1145/2875194.2875246Google ScholarDigital Library
- Nami Ogawa, Takuji Narumi, Hideaki Kuzuoka, and Michitaka Hirose. 2020. Do You Feel Like Passing Through Walls?: Effect of Self-Avatar Appearance on Facilitating Realistic Behavior in Virtual Environments. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376562Google ScholarDigital Library
- Shahabedin Sagheb, Frank Wencheng Liu, Alireza Bahremand, Assegid Kidane, and Robert LiKamWa. 2019. SWISH: A Shifting-Weight Interface of Simulated Hydrodynamics for Haptic Perception of Virtual Fluid Vessels. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 751–761. https://doi.org/10.1145/3332165.3347870Google ScholarDigital Library
- MHD Yamen Saraiji, Tomoya Sasaki, Reo Matsumura, Kouta Minamizawa, and Masahiko Inami. 2018. Fusion: Full Body Surrogacy for Collaborative Communication. In ACM SIGGRAPH 2018 Emerging Technologies (Vancouver, British Columbia, Canada) (SIGGRAPH ’18). Association for Computing Machinery, New York, NY, USA, Article 7, 2 pages. https://doi.org/10.1145/3214907.3214912Google ScholarDigital Library
- Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2019. Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering Based on Computational Perception Model(CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3290605.3300241Google ScholarDigital Library
- Susumu TACHI and Hirohiko ARAI. 1989. Design and Evaluation of a Visual Display with a Sensation of Presence in Tele-existence System. Journal of the Robotics Society of Japan 7, 4 (1989), 314–326. https://doi.org/10.7210/jrsj.7.314Google Scholar
- André Zenner and Antonio Krüger. 2019. Drag:On: A Virtual Reality Controller Providing Haptic Feedback Based on Drag and Weight Shift. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300441Google ScholarDigital Library
- André Zenner and Antonio Krüger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (2017), 1285–1294. https://doi.org/10.1109/TVCG.2017.2656978Google ScholarDigital Library
Index Terms
- WeightMorphy: A Dynamic Weight-Shifting Method to Enhance the Virtual Experience with Body Deformation
Recommendations
Embodied media: expanding human capacity via virtual reality and telexistence (keynote)
ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal InteractionThe information we acquire in real life gives us a holistic experience that fully incorporates a variety of sensations and bodily motions such as seeing, hearing, speaking, touching, smelling, tasting, and moving. However, the sensory modalities that ...
Virtual and Augmented Reality with Head-Tracking for Efficient Teleoperation of Groups of Robots
CW '08: Proceedings of the 2008 International Conference on CyberworldsThis paper deals with the usage of Virtual and Augmented Reality techniques in the field of teleoperation. The global context is a project for collaborative teleoperation of real robots groups. The aim is to enable to a group of teleoprators to control ...
Can Haptic Feedback on One Virtual Object Increase the Presence of Another Virtual Object?
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and TechnologyThis paper investigated whether increased presence from experiencing haptic feedback on one virtual object can transfer to another virtual object. Two similar studies were run in different environments: an immersive virtual environment and a mixed ...
Comments