Sarah Faltaous
Jonas Keppel
Uwe Gruenefeld
Stefan Schneegass
ABSTRACT
Virtual Reality (VR) devices empower users to experience virtual worlds through rich visual and auditory sensations. However, believable haptic feedback that communicates the physical properties of virtual objects, such as their weight, is still unsolved in VR. The current trend towards hand tracking-based interactions, neglecting the typical controllers, further amplifies this problem. Hence, in this work, we investigate the combination of passive haptics and electric muscle stimulation to manipulate users’ perception of weight, and thus, simulate objects with different weights. In a laboratory user study, we investigate four differing electrode placements, stimulating different muscles, to determine which muscle results in the most potent perception of weight with the highest comfort. We found that actuating the biceps brachii or the triceps brachii muscles increased the weight perception of the users. Our findings lay the foundation for future investigations on weight perception in VR.
- Merwan Achibet, Adrien Girard, Maud Marchal, and Anatole Lécuyer. 2016. Leveraging Passive Haptic Feedback in Virtual Environments with the Elastic-Arm Approach. Presence: Teleoperators and Virtual Environments 25, 1 (07 2016), 17–32. https://doi.org/10.1162/PRES_a_00243 arXiv:https://direct.mit.edu/pvar/article-pdf/25/1/17/1625617/pres_a_00243.pdfGoogle Scholar
Digital Library
- Merwan Achibet, Adrien Girard, Anthony Talvas, Maud Marchal, and Anatole Lécuyer. 2015. Elastic-Arm: Human-scale passive haptic feedback for augmenting interaction and perception in virtual environments. In 2015 IEEE Virtual Reality (VR). 63–68. https://doi.org/10.1109/VR.2015.7223325 ISSN: 2375-5334.Google Scholar
- Eric L Amazeen and Michael T Turvey. 1996. Weight perception and the haptic size–weight illusion are functions of the inertia tensor.Journal of Experimental Psychology: Human perception and performance 22, 1(1996), 213.Google Scholar
- Jonas Auda, Uwe Gruenefeld, and Stefan Schneegass. 2021. Enabling Reusable Haptic Props for Virtual Reality by Hand Displacement. In Mensch Und Computer 2021 (Ingolstadt, Germany) (MuC ’21). Association for Computing Machinery, New York, NY, USA, 412–417. https://doi.org/10.1145/3473856.3474000Google ScholarDigital Library
- Jonas Auda, Max Pascher, and Stefan Schneegass. 2019. Around the (Virtual) World: Infinite Walking in Virtual Reality Using Electrical Muscle Stimulation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–8.Google ScholarDigital Library
- Jonas Auda, Nils Verheyen, Sven Mayer, and Stefan Schneegass. 2021. Flyables: Haptic Input Devices for Virtual Realityusing Quadcopters. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (Osaka, Japan) (VRST ’21). Association for Computing Machinery, New York, NY, USA, Article 40, 11 pages. https://doi.org/10.1145/3489849.3489855Google ScholarDigital Library
- Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2016. Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1968–1979. https://doi.org/10.1145/2858036.2858226Google ScholarDigital Library
- Frank Biocca, Jin Kim, and Yung Choi. 2001. Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces, and Cross-Modal Sensory Illusions. Presence: Teleoperators and Virtual Environments 10, 3 (06 2001), 247–265. https://doi.org/10.1162/105474601300343595 arXiv:https://direct.mit.edu/pvar/article-pdf/10/3/247/1623684/105474601300343595.pdfGoogle ScholarDigital Library
- Yi-Wen Chang, Fong-Chin Su, Hong-Wen Wu, and Kai-Nan An. 1999. Optimum length of muscle contraction. Clinical Biomechanics 14, 8 (1999), 537–542. https://doi.org/10.1016/S0268-0033(99)00014-5Google ScholarCross Ref
- Inrak Choi, Heather Culbertson, Mark R. Miller, Alex Olwal, and Sean Follmer. 2017. Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 119–130. https://doi.org/10.1145/3126594.3126599Google ScholarDigital Library
- L. Dominjon, A. Lecuyer, J.-M. Burkhardt, P. Richard, and S. Richir. 2005. Influence of control/display ratio on the perception of mass of manipulated objects in virtual environments. In IEEE Proceedings. VR 2005. Virtual Reality, 2005.19–25. https://doi.org/10.1109/VR.2005.1492749Google Scholar
- Marc O. Ernst and Heinrich H. Bülthoff. 2004. Merging the senses into a robust percept. Trends in Cognitive Sciences 8, 4 (2004), 162–169. https://doi.org/10.1016/j.tics.2004.02.002Google ScholarCross Ref
- Christos Giachritsis, Rachel Wright, and Alan Wing. 2010. The Contribution of Proprioceptive and Cutaneous Cues in Weight Perception: Early Evidence for Maximum-Likelihood Integration. In Proceedings, Part I, of the International Conference on Haptics: Generating and Perceiving Tangible Sensations - Volume 6191. Springer-Verlag, Berlin, Heidelberg, 11–16. https://doi.org/10.1007/978-3-642-14064-8_2Google ScholarDigital Library
- Zhenyi He, Fengyuan Zhu, and Ken Perlin. 2017. PhyShare: Sharing Physical Interaction in Virtual Reality. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology. New York, NY, USA. https://doi.org/10.1145/3131785.3131795Google ScholarDigital Library
- Ken Hinckley, Randy Pausch, John C. Goble, and Neal F. Kassell. 1994. Passive Real-World Interface Props for Neurosurgical Visualization. In Conference Companion on Human Factors in Computing Systems (Boston, Massachusetts, USA) (CHI ’94). Association for Computing Machinery, New York, NY, USA, 232. https://doi.org/10.1145/259963.260443Google ScholarDigital Library
- Matthias Hoppe, Pascal Knierim, Thomas Kosch, Markus Funk, Lauren Futami, Stefan Schneegass, Niels Henze, Albrecht Schmidt, and Tonja Machulla. 2018. VRHapticDrones: Providing Haptics in Virtual Reality through Quadcopters. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia (Cairo, Egypt) (MUM 2018). Association for Computing Machinery, New York, NY, USA, 7–18. https://doi.org/10.1145/3282894.3282898Google ScholarDigital Library
- David Antonio Gomez Jauregui, Ferran Argelaguet, Anne-Helene Olivier, Maud Marchal, Franck Multon, and Anatole Lecuyer. 2014. Toward ”Pseudo-Haptic Avatars”: Modifying the Visual Animation of Self-Avatar Can Simulate the Perception of Weight Lifting. IEEE Transactions on Visualization and Computer Graphics 20, 4(2014), 654–661. https://doi.org/10.1109/TVCG.2014.45Google ScholarDigital Library
- Seungwoo Je, Myung Jin Kim, Woojin Lee, Byungjoo Lee, Xing-Dong Yang, Pedro Lopes, and Andrea Bianchi. 2019. Aero-Plane: A Handheld Force-Feedback Device That Renders Weight Motion Illusion on a Virtual 2D Plane. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 763–775. https://doi.org/10.1145/3332165.3347926Google ScholarDigital Library
- Rebecca L Johnson. 2004. The Muscular System. Lerner Publications.Google Scholar
- Vojtech Kunc, Michal Stulpa, Georg Feigl, and David Kachlik. 2019. Accessory flexor carpi ulnaris muscle with associated anterior interosseous artery variation: case report with the definition of a new type and review of concomitant variants. Surgical and Radiologic Anatomy 41, 11 (2019), 1315–1318.Google ScholarCross Ref
- Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 1471–1482. https://doi.org/10.1145/3025453.3025600Google ScholarDigital Library
- Anatole Lécuyer. 2009. Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-Haptic Feedback. Presence: Teleoperators and Virtual Environments 18, 1 (02 2009), 39–53. https://doi.org/10.1162/pres.18.1.39 arXiv:https://direct.mit.edu/pvar/article-pdf/18/1/39/1624884/pres.18.1.39.pdfGoogle ScholarDigital Library
- Giuseppe Marcolin, Fausto Antonio Panizzolo, Nicola Petrone, Tatiana Moro, Davide Grigoletto, Davide Piccolo, and Antonio Paoli. 2018. Differences in electromyographic activity of biceps brachii and brachioradialis while performing three variants of curl. PeerJ 6(2018), e5165.Google ScholarCross Ref
- John C. McClelland, Robert J. Teather, and Audrey Girouard. 2017. Haptobend: Shape-Changing Passive Haptic Feedback in Virtual Reality. In Proceedings of the 5th Symposium on Spatial User Interaction. New York, NY, USA. https://doi.org/10.1145/3131277.3132179Google ScholarDigital Library
- Ryuma Niiyama, Lining Yao, and Hiroshi Ishii. 2014. Weight and Volume Changing Device with Liquid Metal Transfer. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (Munich, Germany) (TEI ’14). Association for Computing Machinery, New York, NY, USA, 49–52. https://doi.org/10.1145/2540930.2540953Google ScholarDigital Library
- Liliam F Oliveira, Thiago T Matta, Daniel S Alves, Marco AC Garcia, and Taian MM Vieira. 2009. Effect of the shoulder position on the biceps brachii EMG in different dumbbell curls. Journal of sports science & medicine 8, 1 (2009), 24.Google Scholar
- Max Pfeiffer, Tim Duente, and Michael Rohs. 2016. Let Your Body Move: A Prototyping Toolkit for Wearable Force Feedback with Electrical Muscle Stimulation. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (Florence, Italy) (MobileHCI ’16). Association for Computing Machinery, New York, NY, USA, 418–427. https://doi.org/10.1145/2935334.2935348Google ScholarDigital Library
- Andreas Pusch, Olivier Martin, and Sabine Coquillart. 2008. HEMP-Hand-Displacement-Based Pseudo-Haptics: A Study of a Force Field Application. In 2008 IEEE Symposium on 3D User Interfaces. 59–66. https://doi.org/10.1109/3DUI.2008.4476593Google ScholarDigital Library
- Andreas Pusch, Olivier Martin, and Sabine Coquillart. 2009. HEMP—hand-displacement-based pseudo-haptics: A study of a force field application and a behavioural analysis. International Journal of Human-Computer Studies 67, 3 (2009), 256–268. https://doi.org/10.1016/j.ijhcs.2008.09.015 Current trends in 3D user interface research.Google ScholarDigital Library
- Michael Rietzler, Florian Geiselhart, Julian Frommel, and Enrico Rukzio. 2018. Conveying the Perception of Kinesthetic Feedback in Virtual Reality Using State-of-the-Art Hardware. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174034Google ScholarDigital Library
- Michael Rietzler, Florian Geiselhart, Jan Gugenheimer, and Enrico Rukzio. 2018. Breaking the Tracking: Enabling Weight Perception Using Perceivable Tracking Offsets. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173702Google ScholarDigital Library
- Majed Samad, Elia Gatti, Anne Hermes, Hrvoje Benko, and Cesare Parise. 2019. Pseudo-Haptic Weight: Changing the Perceived Weight of Virtual Objects By Manipulating Control-Display Ratio. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300550Google ScholarDigital Library
- Stefan Schneegass, Albrecht Schmidt, and Max Pfeiffer. 2016. Creating User Interfaces with Electrical Muscle Stimulation. Interactions 24, 1 (dec 2016), 74–77. https://doi.org/10.1145/3019606Google ScholarDigital Library
- Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Taiju Aoki, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2018. Transcalibur: dynamic 2D haptic shape illusion of virtual object by weight moving VR controller. In ACM SIGGRAPH 2018 Posters. ACM, Vancouver British Columbia Canada, 1–2. https://doi.org/10.1145/3230744.3230804Google ScholarDigital Library
- The Healthline Editorial Team. 2018. Triceps anatomy, origin & function | body maps. https://www.healthline.com/human-body-maps/triceps#1Google Scholar
- Vonne van Polanen and Marco Davare. 2015. Sensorimotor Memory Biases Weight Perception During Object Lifting. Frontiers in Human Neuroscience 9 (2015). https://doi.org/10.3389/fnhum.2015.00700Google Scholar
- Vonne van Polanen, Robert Tibold, Atsuo Nuruki, and Marco Davare. 2019. Visual delay affects force scaling and weight perception during object lifting in virtual reality. Journal of Neurophysiology 121, 4 (2019), 1398–1409. https://doi.org/10.1152/jn.00396.2018 arXiv:https://doi.org/10.1152/jn.00396.2018PMID: 30673365.Google ScholarCross Ref
- Takeshi Yamamoto and Koichi Hirota. 2015. Recognition of weight through shaking interaction. In 2015 IEEE World Haptics Conference (WHC). IEEE, 451–456. https://doi.org/10.1109/WHC.2015.7177753Google ScholarCross Ref
- André Zenner and Antonio Krüger. 2019. Drag:On: A Virtual Reality Controller Providing Haptic Feedback Based on Drag and Weight Shift. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300441Google ScholarDigital Library
- André Zenner and Antonio Krüger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (April 2017), 1285–1294. https://doi.org/10.1109/TVCG.2017.2656978 Conference Name: IEEE Transactions on Visualization and Computer Graphics.Google ScholarDigital Library
- André Zenner, Kristin Ullmann, and Antonio Krüger. 2021. Combining Dynamic Passive Haptics and Haptic Retargeting for Enhanced Haptic Feedback in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 27, 5(2021), 2627–2637. https://doi.org/10.1109/TVCG.2021.3067777Google ScholarCross Ref
Index Terms
- Give Weight to VR: Manipulating Users’ Perception of Weight in Virtual Reality with Electric Muscle Stimulation
Recommendations
Virtual Weight Illusion: Weight Perception of Virtual Objects Using Weight Illusions
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing SystemsThis study investigated whether weight illusions in virtual reality (VR) without haptic feedback occur as in the real world. In the experiment, we set up three scenarios to cause three different weight illusions in VR: the size–weight illusion (smaller ...
Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsWe explore how to add haptics to walls and other heavy objects in virtual reality. When a user tries to push such an object, our system actuates the user's shoulder, arm, and wrist muscles by means of electrical muscle stimulation, creating a counter ...
Enabling Reusable Haptic Props for Virtual Reality by Hand Displacement
MuC '21: Proceedings of Mensch und Computer 2021Virtual Reality (VR) enables compelling visual experiences. However, providing haptic feedback is still challenging. Previous work suggests utilizing haptic props to overcome such limitations and presents evidence that props could function as a single ...
Comments