Hsin-Ruey Tsai
Yu-So Liao
ABSTRACT
Rendering instant and intense impact feedback on users’ hands, limbs and head to enhance realism in virtual reality (VR) has been proposed in previous works, but impact on the body is still less discussed. With the body’s large surface area to utilize, numerous impact patterns can be rendered in versatile VR applications, e.g., being shot, blasted, punched or slashed on body in VR games. Herein we propose ImpactVest to render spatio-temporal multilevel impact force feedback on body. By independently controlling nine impactors in a 3 × 3 layout using elastic force, impact is generated at different levels, positions and time sequences for versatile spatial and temporal combinations. We conducted a just-noticeable difference (JND) study to understand users’ impact level distinguishability on the body. A time interval threshold study was then performed to ascertain what time interval thresholds between two impact stimuli should be used to distinguish from simultaneous impact, a continuous impact stroke and two discrete impact stimuli. Based on the results, we conducted a VR experience study to verify that impact feedback from ImpactVest enhances VR realism.
Supplemental Material
- bHaptics. 2021. TactSuit. https://www.bhaptics.comGoogle Scholar
- Hong-Yu Chang, Wen-Jie Tseng, Chia-En Tsai, Hsin-Yu Chen, Roshan Lalintha Peiris, and Liwei Chan. 2018. FacePush: Introducing Normal Force on Face with Head-Mounted Displays. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 927–935. https://doi.org/10.1145/3242587.3242588Google ScholarDigital Library
- Inrak Choi, Eyal Ofek, Hrvoje Benko, Mike Sinclair, and Christian Holz. 2018. CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174228Google ScholarDigital Library
- Alexandra Delazio, Ken Nakagaki, Roberta L. Klatzky, Scott E. Hudson, Jill Fain Lehman, and Alanson P. Sample. 2018. Force Jacket: Pneumatically-Actuated Jacket for Embodied Haptic Experiences. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173894Google ScholarDigital Library
- Taichi Furukawa, Nobuhisa Hanamitsu, Yoichi Kamiyama, Hideaki Nii, Charalampos Krekoukiotis, Kouta Minamizawa, Akihito Noda, Junko Yamada, Keiichi Kitamura, Daisuke Niwa, Yoshiaki Hirano, and Tetsuya Mizuguchi. 2019. Synesthesia Wear: Full-Body Haptic Clothing Interface Based on Two-Dimensional Signal Transmission. In SIGGRAPH Asia 2019 Emerging Technologies. Association for Computing Machinery, New York, NY, USA, 48–50. https://doi.org/10.1145/3355049.3360524Google ScholarDigital Library
- TN Games. 2021. PHANTOMSENSE. https://tngames.com/Google Scholar
- Jun Gong, Da-Yuan Huang, Teddy Seyed, Te Lin, Tao Hou, Xin Liu, Molin Yang, Boyu Yang, Yuhan Zhang, and Xing-Dong Yang. 2018. Jetto: Using Lateral Force Feedback for Smartwatch Interactions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3174000Google ScholarDigital Library
- Seongkook Heo, Christina Chung, Geehyuk Lee, and Daniel Wigdor. 2018. Thor’s Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3174099Google ScholarDigital Library
- Ali Israr, Seung-Chan Kim, Jan Stec, and Ivan Poupyrev. 2012. Surround Haptics: Tactile Feedback for Immersive Gaming Experiences. In CHI ’12 Extended Abstracts on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1087–1090. https://doi.org/10.1145/2212776.2212392Google ScholarDigital Library
- Ali Israr and Ivan Poupyrev. 2010. Exploring Surround Haptics Displays. In CHI ’10 Extended Abstracts on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 4171–4176. https://doi.org/10.1145/1753846.1754121Google ScholarDigital Library
- A. Israr and I. Poupyrev. 2011. Control space of apparent haptic motion. In 2011 IEEE World Haptics Conference. 457–462.Google Scholar
- Ali Israr and Ivan Poupyrev. 2011. Tactile Brush: Drawing on Skin with a Tactile Grid Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 2019–2028. https://doi.org/10.1145/1978942.1979235Google ScholarDigital Library
- Ali Israr, Siyan Zhao, Kaitlyn Schwalje, Roberta Klatzky, and Jill Lehman. 2014. Feel Effects: Enriching Storytelling with Haptic Feedback. ACM Trans. Appl. Percept. 11, 3, Article 11 (Sept. 2014), 17 pages. https://doi.org/10.1145/2641570Google ScholarDigital Library
- Seungwoo Je, Myung Jin Kim, Woojin Lee, Byungjoo Lee, Xing-Dong Yang, Pedro Lopes, and Andrea Bianchi. 2019. Aero-Plane: A Handheld Force-Feedback Device That Renders Weight Motion Illusion on a Virtual 2D Plane. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 763–775. https://doi.org/10.1145/3332165.3347926Google ScholarDigital Library
- Seungwoo Je, Hyelip Lee, Myung Jin Kim, and Andrea Bianchi. 2018. Wind-Blaster: A Wearable Propeller-Based Prototype That Provides Ungrounded Force-Feedback. In ACM SIGGRAPH 2018 Emerging Technologies (Vancouver, British Columbia, Canada) (SIGGRAPH ’18). Association for Computing Machinery, New York, NY, USA, Article 23, 2 pages. https://doi.org/10.1145/3214907.3214915Google ScholarDigital Library
- Jinsoo Kim, Seungjae Oh, Chaeyong Park, and Seungmoon Choi. 2020. Body-Penetrating Tactile Phantom Sensations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376619Google ScholarDigital Library
- Yukari Konishi, Nobuhisa Hanamitsu, Kouta Minamizawa, Ayahiko Sato, and Tetsuya Mizuguchi. 2016. Synesthesia Suit: The Full Body Immersive Experience. In ACM SIGGRAPH 2016 Posters. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/2945078.2945149Google ScholarDigital Library
- Pedro Lopes, Alexandra Ion, and Patrick Baudisch. 2015. Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST ’15). Association for Computing Machinery, New York, NY, USA, 11–19. https://doi.org/10.1145/2807442.2807443Google ScholarDigital Library
- Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 1471–1482. https://doi.org/10.1145/3025453.3025600Google ScholarDigital Library
- Precision Microdrives. 2021. Model No. 334-401. https://catalogue.precisionmicrodrives.com/product/334-401-34mm-vibration-motor-30mm-typeGoogle Scholar
- Jun Murayama, Laroussi Bougrila, YanLin Luo, Katsuhito Akahane, Shoichi Hasegawa, Béat Hirsbrunner, and Makoto Sato. 2004. SPIDAR G&G: a two-handed haptic interface for bimanual VR interaction. In Proceedings of EuroHaptics, Vol. 2004. Citeseer, 138–146.Google Scholar
- Kazuki Nagai, Soma Tanoue, Katsuhito Akahane, and Makoto Sato. 2015. Wearable 6-DoF Wrist Haptic Device ”SPIDAR-W”. In SIGGRAPH Asia 2015 Haptic Media And Contents Design (Kobe, Japan) (SA ’15). Association for Computing Machinery, New York, NY, USA, Article 19, 2 pages. https://doi.org/10.1145/2818384.2818403Google ScholarDigital Library
- M. Nakamura and L. Jones. 2003. An actuator for the tactile vest - a torso-based haptic device. In 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings.333–339.Google Scholar
- Sayaka Ooshima, Yasushi Fukuzawa, Yuki Hashimoto, Hideyuki Ando, Junji Watanabe, and Hiroyuki Kajimoto. 2008. /Ed (Slashed): Gut Feelings When Being Cut and Pierced. In ACM SIGGRAPH 2008 New Tech Demos(Los Angeles, California) (SIGGRAPH ’08). Association for Computing Machinery, New York, NY, USA, Article 14, 1 pages. https://doi.org/10.1145/1401615.1401629Google ScholarDigital Library
- Tomoya Sasaki, Richard Sahala Hartanto, Kao-Hua Liu, Keitarou Tsuchiya, Atsushi Hiyama, and Masahiko Inami. 2018. Leviopole: Mid-Air Haptic Interactions Using Multirotor. In ACM SIGGRAPH 2018 Emerging Technologies (Vancouver, British Columbia, Canada) (SIGGRAPH ’18). Association for Computing Machinery, New York, NY, USA, Article 12, 2 pages. https://doi.org/10.1145/3214907.3214913Google ScholarDigital Library
- Jongman Seo, Sunung Mun, Jaebong Lee, and Seungmoon Choi. 2018. Substituting Motion Effects with Vibrotactile Effects for 4D Experiences. Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3173574.3174002Google ScholarDigital Library
- Yuqian Sun, Shigeo Yoshida, Takuji Narumi, and Michitaka Hirose. 2019. PaCaPa: A Handheld VR Device for Rendering Size, Shape, and Stiffness of Virtual Objects in Tool-Based Interactions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300682Google ScholarDigital Library
- Teslasuit. 2021. Teslasuit. https://teslasuit.io/Google Scholar
- Hsin-Ruey Tsai, Yuan-Chia Chang, Tzu-Yun Wei, Chih-An Tsao, Xander Chin-yuan Koo, Hao-Chuan Wang, and Bing-Yu Chen. 2021. GuideBand: Intuitive 3D Multilevel Force Guidance on a Wristband in Virtual Reality. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445262Google ScholarDigital Library
- Hsin-Ruey Tsai and Bing-Yu Chen. 2019. ElastImpact: 2.5D Multilevel Instant Impact Using Elasticity on Head-Mounted Displays. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 429–437. https://doi.org/10.1145/3332165.3347931Google ScholarDigital Library
- Hsin-Ruey Tsai and Jun Rekimoto. 2018. ElasticVR: Providing Multi-Level Active and Passive Force Feedback in Virtual Reality Using Elasticity. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3170427.3186540Google ScholarDigital Library
- Hsin-Ruey Tsai, Jun Rekimoto, and Bing-Yu Chen. 2019. ElasticVR: Providing Multilevel Continuously-Changing Resistive Force and Instant Impact Using Elasticity for VR. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3290605.3300450Google ScholarDigital Library
- Dzmitry Tsetserukou, Katsunari Sato, and Susumu Tachi. 2010. ExoInterfaces: Novel Exosceleton Haptic Interfaces for Virtual Reality, Augmented Sport and Rehabilitation. In Proceedings of the 1st Augmented Human International Conference (Megève, France) (AH ’10). Association for Computing Machinery, New York, NY, USA, Article 1, 6 pages. https://doi.org/10.1145/1785455.1785456Google ScholarDigital Library
- Yu-Wei Wang, Yu-Hsin Lin, Pin-Sung Ku, Yōko Miyatake, Yi-Hsuan Mao, Po Yu Chen, Chun-Miao Tseng, and Mike Y. Chen. 2021. JetController: High-Speed Ungrounded 3-DoF Force Feedback Controllers Using Air Propulsion Jets. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445549Google ScholarDigital Library
- Tzu-Yun Wei, Hsin-Ruey Tsai, Yu-So Liao, Chieh Tsai, Yi-Shan Chen, Chi Wang, and Bing-Yu Chen. 2020. ElastiLinks: Force Feedback between VR Controllers with Dynamic Points of Application of Force. In Proceedings of the 33nd Annual ACM Symposium on User Interface Software and Technology.Google ScholarDigital Library
- Yuan-Syun Ye, Hsin-Yu Chen, and Liwei Chan. 2019. Pull-Ups: Enhancing Suspension Activities in Virtual Reality with Body-Scale Kinesthetic Force Feedback. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 791–801. https://doi.org/10.1145/3332165.3347874Google ScholarDigital Library
- G. Yun, S. Oh, and S. Choi. 2019. Seamless Phantom Sensation Moving Across a Wide Range of Body. In 2019 IEEE World Haptics Conference (WHC). 616–621.Google Scholar
- Andre Zenner and Antonio Kruger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (April 2017), 1285–1294. https://doi.org/10.1109/TVCG.2017.2656978Google ScholarDigital Library
Index Terms
- ImpactVest: Rendering Spatio-Temporal Multilevel Impact Force Feedback on Body in VR
Recommendations
ElastImpact: 2.5D Multilevel Instant Impact Using Elasticity on Head-Mounted Displays
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and TechnologyImpact is a common effect in both daily life and virtual reality (VR) experiences, e.g., being punched, hit or bumped. Impact force is instantly produced, which is distinct from other force feedback, e.g., push and pull. We propose ElastImpact to ...
ELAXO : Rendering Versatile Resistive Force Feedback for Fingers Grasping and Twisting
UIST '22: Proceedings of the 35th Annual ACM Symposium on User Interface Software and TechnologyHaptic feedback not only enhances immersion in virtual reality (VR) but also delivers experts’ haptic sensation tips in VR training, e.g., properly clamping a tenon and mortise joint or tightening a screw in the assembly of VR factory training, which ...
ElastiLinks: Force Feedback between VR Controllers with Dynamic Points of Application of Force
UIST '20: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and TechnologyForce feedback is commonly used to enhance realism in virtual reality (VR). However, current works mainly focus on providing different force types or patterns, but do not investigate how a proper point of application of force (PAF), which means where ...
Comments