Jaeyeon Lee
Mike Sinclair
Eyal Ofek
ABSTRACT
Recent hand-held controllers have explored a variety of haptic feedback sensations for users in virtual reality by producing both kinesthetic and cutaneous feedback from virtual objects. These controllers are grounded to the user's hand and can only manipulate objects through arm and wrist motions, not using the dexterity of their fingers as they would in real life. In this paper, we present TORC, a rigid haptic controller that renders virtual object characteristics and behaviors such as texture and compliance. Users hold and squeeze TORC using their thumb and two fingers and interact with virtual objects by sliding their thumb on TORC's trackpad. During the interaction, vibrotactile motors produce sensations to each finger that represent the haptic feel of squeezing, shearing or turning an object. Our evaluation showed that using TORC, participants could manipulate virtual objects more precisely (e.g., position and rotate objects in 3D) than when using a conventional VR controller.
Supplemental Material
- Parastoo Abtahi and Sean Follmer. 2018. Visuo-Haptic Illusions for Improving the Perceived Performance of Shape Displays. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--13. Google Scholar
Digital Library
- Merwan Achibet, Maud Marchal, Ferran Argelaguet, and Anatole Lecuyer. 2014. The Virtual Mitten: A novel interaction paradigm for visuo-haptic manipulation of objects using grip force. In 2014 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 59--66.Google ScholarCross Ref
- Michael J Adams, Simon A Johnson, Philippe Lefèvre, Vincent Lévesque, Vincent Hayward, Thibaut André, and Jean-Louis Thonnard. 2013. Finger pad friction and its role in grip and touch. Journal of The Royal Society Interface 10, 80 (3 2013).Google ScholarCross Ref
- Ferran Argelaguet, David Antonio GÃmez Jáuregui, Maud Marchal, and Anatole Lécuyer. 2013. Elastic images: Perceiving local elasticity of images through a novel pseudo-haptic deformation effect. ACM Transactions on Applied Perception (TAP) 10, 3 (2013), 17. Google ScholarDigital Library
- Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, 717--728. Google ScholarDigital Library
- Christopher C Berger and Mar Gonzalez-Franco. 2018. Expanding the Sense of Touch Outside the Body. In Proceedings of the 15th ACM Symposium on Applied Perception, Vol. SAP '18. ACM, Vancouver, 10:1-- 10:9. Google ScholarDigital Library
- Christopher C Berger, Mar Gonzalez-Franco, Eyal Ofek, and Ken Hinckley. 2018. The uncanny valley of haptics. Science Robotics 3, 17 (4 2018).Google Scholar
- Ray Bittner and Mike Sinclair. 2009. VersaPatch: A Low Cost 2.5D Capacitive Touch Sensor. Springer, Berlin, Heidelberg, 407--416.Google Scholar
- Conrad Bullion and Hakan Gurocak. 2009. Haptic Glove with MR Brakes for Distributed Finger Force Feedback. Presence: Teleoperators and Virtual Environments 18, 6 (12 2009), 421--433. Google ScholarDigital Library
- Francesco Chinello, Claudio Pacchierotti, Monica Malvezzi, and Domenico Prattichizzo. 2018. A Three Revolute-Revolute-Spherical Wearable Fingertip Cutaneous Device for Stiffness Rendering. IEEE Transactions on Haptics 11, 1 (1 2018), 39--50.Google ScholarCross Ref
- Inrak Choi, Heather Culbertson, Mark R. Miller, Alex Olwal, and Sean Follmer. 2017. Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, 119--130. Google ScholarDigital Library
- Inrak Choi, Elliot W. Hawkes, David L. Christensen, Christopher J. Ploch, and Sean Follmer. 2016. Wolverine: A wearable haptic interface for grasping in virtual reality. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 986--993.Google ScholarDigital Library
- Inrak Choi, Eyal Ofek, Hrvoje Benko, Mike Sinclair, and Christian Holz. 2018. CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--13. Google ScholarDigital Library
- H. Culbertson and K. J. Kuchenbecker. 2015. Should haptic texture vibrations respond to user force and speed?. In 2015 IEEE World Haptics Conference (WHC). 106--112.Google Scholar
- H. Culbertson, J. Unwin, and K. J. Kuchenbecker. 2014. Modeling and Rendering Realistic Textures from Unconstrained Tool-Surface Interactions. IEEE Transactions on Haptics 7, 3 (7 2014), 381--393.Google ScholarCross Ref
- Mark R Cutkosky. 1989. On grasp choice, grasp models, and the design of hands for manufacturing tasks. IEEE Transactions on robotics and automation 5, 3 (1989), 269--279.Google ScholarCross Ref
- Ravin de Souza, Sahar El-Khoury, Jos Santos-Victor, and Aude Billard. 2015. Recognizing the grasp intention from human demonstration. Robotics and Autonomous Systems 74, PA (12 2015), 108--121. Google ScholarDigital Library
- Brian Dellon and Yoky Matsuoka. 2007. Prosthetics, exoskeletons, and rehabilitation {grand challenges of robotics}. IEEE robotics & automation magazine 14, 1 (2007), 30--34.Google ScholarCross Ref
- L. Dominjon, A. Lecuyer, J. Burkhardt, P. Richard, and S. Richir. 2005. Influence of control/display ratio on the perception of mass of manipulated objects in virtual environments. In IEEE Proceedings. VR 2005. Virtual Reality, 2005. IEEE, 19--318. Google ScholarDigital Library
- Thomas Feix, Javier Romero, Heinz-Bodo Schmiedmayer, Aaron M. Dollar, and Danica Kragic. 2016. The GRASP Taxonomy of Human Grasp Types. IEEE Transactions on Human-Machine Systems 46, 1 (2 2016), 66--77.Google ScholarCross Ref
- Mar Gonzalez-Franco and Jaron Lanier. 2017. Model of Illusions and Virtual Reality., 1125 pages.Google Scholar
- Mar Gonzalez-Franco, Antonella Maselli, DInei Florencio, Nikolai Smolyanskiy, and Zhengyou Zhang. 2017. Concurrent talking in immersive virtual reality: On the dominance of visual speech cues. Scientific Reports (2017).Google Scholar
- Mar Gonzalez-Franco and Tabitha C. Peck. 2018. Avatar Embodiment. Towards a Standardized Questionnaire. Frontiers in Robotics and AI 5 (6 2018), 74.Google Scholar
- Xiaochi Gu, Yifei Zhang, Weize Sun, Yuanzhe Bian, Dao Zhou, and Per Ola Kristensson. 2016. Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, 1991-1995. Google ScholarDigital Library
- Seongkook Heo and Geehyuk Lee. 2017. Vibrotactile Compliance Feedback for Tangential Force Interaction. IEEE Transactions on Haptics 10, 3 (7 2017), 444--455.Google ScholarDigital Library
- Ronan Hinchet, Velko Vechev, Herbert Shea, and Otmar Hilliges. 2018. DextrES. In The 31st Annual ACM Symposium on User Interface Software and Technology - UIST '18. ACM Press, New York, New York, USA, 901-- 912. Google ScholarDigital Library
- HyunKi In, Kyu-Jin Cho, KyuRi Kim, and BumSuk Lee. 2011. Jointless structure and under-actuation mechanism for compact hand exoskeleton. In 2011 IEEE International Conference on Rehabilitation Robotics. IEEE, 1--6.Google Scholar
- Hyunki In, Brian Byunghyun Kang, MinKi Sin, and Kyu-Jin Cho. 2015. Exo-Glove: A Wearable Robot for the Hand with a Soft Tendon Routing System. IEEE Robotics & Automation Magazine 22, 1 (3 2015), 97--105.Google ScholarCross Ref
- Johan Kildal. 2011. Tangible 3D Haptics on Touch Surfaces: Virtual Compliance. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11). ACM, New York, 1123--1128. Google ScholarDigital Library
- Johan Kildal. 2012. Kooboh: Variable Tangible Properties in a Handheld Haptic-Illusion Box. Springer, Berlin, Heidelberg, 191--194. Google ScholarDigital Library
- Hwan Kim, HyeonBeom Yi, Hyein Lee, and Woohun Lee. 2018. HapCube: A Wearable Tactile Device to Provide Tangential and Normal Pseudo-Force Feedback on a Fingertip. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, 1--501. Google ScholarDigital Library
- Sunjun Kim and Geehyuk Lee. 2013. Haptic feedback design for a virtual button along force-displacement curves. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13. ACM Press, New York, New York, USA, 91--96. Google ScholarDigital Library
- Seung-Chan Kim, Chong Hui Kim, Tae-Hon Yang, Gi-Hun Yang, SungChul Kang, and Dong-Soo Kwon. 2008. SaLT: Small and lightweight tactile display using ultrasonic actuators. In RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication. IEEE, 430--435.Google Scholar
- Yeongmi Kim, Ian Oakley, and Jeha Ryu. 2014. Combining Point Force Haptic and Pneumatic Tactile Displays LAMS: Location Aware Multimedia Storytelling View project YouGrabber View project Combining Point Force Haptic and Pneumatic Tactile Displays. Technical Report. https://www.researchgate.net/publication/252603525Google Scholar
- Roberta L. Klatzky and Susan Lederman. 1990. Intelligent Exploration by the Human Hand. In Dextrous Robot Hands. Springer New York, New York, NY, 66--81. Google ScholarDigital Library
- Inwook Koo, Brian Byunghyun Kang, and Kyu-Jin Cho. 2013. Development of Hand Exoskeleton using Pneumatic Artificial Muscle Combined with Linkage. Journal of the Korean Society for Precision Engineering 30, 11 (11 2013), 1217--1224.Google ScholarCross Ref
- Anatole Lécuyer. 2009. Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-Haptic Feedback. Presence: Teleoperators and Virtual Environments 18, 1 (2 2009), 39--53. Google ScholarDigital Library
- Anatole Lecuyer. 2017. Playing with Senses in VR: Alternate Perceptions Combining Vision and Touch. IEEE Computer Graphics and Applications 37, 1 (2017), 20--26.Google ScholarDigital Library
- Anatole Lécuyer, Jean-Marie Burkhardt, and Laurent Etienne. 2004. Feeling bumps and holes without a haptic interface. In Proceedings of the 2004 conference on Human factors in computing systems - CHI '04. ACM Press, New York, New York, USA, 239--246. Google ScholarDigital Library
- A. Lecuyer, S. Coquillart, A. Kheddar, P. Richard, and P. Coiffet. 2000. Pseudo-haptic feedback: can isometric input devices simulate force feedback?. In Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048). IEEE Comput. Soc, 83--90. Google ScholarDigital Library
- Susan J. Lederman and Lynette A. Jones. 2011. Tactile and Haptic Illusions. IEEE Transactions on Haptics 4, 4 (10 2011), 273--294. Google ScholarDigital Library
- Christine L MacKenzie and Thea Iberall. 1994. The grasping hand. Vol. 104. Elsevier.Google Scholar
- Kouta Minamizawa, Souichiro Fukamachi, Hiroyuki Kajimoto, Naoki Kawakami, and Susumu Tachi. 2007. Gravity grabber: wearable haptic display to present virtual mass sensation. ACM SIGGRAPH 2007 emerging technologies (2007), 8. Google ScholarDigital Library
- A.M. Okamura, N. Smaby, and M.R. Cutkosky. 2000. An overview of dexterous manipulation. In Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065), Vol. 1. IEEE, 255--262.Google ScholarCross Ref
- George L Peterson and Thomas C Brown. 1998. Economic Valuation by the Method of Paired Comparison, with Emphasis on Evaluation of the Transitivity Axiom. Land Economics 74(2), May (1998), 240--261.Google ScholarCross Ref
- William R. Provancher, Mark R. Cutkosky, Katherine J. Kuchenbecker, and Gijnter Niemeyer. 2005. Contact Location Display for Haptic Perception of Curvature and Object Motion. The International Journal of Robotics Research 24, 9 (9 2005), 691--702. Google ScholarDigital Library
- Jun Rekimoto. 2013. Traxion. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13. ACM Press, New York, New York, USA, 427--432. Google ScholarDigital Library
- I. Sarakoglou, N. Tsagarakis, and D.G. Caldwell. 2005. A Portable Fingertip Tactile Feedback Array Transmission System Reliability and Modelling. In First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, 547--548. Google ScholarDigital Library
- Samuel B. Schorr and Allison M. Okamura. 2017. Fingertip Tactile Devices for Virtual Object Manipulation and Exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. ACM Press, New York, New York, USA, 3115--3119. Google ScholarDigital Library
- Evan Strasnick, Christian Holz, Eyal Ofek, Mike Sinclair, and Hrvoje Benko. 2018. Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, 1--644. Google ScholarDigital Library
- Jacob Thorn, Rodrigo Pizarro, Bernhard Spanlang, Pablo BermellGarcia, and Mar Gonzalez-Franco. 2016. Assessing 3D Scan Quality Through Paired-comparisons Psychophysics. In Proceedings of the 2016 ACM on Multimedia Conference - MM '16. ACM Press, New York, New York, USA, 147--151. Google ScholarDigital Library
- Krist Vaesen. 2012. The cognitive bases of human tool use. Behavioral and Brain Sciences 35, 4 (2012), 203--218.Google ScholarCross Ref
- Yon Visell, Bruno L. Giordano, Guillaume Millet, and Jeremy R. Cooperstock. 2011. Vibration Influences Haptic Perception of Surface Compliance During Walking. PLoS ONE 6, 3 (3 2011), e17697.Google Scholar
- Eric Whitmire, Hrvoje Benko, Christian Holz, Eyal Ofek, and Mike Sinclair. 2018. Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, 86:1--86:12. Google ScholarDigital Library
- Vibol Yem, Ryuta Okazaki, and Hiroyuki Kajimoto. 2016. FinGAR. In ACM SIGGRAPH 2016 Emerging Technologies on - SIGGRAPH '16. ACM Press, New York, New York, USA, 1--2. Google ScholarDigital Library
- Vibol Yem, Kevin Vu, Yuki Kon, and Hiroyuki Kajimoto. 2018. Effect of Electrical Stimulation Haptic Feedback on Perceptions of SoftnessHardness and Stickiness While Touching a Virtual Object. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 89--96.Google Scholar
- T. Yoshioka, S. J. Bensmaïa, J. C. Craig, and S. S. Hsiao. 2007. Texture perception through direct and indirect touch: An analysis of perceptual space for tactile textures in two modes of exploration. Somatosensory & Motor Research 24, 1--2 (1 2007), 53--70.Google ScholarCross Ref
- Sung-Sik Yun, Brian Byunghyun Kang, and Kyu-Jin Cho. 2017. ExoGlove PM: An Easily Customizable Modularized Pneumatic Assistive Glove. IEEE Robotics and Automation Letters 2, 3 (7 2017), 1725--1732.Google ScholarCross Ref
- Andre Zenner and Antonio Kruger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (4 2017), 1285--1294. Google ScholarDigital Library
Index Terms
- TORC: A Virtual Reality Controller for In-Hand High-Dexterity Finger Interaction
Recommendations
Demonstration of TORC: A Virtual Reality Controller for In-Hand High-Dexterity Finger Interaction
UIST '19 Adjunct: Adjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and TechnologyRecent hand-held controllers have explored a variety of haptic feedback sensations for users in virtual reality by producing both kinesthetic and cutaneous feedback from virtual objects. These controllers are grounded to the user's hand and can only ...
Procedural haptic texture
UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technologyWe present the Haptic Shading Framework (HSF), a framework for procedurally defining haptic texture. HSF haptic texture shaders are short procedures allowing an application-programmer to easily define interesting haptic surface interaction and the ...
AoEs: enhancing teleportation experience in immersive environment with mid-air haptics
SIGGRAPH '17: ACM SIGGRAPH 2017 Emerging TechnologiesTo alleviate cybersickness in the immersive virtual reality (VR), teleportation is a common method of moving around in virtual spaces. Although users can receive the visual and auditory feedbacks from their first-person perspective with the advances of ...
Comments