skip to main content
10.1145/3025453.3025744acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Fingertip Tactile Devices for Virtual Object Manipulation and Exploration

Published: 02 May 2017 Publication History

Abstract

One of the main barriers to immersivity during object manipulation in virtual reality is the lack of realistic haptic feedback. Our goal is to convey compelling interactions with virtual objects, such as grasping, squeezing, pressing, lifting, and stroking, without requiring a bulky, world-grounded kinesthetic feedback device (traditional haptics) or the use of predetermined passive objects (haptic retargeting). To achieve this, we use a pair of finger-mounted haptic feedback devices that deform the skin on the fingertips to convey cutaneous force information from object manipulation. We show that users can perceive differences in virtual object weight and that they apply increasing grasp forces when lifting virtual objects as rendered mass is increased. Moreover, we show how naive users perceive changes of a virtual object's physical properties when we use skin deformation to render objects with varying mass, friction, and stiffness. These studies demonstrate that fingertip skin deformation devices can provide a compelling haptic experience appropriate for virtual reality scenarios involving object manipulation.

Supplementary Material

suppl.mov (pn2443.mp4)
Supplemental video
suppl.mov (pn2443p.mp4)
Supplemental video

References

[1]
I. Birznieks, P. Jenmalm, A. W. Goodwin, and R. S. Johansson. 2001. Encoding of Direction of Fingertip Forces by Human Tactile Afferents. The Journal of Neuroscience 21, 20 (2001), 8222--8237.
[2]
T. Carter, S. A. Seah, B. Long, B. Drinkwater, and S. Subramanian. 2013. UltraHaptics: multi-point mid-air haptic feedback for touch surfaces. In ACM Symposium on User Interface Software and Technology. 505--514.
[3]
F. Conti, F. Barbagli, D. Morris, and C. Sewell. 2005. CHAI3D: An open-source library for the rapid development of haptic scenes. In IEEE World Haptics Conference. 21--29.
[4]
M. O. Ernst and M. S. Banks. 2002. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 6870 (2002), 429--433.
[5]
M. Gabardi, M. Solazzi, D. Leonardis, and A. Frisoli. 2016. A new wearable fingertip haptic interface for the rendering of virtual shapes and surface features. In IEEE Haptics Symposium. 140--146.
[6]
A. Girard, M. Marchal, F. Gosselin, A. Chabrier, F. Louveau, and A. LÃl'cuyer. 2016. HapTip: Displaying Haptic Shear Forces at the Fingertips for Multi-Finger Interaction in Virtual Environments. Frontiers in ICT 3 (2016), 6.
[7]
X. Gu, Y. Zhang, W. Sun, Y. Bian, D. Zhou, and P. O. Kristensson. 2016. Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR. In Conference on Human Factors in Computing Systems. 1991--1995.
[8]
M. Hara, C. Asada, T. Higuchi, and T. Yabuta. 2004. Perceptual illusion in virtual reality using haptic interface. In IEEE/RSJ International Conference on Intelligent Robots and Systems. 3901--3906.
[9]
W. S. Harwin and N. Melder. 2002. Improved haptic rendering for multi-finger manipulation using friction cone based god-objects. In Eurohaptics Conference.
[10]
E. Heineken and F. P. Schulte. 2007. Seeing size and feeling weight: The size-weight illusion in natural and virtual reality. Human Factors: The Journal of the Human Factors and Ergonomics Society 49, 1 (2007), 136--144.
[11]
K. O. Johnson. 2001. The roles and functions of cutaneous mechanoreceptors. Current Opinion in Neurobiology 11, 4 (2001), 455 -- 461.
[12]
K.J. Kuchenbecker, J. Fiene, and G. Niemeyer. 2006. Improving contact realism through event-based haptic feedback. IEEE Transactions on Visualization and Computer Graphics 12, 2 (2006), 219--230.
[13]
D. Leonardis, M. Solazzi, I. Bortone, and A. Frisoli. 2015. A wearable fingertip haptic device with 3 DoF asymmetric 3-RSR kinematics. In IEEE World Haptics Conference. 388--393.
[14]
W. McMahan, J. Gewirtz, D. Standish, P. Martin, J.A. Kunkel, M. Lilavois, A. Wedmid, D. I. Lee, and K. J. Kuchenbecker. 2011. Tool contact acceleration feedback for telerobotic surgery. IEEE Transactions on Haptics 4, 3 (2011), 210 --220.
[15]
Kouta Minamizawa, Domenico Prattichizzo, and Susumu Tachi. 2010. Simplified design of haptic display by extending one-point kinesthetic feedback to multipoint tactile feedback. In IEEE Haptics Symposium. 257--260.
[16]
N. Nakazawa, R. Ikeura, and H. Inooka. 2000. Characteristics of human fingertips in the shearing direction. Biological Cybernetics 82, 3 (2000), 207--214.
[17]
C. Pacchierotti, D. Prattichizzo, and K. J. Kuchenbecker. 2016. Cutaneous feedback of fingertip deformation and vibration for palpation in robotic surgery. IEEE Transactions on Biomedical Engineering 63, 2 (2016), 278--287.
[18]
A. G. Perez, D. Lobo, F. Chinello, G. Cirio, M. Malvezzi, J. S. Martín, D. Prattichizzo, and M. A. Otaduy. 2015. Soft finger tactile rendering for wearable haptics. In IEEE World Haptics Conference. 327--332.
[19]
D. Prattichizzo, F. Chinello, C. Pacchierotti, and M. Malvezzi. 2013. Towards wearability in fingertip haptics: A 3-DoF wearable device for cutaneous force feedback. IEEE Transactions on Haptics 6, 4 (2013), 506--516.
[20]
W. R. Provancher and N. D. Sylvester. 2009. Fingerpad skin stretch increases the perception of virtual friction. IEEE Transactions on Haptics 2, 4 (2009), 212--223.
[21]
Z. F. Quek, S. B. Schorr, I. Nisky, A. M. Okamura, and W. R. Provancher. 2014. Sensory substitution using 3-degree-of-freedom tangential and normal skin deformation feedback. In IEEE Haptics Symposium. 27--33.
[22]
Z. F. Quek, S. B. Schorr, I. Nisky, W. R. Provancher, and A. M. Okamura. 2015. Sensory substitution and augmentation using 3-degree-of-freedom skin deformation feedback. IEEE Transactions on Haptics 8, 2 (2015), 209--221.
[23]
R. E. Schoonmaker and C. G. L. Cao. 2006. Vibrotactile force feedback system for minimally invasive surgical procedures. In IEEE International Conference on Systems, Man and Cybernetics. 2464 --2469.
[24]
S. B. Schorr, Z. F. Quek, I. Nisky, W. R. Provancher, and A. M. Okamura. 2015. Tactor-induced skin stretch as a sensory substitution method in teleoperated palpation. IEEE Transactions on Human-Machine Systems 45, 6 (2015), 714--726.
[25]
L. Sjöberg. 1969. Sensation scales in the size weight illusion. Scandinavian Journal of Psychology 10, 1 (1969), 109--112.
[26]
J. M. Suchoski, A. Barron, C. Wu, Z. F. Quek, S. Keller, and A. M. Okamura. 2016. Comparison of kinesthetic and skin deformation feedback for mass rendering. In IEEE International Conference on Robotics and Automation. 4030--4035.
[27]
A. G. Witney, A. Wing, J.L. Thonnard, and A. M. Smith. 2004. The cutaneous contribution to adaptive precision grip. Trends in Neurosciences 27, 10 (2004), 637--643.

Cited By

View all
  • (2025)HAPshop: How Haptic Information Affects Consumers’ Purchase Intentions toward Online ProductsComputers in Human Behavior10.1016/j.chb.2025.108580(108580)Online publication date: Jan-2025
  • (2025)A Soft Glove with Proprioceptive Sensing and Multi-modal Haptic Feedback for VR and Telerobotic ApplicationsJournal of Bionic Engineering10.1007/s42235-024-00642-zOnline publication date: 7-Feb-2025
  • (2024)Enhancing User Experience in Virtual Museums: Impact of Finger Vibrotactile FeedbackApplied Sciences10.3390/app1415659314:15(6593)Online publication date: 28-Jul-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
May 2017
7138 pages
ISBN:9781450346559
DOI:10.1145/3025453
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2017

Permissions

Request permissions for this article.

Check for updates

Badges

  • Best Paper

Author Tags

  1. haptics
  2. mass perception
  3. virtual reality

Qualifiers

  • Research-article

Funding Sources

Conference

CHI '17
Sponsor:

Acceptance Rates

CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)308
  • Downloads (Last 6 weeks)21
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)HAPshop: How Haptic Information Affects Consumers’ Purchase Intentions toward Online ProductsComputers in Human Behavior10.1016/j.chb.2025.108580(108580)Online publication date: Jan-2025
  • (2025)A Soft Glove with Proprioceptive Sensing and Multi-modal Haptic Feedback for VR and Telerobotic ApplicationsJournal of Bionic Engineering10.1007/s42235-024-00642-zOnline publication date: 7-Feb-2025
  • (2024)Enhancing User Experience in Virtual Museums: Impact of Finger Vibrotactile FeedbackApplied Sciences10.3390/app1415659314:15(6593)Online publication date: 28-Jul-2024
  • (2024)Object Selection and Manipulation in VR Headsets: Research Challenges, Solutions, and Success MeasurementsACM Computing Surveys10.1145/370641757:4(1-34)Online publication date: 30-Nov-2024
  • (2024)Demonstrating Haptic Source-Effector: Full-Body Haptics via Non-Invasive Brain StimulationAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686756(1-3)Online publication date: 13-Oct-2024
  • (2024)Demonstration of JetUnit: Rendering Diverse Force Feedback in Virtual Reality Using Water JetsAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686742(1-3)Online publication date: 13-Oct-2024
  • (2024)JetUnit: Rendering Diverse Force Feedback in Virtual Reality Using Water JetsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676440(1-15)Online publication date: 13-Oct-2024
  • (2024)Can a Smartwatch Move Your Fingers? Compact and Practical Electrical Muscle Stimulation in a SmartwatchProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676373(1-15)Online publication date: 13-Oct-2024
  • (2024)vARitouch: Back of the Finger Device for Adding Variable Compliance to Rigid ObjectsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642828(1-20)Online publication date: 11-May-2024
  • (2024)Experiencing Dynamic Weight Changes in Virtual Reality Through Pseudo-Haptics and Vibrotactile FeedbackProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642552(1-13)Online publication date: 11-May-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media