skip to main content
10.1145/3025453.3025753acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop

Published: 02 May 2017 Publication History

Abstract

We propose a class of passive haptics that we call Sparse Haptic Proxy: a set of geometric primitives that simulate touch feedback in elaborate virtual reality scenes. Unlike previous passive haptics that replicate the virtual environment in physical space, a Sparse Haptic Proxy simulates a scene's detailed geometry by redirecting the user's hand to a matching primitive of the proxy. To bridge the divergence of the scene from the proxy, we augment an existing Haptic Retargeting technique with an on-the-fly target remapping: We predict users' intentions during interaction in the virtual space by analyzing their gaze and hand motions, and consequently redirect their hand to a matching part of the proxy. We conducted three user studies on haptic retargeting technique and implemented a system from three main results: 1) The maximum angle participants found acceptable for retargeting their hand is 40°, with an average rating of 4.6 out of 5. 2) Tracking participants' eye gaze reliably predicts their touch intentions (97.5%), even while simultaneously manipulating the user's hand-eye coordination for retargeting. 3) Participants preferred minimized retargeting distances over better-matching surfaces of our Sparse Haptic Proxy when receiving haptic feedback for single-finger touch input. We demonstrate our system with two virtual scenes: a flight cockpit and a room quest game. While their scene geometries differ substantially, both use the same sparse haptic proxy to provide haptic feedback to the user during task completion.

Supplementary Material

suppl.mov (pn2491-file3.mp4)
Supplemental video
suppl.mov (pn2491p.mp4)
Supplemental video

References

[1]
Azmandian, M., Hancock, M., Benko, H., Ofek, E., and Wilson, A. 2016. Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 1968--1979.
[2]
Ban, Y., Kajinami, T., Narumi, T., Tanikawa, T., and Hirose, M. (2012). Modifying an identified angle of edged shapes using pseudo-haptic effects. In Proceedings of the International Conference on Haptics: Perception, Devices, Mobility, and Communication, 25 of
[3]
Bergamasco M., Allotta B., Bosio L., Ferretti L., Parrini G., Prisco G.M., Salsedo F., Sartini G. 1994. An arm exoskeleton system for teleoperation and virtual environments applications. In Proceedings of IEEE International Conference on Robotics and Automation. 2, 1449--1454. http://doi.org/10.1109/ROBOT.1994.351286
[4]
Binsted, G., Chua, R., Helsen, W., and Elliott, D. Eyehand coordination in goal-directed aiming. Human Movement Science 20, 4--5 (2001), 563--585.
[5]
Burns, E., Razzaque, S., Whitton, M.C., and Brooks, F.P. 2007. MACBETH: The avatar which I see before me and its movement toward my hand. In Proceedings of IEEE Virtual Reality Conference, 295--296.
[6]
Frederick P. Brooks, Jr., Ming Ouh-Young, James J. Batter, and P. Jerome Kilpatrick. 1990. Project GROPEHaptic displays for scientific visualization. SIGGRAPH Comput. Graph. 24, 4 (September 1990), 177--185. DOI=http://dx.doi.org/10.1145/97880.97899
[7]
Lung-Pan Cheng, Thijs Roumen, Hannes Rantzsch, Sven Köhler, Patrick Schmidt, Robert Kovacs, Johannes Jasper, Jonas Kemper, and Patrick Baudisch. 2015. TurkDeck: Physical Virtual Reality Based on People. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, NY, NY, USA, 417--426.
[8]
Conti, F. and Khatib, O. 2005. Spanning large workspaces using small haptic devices. In Proceedings of First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 183--188.
[9]
Christian Corsten, Ignacio Avellino, Max Möllers, and Jan Borchers. 2013. Instant user interfaces: repurposing everyday objects as input devices. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces (ITS '13). ACM, NY, NY, USA, 71--80. DOI=http://dx.doi.org/10.1145/2512349.2512799
[10]
George W. Fitzmaurice, Hiroshi Ishii, and William A. S. Buxton. 1995. Bricks: laying the foundations for graspable user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '95), Irvin R. Katz, Robert Mack, Linn Marks, Mary Beth Rosson, and Jakob Nielsen (Eds.). ACM Press/Addison-Wesley Publishing Co., NY, NY, USA, 442--449.
[11]
Goertz, R. and Thompson, R. 1954. Electronically controlled manipulator. Nucleonics, 12, 11, 46--47.
[12]
Steven J. Henderson and Steven Feiner. 2008. Opportunistic controls: leveraging natural affordances as tangible user interfaces for augmented reality. In Proceedings of the 2008 ACM symposium on Virtual reality software and technology (VRST '08). ACM, NY, NY, USA, 211--218. DOI=http://dx.doi.org/10.1145/1450579.1450625
[13]
Anuruddha Hettiarachchi and Daniel Wigdor. 2016. Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in Augmented Reality. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 1957--1967.
[14]
Ken Hinckley, Randy Pausch, John C. Goble, and Neal F. Kassell. 1994. Passive real-world interface props for neurosurgical visualization. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94), Beth Adelson, Susan Dumais, and Judith Olson (Eds.). ACM, NY, NY, USA, 452458. DOI=http://dx.doi.org/10.1145/191666.191821
[15]
Hughes, C.E., Stapleton, C.B., Hughes, D.E., Smith, E.M. 2005. Mixed reality in education, entertainment, and training. Computer Graphics and Applications, 25, 6, 24--30.
[16]
Hiroo Iwata, Hiroaki Yano, Fumitaka Nakaizumi, and Ryo Kawamura. 2001. Project FEELEX: adding haptic surface to graphics. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques (SIGGRAPH '01). ACM, NY, NY, USA, 469--476. DOI=http://dx.doi.org/10.1145/383259.383314
[17]
Ivan E. Sutherland. 1965. The ultimate display. In Proceedings of the Congress of the International Federation of Information Processing (IFIP), 506--508. http://doi.org/10.1109/MC.2005.274
[18]
Kohli, L. 2010. Redirected touching: Warping space to remap passive haptics. In Proceedings of IEEE Symposium on 3D User Interfaces (3DUI), 2010, 129--130. http://doi.org/10.1109/3DUI.2010.5444703
[19]
Kohli, L., Burns, E., Miller, D., and Fuchs, H. 2005. Combining Passive Haptics with Redirected Walking. In Proceedings of the 2005 International Conference on Augmented Tele-existence, 253--254.
[20]
Kohli, L., Whitton, M.C., and Brooks, F.P. 2012. Redirected touching: The effect of warping space on task performance. IEEE Symposium on 3D User Interfaces (3DUI), 105--112.
[21]
Kohli, L., Whitton, M.C., and Brooks, F.P. 2013. Redirected Touching: Training and adaptation in warped virtual spaces. IEEE Symposium on 3D User Interfaces (3DUI), 79--86.
[22]
Kok-Lim Low, Greg Welch, Anselmo Lastra, and Henry Fuchs. 2001. Life-sized projector-based dioramas. In Proceedings of the ACM symposium on Virtual reality software and technology (VRST '01). ACM, NY, NY, USA, 93--101. DOI=http://dx.doi.org/10.1145/505008.505026
[23]
Massie, T.H. and Salisbury, J.K. 1994. The PHANTOM Haptic Interface: A Device for Probing Virtual Objects Three Enabling Observations Three Necessary Criteria for an Effective Interface. In Proceedings HAPTICS '94, 55, 1, 295--300.
[24]
Matsuoka, Y., Allin, S. J., & Klatzky, R. L. (2002). The tolerance for visual feedback distortions in a virtual environment. Physiology & behavior, 77(4), 651655.
[25]
Patrick, N. 1990. Design, Construction, and Testing of a Fingertip Tactile Display for Interaction with Virtual and Remote Environments, Masters Thesis, Dept. of Mechanical Engineering, MIT, Boston, MA.
[26]
Pair, J., Neumann, U., Piepol, D., and Swartout, W.R. FlatWorld: Combining Hollywood Set-Design Techniques with VR. IEEE Computer Graphics and Applications 23, 1 (2003), 12--15.
[27]
Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The go-go interaction technique: non-linear mapping for direct manipulation in VR. In Proceedings of the 9th annual ACM symposium on User interface software and technology (UIST '96). ACM, NY, NY, USA, 79--80. DOI=http://dx.doi.org/10.1145/237091.237102
[28]
Razzaque, S., Kohn, Z., and Whitton, M.C. 2001. Redirected Walking. In Proceedings of EUROGRAPHICS, 289--294.
[29]
Jia Sheng, Ravin Balakrishnan, and Karan Singh. 2006. An interface for virtual 3D sculpting via physical proxy. In Proceedings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia (GRAPHITE '06). ACM, NY, NY, USA, 213--220. DOI=http://dx.doi.org/10.1145/1174429.1174467
[30]
Adalberto L. Simeone, Eduardo Velloso, and Hans Gellersen. 2015. Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 3307--3316.
[31]
Barton A. Smith, Janet Ho, Wendy Ark, and Shumin Zhai. 2000. Hand eye coordination patterns in target selection. In Proceedings of the 2000 symposium on Eye tracking research & applications (ETRA '00). ACM, NY, NY, USA, 117--122. DOI=http://dx.doi.org/10.1145/355017.355041
[32]
Spillmann, J., Tuchschmid, S., and Harders, M. (2013). Adaptive space warping to enhance passive haptics in an arthroscopy surgical simulator. IEEE Transactions on Visualization and Computer Graphics, 19(4):626-- 633.
[33]
Steinicke, F., Bruder, G., Jerald, J., Frenz, H., and Lappe, M. 2010. Estimation of Detection Thresholds for Redirected Walking Techniques. IEEE Transactions on Visualization and Computer Graphics 16, 1, 17--27.
[34]
Szalavári, Z. and Gervautz, M. 2008. The Personal Interaction Panel - a Two-Handed Interface for Augmented Reality. Computer Graphics Forum 16, 3, 335-- 346.
[35]
Tachi, S., Maeda, T., Hirata, R., and Hoshino, H. A. 1994. Construction Method of Virtual Haptic Space. In Proceedings of the 4th International Conference on Artificial Reality and Tele-Existence, 131--138.
[36]
William A. McNeely. 1993. Robotic graphics: a new approach to force feedback for virtual reality. In Proceedings of IEEE Virtual Reality Annual International Symposium, 1993, 336--341. http://doi.org/10.1109/VRAIS.1993.380761

Cited By

View all
  • (2025)Cross-Modal Interaction Between Perception and Vision of Grasping a Slanted Handrail to Reproduce the Sensation of Walking on a Slope in Virtual RealitySensors10.3390/s2503093825:3(938)Online publication date: 4-Feb-2025
  • (2025)Borders of physical self in virtual reality: a systematic review of virtual hand position discrepancy detectionFrontiers in Psychiatry10.3389/fpsyt.2024.145549515Online publication date: 6-Jan-2025
  • (2024)Guiding Handrays in Virtual Reality: Comparison of Gaze- and Object-Based Assistive Raycast RedirectionProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682080(1-12)Online publication date: 7-Oct-2024
  • Show More Cited By

Index Terms

  1. Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
      May 2017
      7138 pages
      ISBN:9781450346559
      DOI:10.1145/3025453
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 02 May 2017

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. passive haptics
      2. perception
      3. retargeting
      4. virtual reality

      Qualifiers

      • Research-article

      Conference

      CHI '17
      Sponsor:

      Acceptance Rates

      CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
      Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

      Upcoming Conference

      CHI 2025
      ACM CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2025
      Yokohama , Japan

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)293
      • Downloads (Last 6 weeks)15
      Reflects downloads up to 13 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)Cross-Modal Interaction Between Perception and Vision of Grasping a Slanted Handrail to Reproduce the Sensation of Walking on a Slope in Virtual RealitySensors10.3390/s2503093825:3(938)Online publication date: 4-Feb-2025
      • (2025)Borders of physical self in virtual reality: a systematic review of virtual hand position discrepancy detectionFrontiers in Psychiatry10.3389/fpsyt.2024.145549515Online publication date: 6-Jan-2025
      • (2024)Guiding Handrays in Virtual Reality: Comparison of Gaze- and Object-Based Assistive Raycast RedirectionProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682080(1-12)Online publication date: 7-Oct-2024
      • (2024)Exploring Redirection and Shifting Techniques to Mask Hand Movements from Shoulder-Surfing Attacks during PIN Authentication in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36765028:MHCI(1-24)Online publication date: 24-Sep-2024
      • (2024)An Examination of Ultrasound Mid-air Haptics for Enhanced Material and Temperature Perception in Virtual EnvironmentsProceedings of the ACM on Human-Computer Interaction10.1145/36764888:MHCI(1-21)Online publication date: 24-Sep-2024
      • (2024)What Makes XR Dark? Examining Emerging Dark Patterns in Augmented and Virtual Reality through Expert Co-DesignACM Transactions on Computer-Human Interaction10.1145/366034031:3(1-39)Online publication date: 22-Apr-2024
      • (2024)Predicting the Limits: Tailoring Unnoticeable Hand Redirection Offsets in Virtual Reality to Individuals' Perceptual BoundariesProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676425(1-13)Online publication date: 13-Oct-2024
      • (2024)TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676330(1-16)Online publication date: 13-Oct-2024
      • (2024)The Visuo-Haptic Illusions ToolkitProceedings of the 35th International Francophone Conference on Human-Computer Interaction10.1145/3650104.3652905(1-6)Online publication date: 25-Mar-2024
      • (2024)Study of the Impact of Visual and Haptic Sensory Sensitivities on the Detection of Visuo-Haptic Illusions in Virtual RealityProceedings of the 35th Conference on l'Interaction Humain-Machine10.1145/3649792.3649803(1-15)Online publication date: 25-Mar-2024
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media