research-article

Tactile Vectors for Omnidirectional Arm Guidance

Authors:

Hesham Elsayed,

Johannes Semsch,

Max Mühlhäuser,

Martin SchmitzAuthors Info & Claims

AHs '23: Proceedings of the Augmented Humans International Conference 2023

Pages 35 - 45

https://doi.org/10.1145/3582700.3582701

Published: 14 March 2023 Publication History

Abstract

We introduce and study two omnidirectional movement guidance techniques that use two vibrotactile actuators to convey a movement direction. The first vibrotactile actuator defines the starting point and the second actuator communicates the endpoint of the direction vector. We investigate two variants of our tactile vectors using phantom sensations for 3D arm motion guidance. The first technique uses two sequential stimuli to communicate the movement vector (Sequential Tactile Vectors). The second technique creates a continuous vibration vector using body-penetrating phantom sensations (Continuous Tactile Vectors). In a user study (N = 16), we compare these two new techniques with state of the art push and pull metaphors. Our findings show that users are 20% more accurate in their movements with sequential tactile vectors.

References

[1]

Marco Aggravi, Gionata Salvietti, and Domenico Prattichizzo. 2016. Haptic wrist guidance using vibrations for Human-Robot teams. 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) (2016), 113–118.

Digital Library

[2]

Jacob Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences. Routledge. https://doi.org/10.4324/9780203771587

[3]

Dieter Drobny and Jan Borchers. 2010. Learning Basic Dance Choreographies with Different Augmented Feedback Modalities. In CHI ’10 Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI EA ’10). Association for Computing Machinery, New York, NY, USA, 3793–3798. https://doi.org/10.1145/1753846.1754058

Digital Library

[4]

Hesham Elsayed, Philipp Hoffmann, Sebastian Günther, Martin Schmitz, Martin Weigel, Max Mühlhäuser, and Florian Müller. 2021. CameraReady: Assessing the Influence of Display Types and Visualizations on Posture Guidance. In Designing Interactive Systems Conference 2021(Virtual Event, USA) (DIS ’21). Association for Computing Machinery, New York, NY, USA, 1046–1055. https://doi.org/10.1145/3461778.3462026

Digital Library

[5]

Hesham Elsayed, Kenneth Kartono, Dominik Schön, Martin Schmitz, Max Mühlhäuser, and Martin Weigel. 2022. Understanding Perspectives for Single- and Multi-Limb Movement Guidance in Virtual 3D Environments. In 28th ACM Symposium on Virtual Reality Software and Technology (Tsukuba, Japan) (VRST ’22). Association for Computing Machinery, New York, NY, USA, Article 34, 10 pages. https://doi.org/10.1145/3562939.3565635

Digital Library

[6]

Hesham Elsayed, Martin Weigel, Florian Müller, Martin Schmitz, Karola Marky, Sebastian Günther, Jan Riemann, and Max Mühlhäuser. 2020. VibroMap: Understanding the Spacing of Vibrotactile Actuators across the Body. 4, 4, Article 125 (Dec. 2020), 16 pages. https://doi.org/10.1145/3432189

Digital Library

[7]

Sebastian Günther, Florian Müller, Markus Funk, Jan Kirchner, Niloofar Dezfuli, and Max Mühlhäuser. 2018. TactileGlove: Assistive Spatial Guidance in 3D Space through Vibrotactile Navigation. In Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference (Corfu, Greece) (PETRA ’18). Association for Computing Machinery, New York, NY, USA, 273–280. https://doi.org/10.1145/3197768.3197785

Digital Library

[8]

Sandra G. Hart. 2006. Nasa-Task Load Index (NASA-TLX); 20 Years Later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 9(2006), 904–908. https://doi.org/10.1177/154193120605000909 arXiv:https://doi.org/10.1177/154193120605000909

[9]

Jonggi Hong, Lee Stearns, Jon Froehlich, David Ross, and Leah Findlater. 2016. Evaluating Angular Accuracy of Wrist-Based Haptic Directional Guidance for Hand Movement. In Proceedings of the 42nd Graphics Interface Conference (Victoria, British Columbia, Canada) (GI ’16). Canadian Human-Computer Communications Society, Waterloo, CAN, 195–200.

Digital Library

[10]

Chris Jansen, Arjen Oving, and Hendrik-Jan Veen. 2004. Vibrotactile movement initiation. (01 2004).

[11]

Yeon Sub Jin, Han Yong Chun, Eun Tai Kim, and Sungchul Kang. 2014. VT-ware: A wearable tactile device for upper extremity motion guidance. In The 23rd IEEE International Symposium on Robot and Human Interactive Communication. 335–340. https://doi.org/10.1109/ROMAN.2014.6926275

[12]

Pulkit Kapur, Mallory Jensen, Laurel J. Buxbaum, Steven A. Jax, and Katherine J. Kuchenbecker. 2010. Spatially distributed tactile feedback for kinesthetic motion guidance. In 2010 IEEE Haptics Symposium. 519–526. https://doi.org/10.1109/HAPTIC.2010.5444606

Digital Library

[13]

Oliver Beren Kaul and Michael Rohs. 2017. HapticHead: A Spherical Vibrotactile Grid around the Head for 3D Guidance in Virtual and Augmented Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3729–3740. https://doi.org/10.1145/3025453.3025684

Digital Library

[14]

Jinsoo Kim, Seungjae Oh, Chaeyong Park, and Seungmoon Choi. 2020. Body-Penetrating Tactile Phantom Sensations(CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376619

Digital Library

[15]

Jeff Lieberman and Cynthia Breazeal. 2007. TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning. IEEE Transactions on Robotics 23, 5 (2007), 919–926. https://doi.org/10.1109/TRO.2007.907481

Digital Library

[16]

Kristen L. Lurie, Pete B. Shull, Karen F. Nesbitt, and Mark R. Cutkosky. 2011. Informing haptic feedback design for gait retraining. In 2011 IEEE World Haptics Conference. 19–24. https://doi.org/10.1109/WHC.2011.5945455

[17]

Alexander Marquardt, Jens Maiero, Ernst Kruijff, Christina Trepkowski, Andrea Schwandt, André Hinkenjann, Johannes Schöning, and Wolfgang Stuerzlinger. 2018. Tactile Hand Motion and Pose Guidance for 3D Interaction. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (Tokyo, Japan) (VRST ’18). Association for Computing Machinery, New York, NY, USA, Article 3, 10 pages. https://doi.org/10.1145/3281505.3281526

Digital Library

[18]

Troy McDaniel, Morris Goldberg, Daniel Villanueva, Lakshmie Narayan Viswanathan, and Sethuraman Panchanathan. 2011. Motor Learning Using a Kinematic-Vibrotactile Mapping Targeting Fundamental Movements(MM ’11). Association for Computing Machinery, New York, NY, USA, 543–552. https://doi.org/10.1145/2072298.2072369

Digital Library

[19]

Tony Morelli, John Foley, Luis Columna, Lauren Lieberman, and Eelke Folmer. 2010. VI-Tennis: A Vibrotactile/Audio Exergame for Players Who Are Visually Impaired. In Proceedings of the Fifth International Conference on the Foundations of Digital Games(Monterey, California) (FDG ’10). Association for Computing Machinery, New York, NY, USA, 147–154. https://doi.org/10.1145/1822348.1822368

Digital Library

[20]

Florian Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, Jun Nishida, Elizabeth M. Gerber, Dag Svanaes, Jonathan Grudin, Stefan Greuter, Kai Kunze, Thomas Erickson, Steven Greenspan, Masahiko Inami, Joe Marshall, Harald Reiterer, Katrin Wolf, Jochen Meyer, Thecla Schiphorst, Dakuo Wang, and Pattie Maes. 2020. Next Steps for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376242

Digital Library

[21]

Florian ‘Floyd’ Mueller, Nathan Semertzidis, Josh Andres, Martin Weigel, Suranga Nanayakkara, Rakesh Patibanda, Zhuying Li, Paul Strohmeier, Jarrod Knibbe, Stefan Greuter, Marianna Obrist, Pattie Maes, Dakuo Wang, Katrin Wolf, Liz Gerber, Joe Marshall, Kai Kunze, Jonathan Grudin, Harald Reiterer, and Richard Byrne. 2022. Human–Computer Integration: Towards Integrating the Human Body with the Computational Machine. Foundations and Trends® in Human-Computer Interaction 16, 1(2022), 1–64. https://doi.org/10.1561/1100000086

Digital Library

[22]

Gunhyuk Park and Seungmoon Choi. 2018. Tactile Information Transmission by 2D Stationary Phantom Sensations(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173832

Digital Library

[23]

Jacob Rosenthal, Nathan Edwards, Daniel Villanueva, Sreekar Krishna, Troy McDaniel, and Sethuraman Panchanathan. 2011. Design, Implementation, and Case Study of a Pragmatic Vibrotactile Belt. IEEE Transactions on Instrumentation and Measurement 60, 1(2011), 114–125. https://doi.org/10.1109/TIM.2010.2065830

[24]

Emanuele Ruffaldi, Alessandro Filippeschi, Antonio Frisoli, Oscar Sandoval, Carlo Alberto Avizzano, and Massimo Bergamasco. 2009. Vibrotactile perception assessment for a rowing training system. In World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. 350–355. https://doi.org/10.1109/WHC.2009.4810849

Digital Library

[25]

Jose Salazar, Keisuke Okabe, and Yasuhisa Hirata. 2018. Path-Following Guidance Using Phantom Sensation Based Vibrotactile Cues Around the Wrist. IEEE Robotics and Automation Letters 3, 3 (2018), 2485–2492. https://doi.org/10.1109/LRA.2018.2810939

[26]

Jose V. Salazar Luces, Keisuke Okabe, Yoshiki Murao, and Yasuhisa Hirata. 2018. A Phantom-Sensation Based Paradigm for Continuous Vibrotactile Wrist Guidance in Two-Dimensional Space. IEEE Robotics and Automation Letters 3, 1 (2018), 163–170. https://doi.org/10.1109/LRA.2017.2737480

[27]

Christian Schönauer, Kenichiro Fukushi, Alex Olwal, Hannes Kaufmann, and Ramesh Raskar. 2012. Multimodal Motion Guidance: Techniques for Adaptive and Dynamic Feedback(ICMI ’12). Association for Computing Machinery, New York, NY, USA, 133–140. https://doi.org/10.1145/2388676.2388706

Digital Library

[28]

Daniel Spelmezan, Mareike Jacobs, Anke Hilgers, and Jan Borchers. 2009. Tactile Motion Instructions for Physical Activities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 2243–2252. https://doi.org/10.1145/1518701.1519044

Digital Library

[29]

Andrew A. Stanley and Katherine J. Kuchenbecker. 2012. Evaluation of Tactile Feedback Methods for Wrist Rotation Guidance. IEEE Transactions on Haptics 5, 3 (2012), 240–251. https://doi.org/10.1109/TOH.2012.33

Digital Library

[30]

Hsin-Ruey Tsai, Yuan-Chia Chang, Tzu-Yun Wei, Chih-An Tsao, Xander Chin-yuan Koo, Hao-Chuan Wang, and Bing-Yu Chen. 2021. GuideBand: Intuitive 3D Multilevel Force Guidance on a Wristband in Virtual Reality. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445262

Digital Library

[31]

Janet van der Linden, Erwin Schoonderwaldt, Jon Bird, and Rose Johnson. 2011. MusicJacket—Combining Motion Capture and Vibrotactile Feedback to Teach Violin Bowing. IEEE Transactions on Instrumentation and Measurement 60, 1(2011), 104–113. https://doi.org/10.1109/TIM.2010.2065770

[32]

Bernhard Weber, Simon Schätzle, Thomas Hulin, Carsten Preusche, and Barbara Deml. 2011. Evaluation of a vibrotactile feedback device for spatial guidance. In 2011 IEEE World Haptics Conference. 349–354. https://doi.org/10.1109/WHC.2011.5945511

[33]

Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). ACM, New York, NY, USA, 143–146. https://doi.org/10.1145/1978942.1978963

Digital Library

Cited By

Yokoe KFunabora YAoyama T(2025)Intuitive Hand Positional Guidance Using McKibben-Based Surface Tactile Sensations to Shoulder and ElbowIEEE Robotics and Automation Letters10.1109/LRA.2025.354057910:4(3254-3261)Online publication date: Apr-2025
https://doi.org/10.1109/LRA.2025.3540579
Seetohul VSchweitzer KBöhmer M(2024)ShoulderTapper: Providing Directional Cues through Electrotactile Feedback for Target Acquisition in Pick-by-Light SystemsProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701597(228-234)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701597
Donkov SElizondo SEzcurdia ISarasate IMarzo A(2024)Mental Workload of Guiding Devices: Directional Pulling Forces, Vibrotactile Stimuli and Audio CuesProceedings of the XXIV International Conference on Human Computer Interaction10.1145/3657242.3658581(1-8)Online publication date: 19-Jun-2024
https://dl.acm.org/doi/10.1145/3657242.3658581
Show More Cited By

Index Terms

Tactile Vectors for Omnidirectional Arm Guidance
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. Interaction techniques

Recommendations

Understanding Perspectives for Single- and Multi-Limb Movement Guidance in Virtual 3D Environments
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

Movement guidance in virtual reality has many applications ranging from physical therapy, assistive systems to sport learning. These movements range from simple single-limb to complex multi-limb movements. While VR supports many perspectives – e.g., ...
Wearable head-mounted 3D tactile display application scenarios
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

Current generation virtual reality (VR) and augmented reality (AR) head-mounted displays (HMDs) usually include no or only a single vibration motor for haptic feedback and do not use it for guidance. In a previous work, we presented HapticHead, a ...
Tactile Information Transmission by 2D Stationary Phantom Sensations
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

A phantom sensation refers to an illusory tactile sensation perceived midway between multiple distant stimulations on the skin. Phantom sensations have been used intensively in tactile interfaces owing to their simplicity and effectiveness. Despite that, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AHs '23: Proceedings of the Augmented Humans International Conference 2023

March 2023

395 pages

ISBN:9781450399845

DOI:10.1145/3582700

General Chairs:
Jamie A. Ward
Goldsmiths, University of London, United Kingdom
,
Mark McGill
University of Glasgow, United Kingdom
,
Karola Marky
Ruhr-University Bochum, Germany

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 March 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

AHs '23

AHs '23: Augmented Humans Conference

March 12 - 14, 2023

Glasgow, United Kingdom

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
383
Total Downloads

Downloads (Last 12 months)97
Downloads (Last 6 weeks)8

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yokoe KFunabora YAoyama T(2025)Intuitive Hand Positional Guidance Using McKibben-Based Surface Tactile Sensations to Shoulder and ElbowIEEE Robotics and Automation Letters10.1109/LRA.2025.354057910:4(3254-3261)Online publication date: Apr-2025
https://doi.org/10.1109/LRA.2025.3540579
Seetohul VSchweitzer KBöhmer M(2024)ShoulderTapper: Providing Directional Cues through Electrotactile Feedback for Target Acquisition in Pick-by-Light SystemsProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701597(228-234)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701597
Donkov SElizondo SEzcurdia ISarasate IMarzo A(2024)Mental Workload of Guiding Devices: Directional Pulling Forces, Vibrotactile Stimuli and Audio CuesProceedings of the XXIV International Conference on Human Computer Interaction10.1145/3657242.3658581(1-8)Online publication date: 19-Jun-2024
https://dl.acm.org/doi/10.1145/3657242.3658581
Gao BShao TTu HMa QLiu ZHan T(2024)Exploring Bimanual Haptic Feedback for Spatial Search in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337204530:5(2422-2433)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372045

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten