Hesham Elsayed
Martin Weigel
Max Mühlhäuser
Martin Schmitz
ABSTRACT
We introduce and study two omnidirectional movement guidance techniques that use two vibrotactile actuators to convey a movement direction. The first vibrotactile actuator defines the starting point and the second actuator communicates the endpoint of the direction vector. We investigate two variants of our tactile vectors using phantom sensations for 3D arm motion guidance. The first technique uses two sequential stimuli to communicate the movement vector (Sequential Tactile Vectors). The second technique creates a continuous vibration vector using body-penetrating phantom sensations (Continuous Tactile Vectors). In a user study (N = 16), we compare these two new techniques with state of the art push and pull metaphors. Our findings show that users are 20% more accurate in their movements with sequential tactile vectors.
- Marco Aggravi, Gionata Salvietti, and Domenico Prattichizzo. 2016. Haptic wrist guidance using vibrations for Human-Robot teams. 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) (2016), 113–118.Google Scholar
Digital Library
- Jacob Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences. Routledge. https://doi.org/10.4324/9780203771587Google Scholar
- Dieter Drobny and Jan Borchers. 2010. Learning Basic Dance Choreographies with Different Augmented Feedback Modalities. In CHI ’10 Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI EA ’10). Association for Computing Machinery, New York, NY, USA, 3793–3798. https://doi.org/10.1145/1753846.1754058Google ScholarDigital Library
- Hesham Elsayed, Philipp Hoffmann, Sebastian Günther, Martin Schmitz, Martin Weigel, Max Mühlhäuser, and Florian Müller. 2021. CameraReady: Assessing the Influence of Display Types and Visualizations on Posture Guidance. In Designing Interactive Systems Conference 2021(Virtual Event, USA) (DIS ’21). Association for Computing Machinery, New York, NY, USA, 1046–1055. https://doi.org/10.1145/3461778.3462026Google ScholarDigital Library
- Hesham Elsayed, Kenneth Kartono, Dominik Schön, Martin Schmitz, Max Mühlhäuser, and Martin Weigel. 2022. Understanding Perspectives for Single- and Multi-Limb Movement Guidance in Virtual 3D Environments. In 28th ACM Symposium on Virtual Reality Software and Technology (Tsukuba, Japan) (VRST ’22). Association for Computing Machinery, New York, NY, USA, Article 34, 10 pages. https://doi.org/10.1145/3562939.3565635Google ScholarDigital Library
- Hesham Elsayed, Martin Weigel, Florian Müller, Martin Schmitz, Karola Marky, Sebastian Günther, Jan Riemann, and Max Mühlhäuser. 2020. VibroMap: Understanding the Spacing of Vibrotactile Actuators across the Body. 4, 4, Article 125 (Dec. 2020), 16 pages. https://doi.org/10.1145/3432189Google ScholarDigital Library
- Sebastian Günther, Florian Müller, Markus Funk, Jan Kirchner, Niloofar Dezfuli, and Max Mühlhäuser. 2018. TactileGlove: Assistive Spatial Guidance in 3D Space through Vibrotactile Navigation. In Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference (Corfu, Greece) (PETRA ’18). Association for Computing Machinery, New York, NY, USA, 273–280. https://doi.org/10.1145/3197768.3197785Google ScholarDigital Library
- Sandra G. Hart. 2006. Nasa-Task Load Index (NASA-TLX); 20 Years Later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 9(2006), 904–908. https://doi.org/10.1177/154193120605000909 arXiv:https://doi.org/10.1177/154193120605000909Google ScholarCross Ref
- Jonggi Hong, Lee Stearns, Jon Froehlich, David Ross, and Leah Findlater. 2016. Evaluating Angular Accuracy of Wrist-Based Haptic Directional Guidance for Hand Movement. In Proceedings of the 42nd Graphics Interface Conference (Victoria, British Columbia, Canada) (GI ’16). Canadian Human-Computer Communications Society, Waterloo, CAN, 195–200.Google ScholarDigital Library
- Chris Jansen, Arjen Oving, and Hendrik-Jan Veen. 2004. Vibrotactile movement initiation. (01 2004).Google Scholar
- Yeon Sub Jin, Han Yong Chun, Eun Tai Kim, and Sungchul Kang. 2014. VT-ware: A wearable tactile device for upper extremity motion guidance. In The 23rd IEEE International Symposium on Robot and Human Interactive Communication. 335–340. https://doi.org/10.1109/ROMAN.2014.6926275Google ScholarCross Ref
- Pulkit Kapur, Mallory Jensen, Laurel J. Buxbaum, Steven A. Jax, and Katherine J. Kuchenbecker. 2010. Spatially distributed tactile feedback for kinesthetic motion guidance. In 2010 IEEE Haptics Symposium. 519–526. https://doi.org/10.1109/HAPTIC.2010.5444606Google ScholarDigital Library
- Oliver Beren Kaul and Michael Rohs. 2017. HapticHead: A Spherical Vibrotactile Grid around the Head for 3D Guidance in Virtual and Augmented Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3729–3740. https://doi.org/10.1145/3025453.3025684Google ScholarDigital Library
- Jinsoo Kim, Seungjae Oh, Chaeyong Park, and Seungmoon Choi. 2020. Body-Penetrating Tactile Phantom Sensations(CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376619Google ScholarDigital Library
- Jeff Lieberman and Cynthia Breazeal. 2007. TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning. IEEE Transactions on Robotics 23, 5 (2007), 919–926. https://doi.org/10.1109/TRO.2007.907481Google ScholarDigital Library
- Kristen L. Lurie, Pete B. Shull, Karen F. Nesbitt, and Mark R. Cutkosky. 2011. Informing haptic feedback design for gait retraining. In 2011 IEEE World Haptics Conference. 19–24. https://doi.org/10.1109/WHC.2011.5945455Google ScholarCross Ref
- Alexander Marquardt, Jens Maiero, Ernst Kruijff, Christina Trepkowski, Andrea Schwandt, André Hinkenjann, Johannes Schöning, and Wolfgang Stuerzlinger. 2018. Tactile Hand Motion and Pose Guidance for 3D Interaction. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (Tokyo, Japan) (VRST ’18). Association for Computing Machinery, New York, NY, USA, Article 3, 10 pages. https://doi.org/10.1145/3281505.3281526Google ScholarDigital Library
- Troy McDaniel, Morris Goldberg, Daniel Villanueva, Lakshmie Narayan Viswanathan, and Sethuraman Panchanathan. 2011. Motor Learning Using a Kinematic-Vibrotactile Mapping Targeting Fundamental Movements(MM ’11). Association for Computing Machinery, New York, NY, USA, 543–552. https://doi.org/10.1145/2072298.2072369Google ScholarDigital Library
- Tony Morelli, John Foley, Luis Columna, Lauren Lieberman, and Eelke Folmer. 2010. VI-Tennis: A Vibrotactile/Audio Exergame for Players Who Are Visually Impaired. In Proceedings of the Fifth International Conference on the Foundations of Digital Games(Monterey, California) (FDG ’10). Association for Computing Machinery, New York, NY, USA, 147–154. https://doi.org/10.1145/1822348.1822368Google ScholarDigital Library
- Florian Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, Jun Nishida, Elizabeth M. Gerber, Dag Svanaes, Jonathan Grudin, Stefan Greuter, Kai Kunze, Thomas Erickson, Steven Greenspan, Masahiko Inami, Joe Marshall, Harald Reiterer, Katrin Wolf, Jochen Meyer, Thecla Schiphorst, Dakuo Wang, and Pattie Maes. 2020. Next Steps for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376242Google ScholarDigital Library
- Florian ‘Floyd’ Mueller, Nathan Semertzidis, Josh Andres, Martin Weigel, Suranga Nanayakkara, Rakesh Patibanda, Zhuying Li, Paul Strohmeier, Jarrod Knibbe, Stefan Greuter, Marianna Obrist, Pattie Maes, Dakuo Wang, Katrin Wolf, Liz Gerber, Joe Marshall, Kai Kunze, Jonathan Grudin, Harald Reiterer, and Richard Byrne. 2022. Human–Computer Integration: Towards Integrating the Human Body with the Computational Machine. Foundations and Trends® in Human-Computer Interaction 16, 1(2022), 1–64. https://doi.org/10.1561/1100000086Google ScholarDigital Library
- Gunhyuk Park and Seungmoon Choi. 2018. Tactile Information Transmission by 2D Stationary Phantom Sensations(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173832Google ScholarDigital Library
- Jacob Rosenthal, Nathan Edwards, Daniel Villanueva, Sreekar Krishna, Troy McDaniel, and Sethuraman Panchanathan. 2011. Design, Implementation, and Case Study of a Pragmatic Vibrotactile Belt. IEEE Transactions on Instrumentation and Measurement 60, 1(2011), 114–125. https://doi.org/10.1109/TIM.2010.2065830Google ScholarCross Ref
- Emanuele Ruffaldi, Alessandro Filippeschi, Antonio Frisoli, Oscar Sandoval, Carlo Alberto Avizzano, and Massimo Bergamasco. 2009. Vibrotactile perception assessment for a rowing training system. In World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. 350–355. https://doi.org/10.1109/WHC.2009.4810849Google ScholarDigital Library
- Jose Salazar, Keisuke Okabe, and Yasuhisa Hirata. 2018. Path-Following Guidance Using Phantom Sensation Based Vibrotactile Cues Around the Wrist. IEEE Robotics and Automation Letters 3, 3 (2018), 2485–2492. https://doi.org/10.1109/LRA.2018.2810939Google ScholarCross Ref
- Jose V. Salazar Luces, Keisuke Okabe, Yoshiki Murao, and Yasuhisa Hirata. 2018. A Phantom-Sensation Based Paradigm for Continuous Vibrotactile Wrist Guidance in Two-Dimensional Space. IEEE Robotics and Automation Letters 3, 1 (2018), 163–170. https://doi.org/10.1109/LRA.2017.2737480Google ScholarCross Ref
- Christian Schönauer, Kenichiro Fukushi, Alex Olwal, Hannes Kaufmann, and Ramesh Raskar. 2012. Multimodal Motion Guidance: Techniques for Adaptive and Dynamic Feedback(ICMI ’12). Association for Computing Machinery, New York, NY, USA, 133–140. https://doi.org/10.1145/2388676.2388706Google ScholarDigital Library
- Daniel Spelmezan, Mareike Jacobs, Anke Hilgers, and Jan Borchers. 2009. Tactile Motion Instructions for Physical Activities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 2243–2252. https://doi.org/10.1145/1518701.1519044Google ScholarDigital Library
- Andrew A. Stanley and Katherine J. Kuchenbecker. 2012. Evaluation of Tactile Feedback Methods for Wrist Rotation Guidance. IEEE Transactions on Haptics 5, 3 (2012), 240–251. https://doi.org/10.1109/TOH.2012.33Google ScholarDigital Library
- Hsin-Ruey Tsai, Yuan-Chia Chang, Tzu-Yun Wei, Chih-An Tsao, Xander Chin-yuan Koo, Hao-Chuan Wang, and Bing-Yu Chen. 2021. GuideBand: Intuitive 3D Multilevel Force Guidance on a Wristband in Virtual Reality. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445262Google ScholarDigital Library
- Janet van der Linden, Erwin Schoonderwaldt, Jon Bird, and Rose Johnson. 2011. MusicJacket—Combining Motion Capture and Vibrotactile Feedback to Teach Violin Bowing. IEEE Transactions on Instrumentation and Measurement 60, 1(2011), 104–113. https://doi.org/10.1109/TIM.2010.2065770Google ScholarCross Ref
- Bernhard Weber, Simon Schätzle, Thomas Hulin, Carsten Preusche, and Barbara Deml. 2011. Evaluation of a vibrotactile feedback device for spatial guidance. In 2011 IEEE World Haptics Conference. 349–354. https://doi.org/10.1109/WHC.2011.5945511Google ScholarCross Ref
- Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). ACM, New York, NY, USA, 143–146. https://doi.org/10.1145/1978942.1978963Google ScholarDigital Library
Index Terms
- Tactile Vectors for Omnidirectional Arm Guidance
Recommendations
Understanding Perspectives for Single- and Multi-Limb Movement Guidance in Virtual 3D Environments
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and TechnologyMovement guidance in virtual reality has many applications ranging from physical therapy, assistive systems to sport learning. These movements range from simple single-limb to complex multi-limb movements. While VR supports many perspectives – e.g., ...
Wearable head-mounted 3D tactile display application scenarios
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services AdjunctCurrent generation virtual reality (VR) and augmented reality (AR) head-mounted displays (HMDs) usually include no or only a single vibration motor for haptic feedback and do not use it for guidance. In a previous work, we presented HapticHead, a ...
Tactile Information Transmission by 2D Stationary Phantom Sensations
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsA phantom sensation refers to an illusory tactile sensation perceived midway between multiple distant stimulations on the skin. Phantom sensations have been used intensively in tactile interfaces owing to their simplicity and effectiveness. Despite that,...
Comments