Jan Willms
Maximilian Letter
Katrin Wolf
ABSTRACT
The use of mid-air gestures to control interactive systems is becoming increasingly important, particularly in mixed reality scenarios. However, these gestures are not always intuitive and can be challenging to learn as they lack visual guidance. Therefore, it is crucial to explore strategies to improve the learnability of these gestures. In this work, it is investigated how a vibration stimulus can be applied at the forearm to guide a person in performing a gesture. Utilizing a prototypical wristband with 24 vibrotactile actuators, the metaphors pull and push, representing attractive and repulsive feedback, were compared against each other. Results of a controlled user study show that participants perform significantly better with the pull metaphor, completing gestures faster, and make fewer errors. In line with this, the majority stated a subjective preference towards pull after experiencing both metaphors.
Supplemental Material
- Marco Aggravi, Gionata Salvietti, and Domenico Prattichizzo. 2016. Haptic wrist guidance using vibrations for Human-Robot teams. In 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, New York, NY, USA, 113–118. https://doi.org/10.1109/ROMAN.2016.7745098 ISSN: 1944-9437.Google Scholar
Digital Library
- Karlin Bark, Preeya Khanna, Rikki Irwin, Pulkit Kapur, Steven A Jax, Laurel J Buxbaum, and Katherine J Kuchenbecker. 2011. Lessons in using vibrotactile feedback to guide fast arm motions. In 2011 IEEE World Haptics Conference. IEEE, IEEE, New York, NY, USA, 355–360.Google ScholarCross Ref
- Olivier Bau and Wendy E Mackay. 2008. OctoPocus: a dynamic guide for learning gesture-based command sets. In Proceedings of the 21st annual ACM symposium on User interface software and technology. Association for Computing Machinery, New York, NY, USA, 37–46.Google ScholarDigital Library
- John Brooke 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4–7.Google Scholar
- J Cohen. 1992. A power primer Psychological Bulletin 112: 155–159. IE and Dyadic Adjustment 1 (1992), 155–159.Google Scholar
- Dylan Ebert and Fillia Makedon. 2017. MyoLearn: Using a multimodal armband sensor for vocational safety problem identification. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments(PETRA ’17). Association for Computing Machinery, New York, NY, USA, 248–249. https://doi.org/10.1145/3056540.3076212Google ScholarDigital Library
- Katherine Fennedy, Jeremy Hartmann, Quentin Roy, Simon Tangi Perrault, and Daniel Vogel. 2021. Octopocus in VR: using a dynamic guide for 3D mid-air gestures in virtual reality. IEEE Transactions on Visualization and Computer Graphics 27, 12 (2021), 4425–4438.Google ScholarDigital Library
- Sebastian Günther, Florian Müller, Markus Funk, Jan Kirchner, Niloofar Dezfuli, and Max Mühlhäuser. 2018. Tactileglove: Assistive spatial guidance in 3d space through vibrotactile navigation. In Proceedings of the 11th pervasive technologies related to assistive environments conference. Association for Computing Machinery, New York, NY, USA, 273–280.Google ScholarDigital Library
- Jay Henderson, Sachi Mizobuchi, Wei Li, and Edward Lank. 2019. Exploring cross-modal training via touch to learn a mid-air marking menu gesture set. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services. Association for Computing Machinery, New York, NY, USA, 1–9.Google ScholarDigital Library
- Jonggi Hong, Alisha Pradhan, Jon E. Froehlich, and Leah Findlater. 2017. Evaluating Wrist-Based Haptic Feedback for Non-Visual Target Finding and Path Tracing on a 2D Surface. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’17). Association for Computing Machinery, New York, NY, USA, 210–219. https://doi.org/10.1145/3132525.3132538Google ScholarDigital Library
- Yeong Rae Joi, Beom Taek Jeong, Jin Hwang Kim, Ki Hyuk Park, Taehyun Lee, and Jun Dong Cho. 2015. WearLove: Affective Communication via Wearable Device with Gamification. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play(CHI PLAY ’15). Association for Computing Machinery, New York, NY, USA, 559–564. https://doi.org/10.1145/2793107.2810337Google ScholarDigital Library
- Seokyeol Kim and Jinah Park. 2016. Haptic Exploration of Remote Environments with Gesture-based Collaborative Guidance. In Proceedings of the 2016 Symposium on Spatial User Interaction. ACM, Tokyo Japan, 211–211. https://doi.org/10.1145/2983310.2989201Google ScholarDigital Library
- Michael Julian Kronester, Andreas Riener, and Teo Babic. 2021. Potential of Wrist-worn Vibrotactile Feedback to Enhance the Perception of Virtual Objects during Mid-air Gestures. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–7.Google ScholarDigital Library
- Beom-Chan Lee and Kathleen H Sienko. 2011. Effects of attractive versus repulsive vibrotactile instructional cues during motion replication tasks. In 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, IEEE, New York, NY, USA, 3533–3536.Google Scholar
- Paul Lubos, Gerd Bruder, Oscar Ariza, and Frank Steinicke. 2016. Touching the Sphere: Leveraging Joint-Centered Kinespheres for Spatial User Interaction. In Proceedings of the 2016 Symposium on Spatial User Interaction (Tokyo, Japan) (SUI ’16). Association for Computing Machinery, New York, NY, USA, 13–22. https://doi.org/10.1145/2983310.2985753Google ScholarDigital Library
- George Lucchese, Martin Field, Jimmy Ho, Ricardo Gutierrez-Osuna, and Tracy Hammond. 2012. GestureCommander: Continuous touch-based gesture prediction. In CHI’12 Extended Abstracts on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1925–1930.Google Scholar
- Donald A. Norman. 2010. Natural User Interfaces Are Not Natural. Interactions 17, 3 (may 2010), 6–10. https://doi.org/10.1145/1744161.1744163Google ScholarDigital Library
- Evan Pezent, Marcia K. O’Malley, Ali Israr, Majed Samad, Shea Robinson, Priyanshu Agarwal, Hrvoje Benko, and Nicholas Colonnese. 2020. Explorations of Wrist Haptic Feedback for AR/VR Interactions with Tasbi. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3334480.3383151Google ScholarDigital Library
- Michael Raitor, Julie M Walker, Allison M Okamura, and Heather Culbertson. 2017. WRAP: Wearable, restricted-aperture pneumatics for haptic guidance. In 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, IEEE, New York, NY, USA, 427–432.Google ScholarDigital Library
- Gustavo Rovelo, Donald Degraen, Davy Vanacken, Kris Luyten, and Karin Coninx. 2015. Gestu-wan-an intelligible mid-air gesture guidance system for walk-up-and-use displays. In Human-Computer Interaction–INTERACT 2015: 15th IFIP TC 13 International Conference, Bamberg, Germany, September 14-18, 2015, Proceedings, Part II 15. Springer, Springer International Publishing, Cham, 368–386.Google ScholarDigital Library
- Jeff Sauro and Joseph S. Dumas. 2009. Comparison of Three One-Question, Post-Task Usability Questionnaires. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 1599–1608. https://doi.org/10.1145/1518701.1518946Google ScholarDigital Library
- Simon Schätzle, Tobias Ende, Tilo Wüsthoff, and Carsten Preusche. 2010. VibroTac: An ergonomic and versatile usable vibrotactile feedback device. In 19th International Symposium in Robot and Human Interactive Communication. IEEE, New York, NY, USA, 670–675. https://doi.org/10.1109/ROMAN.2010.5598694 ISSN: 1944-9437.Google ScholarCross Ref
- Fabrizio Sergi, Dino Accoto, Domenico Campolo, and Eugenio Guglielmelli. 2008. Forearm orientation guidance with a vibrotactile feedback bracelet: On the directionality of tactile motor communication. In 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics. IEEE, IEEE, New York, NY, USA, 433–438.Google ScholarCross Ref
- Gözel Shakeri, John H Williamson, and Stephen Brewster. 2018. May the force be with you: Ultrasound haptic feedback for mid-air gesture interaction in cars. In Proceedings of the 10th international conference on automotive user interfaces and interactive vehicular applications. Association for Computing Machinery, New York, NY, USA, 1–10.Google ScholarDigital Library
- Andrew A. Stanley and Katherine J. Kuchenbecker. 2012. Evaluation of Tactile Feedback Methods for Wrist Rotation Guidance. IEEE Transactions on Haptics 5, 3 (2012), 240–251. https://doi.org/10.1109/TOH.2012.33 Conference Name: IEEE Transactions on Haptics.Google ScholarDigital Library
- Anselm Strauss and Juliet M Corbin. 1997. Grounded theory in practice. Sage, Thousand Oaks, California.Google Scholar
- Isabel Tannert, Katrin H Schulleri, Youssef Michel, Steeven Villa, Leif Johannsen, Joachim Hermsdörfer, and Dongheui Lee. 2021. Immediate effects of vibrotactile biofeedback instructions on human postural control. In 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). IEEE, IEEE, New York, NY, USA, 7426–7432.Google ScholarCross Ref
- Hsin-Ruey Tsai, Yuan-Chia Chang, Tzu-Yun Wei, Chih-An Tsao, Xander Chin-yuan Koo, Hao-Chuan Wang, and Bing-Yu Chen. 2021. Guideband: Intuitive 3d multilevel force guidance on a wristband in virtual reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13.Google ScholarDigital Library
- Bernhard Weber, Simon Schätzle, Thomas Hulin, Carsten Preusche, and Barbara Deml. 2011. Evaluation of a vibrotactile feedback device for spatial guidance. In 2011 IEEE World Haptics Conference. IEEE, IEEE, New York, NY, USA, 349–354.Google ScholarCross Ref
- Fred Zijlstra. 1993. Efficiency in Work Behavior: A Design Approach for Modern Tools. Delft University Press, Delft, Netherlands.Google Scholar
Index Terms
- Pull Outperforms Push as Vibrotactile Wristband Feedback for Mid-Air Gesture Guidance
Recommendations
Vibrotactile stimulation of the head enables faster gaze gestures
Gaze gestures are a promising input technology for wearable devices especially in the smart glasses form factor because gaze gesturing is unobtrusive and leaves the hands free for other tasks. We were interested in how gaze gestures can be enhanced with ...
Wearable head-mounted 3D tactile display application scenarios
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services AdjunctCurrent generation virtual reality (VR) and augmented reality (AR) head-mounted displays (HMDs) usually include no or only a single vibration motor for haptic feedback and do not use it for guidance. In a previous work, we presented HapticHead, a ...
Gestu-Wan - An Intelligible Mid-Air Gesture Guidance System for Walk-up-and-Use Displays
Human-Computer Interaction – INTERACT 2015AbstractWe present Gestu-Wan, an intelligible gesture guidance system designed to support mid-air gesture-based interaction for walk-up-and-use displays. Although gesture-based interfaces have become more prevalent, there is currently very little ...
Comments