Michael Julian Kronester
Andreas Riener
Teo Babic
ABSTRACT
Numerous systems based on mid-air gestures have recently been proposed as a digital variant of object manipulation with hands. Simultaneously, however, direct haptic feedback is lost, eliminating an important aspect that we are familiar with from real-life interaction. We believe that smartwatches, as widely used personal devices, could provide a platform for accessible, flexible, and unobtrusive integration of haptic feedback into mid-air gesture interaction. We prototyped a vibrotactile wrist band with four vibration actuators aiming at communicating invisible, undetectable virtual object properties such as electricity, weight, and tension into 3D haptic experiences. In this paper, we present findings from a user study (n=18) that examined the suitability of different vibration patterns (variation in intensity, temporal profile, rhythm, and location). Results show that all feedback variants have a positive impact on user experience (UX) when interacting with virtual objects. Constant, continuous patterns outweigh the other variants examined.
- Jongeun Cha, Lara Rahal, and Abdulmotaleb El Saddik. 2008. A pilot study on simulating continuous sensation with two vibrating motors. In 2008 IEEE International Workshop on Haptic Audio visual Environments and Games. IEEE, Ottawa, ON, Canada, 143–147. https://doi.org/10.1109/HAVE.2008.4685314Google Scholar
Cross Ref
- Roger W. Cholewiak and Amy A. Collins. 2003. Vibrotactile localization on the arm: Effects of place, space, and age. Perception & Psychophysics 65, 7 (Oct. 2003), 1058–1077. https://doi.org/10.3758/BF03194834Google ScholarCross Ref
- Aakar Gupta, Thomas Pietrzak, Nicolas Roussel, and Ravin Balakrishnan. 2016. Direct Manipulation in Tactile Displays. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). Association for Computing Machinery, San Jose, California, USA, 3683–3693. https://doi.org/10.1145/2858036.2858161Google ScholarDigital Library
- Apple Inc.2021. Representing Haptic Patterns in AHAP Files | Apple Developer Documentation. https://developer.apple.com/documentation/corehaptics/representing_haptic_patterns_in_ahap_filesGoogle Scholar
- Roger W. Johnson. 1996. Fitting Percentage of Body Fat to Simple Body Measurements. Journal of Statistics Education 4, 1 (1996). https://doi.org/10.1080/10691898.1996.11910505Google ScholarCross Ref
- Dan R. Kenshalo. 1986. Somesthetic Sensitivity in Young and Elderly Humans. Journal of Gerontology 41, 6 (Nov. 1986), 732–742. https://doi.org/10.1093/geronj/41.6.732 Publisher: Oxford Academic.Google ScholarCross Ref
- Gordon Legge, Cindee Madison, Brenna Vaughn, Allen Cheong, and Joseph Miller. 2008. Retention of high tactile acuity throughout the life span in blindness. Perception & psychophysics 70 (12 2008), 1471–88. https://doi.org/10.3758/PP.70.8.1471Google ScholarCross Ref
- Joanne Leong, Patrick Parzer, Florian Perteneder, Teo Babic, Christian Rendl, Anita Vogl, Hubert Egger, Alex Olwal, and Michael Haller. 2016. ProCover: Sensory Augmentation of Prosthetic Limbs Using Smart Textile Covers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 335–346. https://doi.org/10.1145/2984511.2984572Google ScholarDigital Library
- James R. Lewis and Oundefineduzhan Erdinç. 2017. User Experience Rating Scales with 7, 11, or 101 Points: Does It Matter?J. Usability Studies 12, 2 (Feb. 2017), 73–91.Google Scholar
- Yi-Chi Liao, Yi-Ling Chen, Jo-Yu Lo, Rong-Hao Liang, Liwei Chan, and Bing-Yu Chen. 2016. EdgeVib: Effective Alphanumeric Character Output Using a Wrist-Worn Tactile Display. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology(UIST ’16). Association for Computing Machinery, New York, NY, USA, 595–601. https://doi.org/10.1145/2984511.2984522Google ScholarDigital Library
- J. Löfvenberg and R.S. Johansson. 1984. Regional differences and interindividual variability in sensitivity to vibration in the glabrous skin of the human hand. Brain Research 301, 1 (1984), 65 – 72. https://doi.org/10.1016/0006-8993(84)90403-7Google ScholarCross Ref
- Zhuoluo Ma, Yue Liu, Dejiang Ye, and Lu Zhao. 2019. Vibrotactile Wristband for Warning and Guiding in Automated Vehicles. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland UK) (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3290607.3312819Google ScholarDigital Library
- Flavia Mancini, Armando Bauleo, Jonathan Cole, Fausta Lui, Carlo Porro, Patrick Haggard, and Gian Iannetti. 2014. Whole-Body Mapping of Spatial Acuity for Pain and Touch. Annals of Neurology 75 (06 2014). https://doi.org/10.1002/ana.24179Google ScholarCross Ref
- Michael Matscheko, Alois Ferscha, Andreas Riener, and Manuel Lehner. 2010. Tactor placement in wrist worn wearables. International Symposium on Wearable Computers (ISWC) 2010 75 (2010), 1–8. https://doi.org/10.1109/ISWC.2010.5665867Google ScholarCross Ref
- Anton Nijholt, Leonardo Giusti, Andrea Minuto, and Patrizia Marti. 2012. Smart Material Interfaces: ”A Material Step to the Future”. In Proceedings of the 1st Workshop on Smart Material Interfaces: A Material Step to the Future (Santa Monica, California) (SMI ’12). Association for Computing Machinery, New York, NY, USA, Article 1, 3 pages. https://doi.org/10.1145/2459056.2459057Google ScholarDigital Library
- I. Oakley, Yeongmi Kim, Junhun Lee, and Jeha Ryu. 2006. Determining the Feasibility of Forearm Mounted Vibrotactile Displays. In 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, Alexandria, VA, USA, 27–34. https://doi.org/10.1109/HAPTIC.2006.1627079 ISSN: 2324-7355.Google ScholarCross Ref
- Erik Pescara, Michael Beigl, and Matthias Budde. 2016. RüttelFlug: A Wrist-Worn Sensing Device for Tactile Vertical Velocity Perception in 3d-Space. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (Heidelberg, Germany) (ISWC ’16). Association for Computing Machinery, New York, NY, USA, 172–175. https://doi.org/10.1145/2971763.2971795Google ScholarDigital Library
- Evan Pezent, Ali Israr, Majed Samad, Shea Robinson, Priyanshu Agarwal, Hrvoje Benko, and Nick Colonnese. 2019. Tasbi: Multisensory Squeeze and Vibrotactile Wrist Haptics for Augmented and Virtual Reality. In 2019 IEEE World Haptics Conference (WHC). IEEE, Tokyo, Japan, 1–6. https://doi.org/10.1109/WHC.2019.8816098Google ScholarCross Ref
- Evan Pezent, Marcia K. O’Malley, Ali Israr, Majed Samad, Shea Robinson, Priyanshu Agarwal, Hrvoje Benko, and Nicholas Colonnese. 2020. Explorations of Wrist Haptic Feedback for AR/VR Interactions with Tasbi. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3334480.3383151Google ScholarDigital Library
- Jose Salazar, Keisuke Okabe, and Yasuhisa Hirata. 2018. Path-Following Guidance Using Phantom Sensation Based Vibrotactile Cues Around the Wrist. IEEE Robotics and Automation Letters 3, 3 (July 2018), 2485–2492. https://doi.org/10.1109/LRA.2018.2810939Google ScholarCross Ref
- Martin Schrepp, Andreas Hinderks, and Jörg Thomaschewski. 2017. Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S). International Journal of Interactive Multimedia and Artificial Intelligence 4 (01 2017), 103. https://doi.org/10.9781/ijimai.2017.09.001Google ScholarCross Ref
- Yuh-Chuan Shih and Bi-Fen Tsai. 2007. Splint Effect on the Range of Wrist Motion and Typing Performance. In Ergonomics and Health Aspects of Work with Computers(Lecture Notes in Computer Science), Marvin J. Dainoff (Ed.). Springer, Berlin, Heidelberg, 144–150. https://doi.org/10.1007/978-3-540-73333-1_18Google ScholarCross Ref
- Jo-Hsi Tang, Giuseppe Raffa, and Liwei Chan. 2020. Design of Vibrotactile Direction Feedbacks on Wrist for Three-Dimensional Spatial Guidance. In Cross-Cultural Design. User Experience of Products, Services, and Intelligent Environments(Lecture Notes in Computer Science), Pei-Luen Patrick Rau (Ed.). Springer International Publishing, Cham, 169–182. https://doi.org/10.1007/978-3-030-49788-0_13Google ScholarDigital Library
- H. Tankovska. 2020. Global smartwatch unit sales forecast 2018-2023. https://www.statista.com/statistics/878144/worldwide-smart-wristwear-shipments-forecast/Google Scholar
- Christopher D Wickens. 2008. Multiple resources and mental workload. Human factors 50, 3 (2008), 449–455. https://doi.org/10.1518/001872008X288394Google ScholarCross Ref
Index Terms
- Potential of Wrist-worn Vibrotactile Feedback to Enhance the Perception of Virtual Objects during Mid-air Gestures
Index terms have been assigned to the content through auto-classification.
Recommendations
WalkingVibe: Reducing Virtual Reality Sickness and Improving Realism while Walking in VR using Unobtrusive Head-mounted Vibrotactile Feedback
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsVirtual Reality (VR) sickness is common with symptoms such as headaches, nausea, and disorientation, and is a major barrier to using VR. We propose WalkingVibe, which applies unobtrusive vibrotactile feedback for VR walking experiences, and also reduces ...
The user experience of distal arm-level vibrotactile feedback for interactions with virtual versus physical displays
AbstractHaptic feedback, a natural component of our everyday interactions in the physical world, requires careful design in virtual environments. However, feedback location can vary from the fingertip to the finger, hand, and arm due to heterogeneous ...
Touch, Movement and Vibration: User Perception of Vibrotactile Feedback for Touch and Mid-Air Gestures
Human-Computer Interaction – INTERACT 2015AbstractDesigning appropriate feedback for gesture interfaces is an important aspect of user experience and performance. We conduct the first investigation of users’ perceptions of vibrotactile stimuli during touch and mid-air gesture input for smart ...
Comments