skip to main content
research-article

BodyTouch: Investigating Eye-Free, On-Body and Near-Body Touch Interactions with HMDs

Published:12 January 2024Publication History
Skip Abstract Section

Abstract

This paper presents a study on the touch precision of an eye-free, body-based interface using on-body and near-body touch methods with and without skin contact. We evaluate user touch accuracy on four different button layouts. These layouts progressively increase the number of buttons between adjacent body joints, resulting in 12, 20, 28, and 36 touch buttons distributed across the body. Our study indicates that the on-body method achieved an accuracy beyond 95% for the 12- and 20-button layouts, whereas the near-body method only for the 12-button layout. Investigating user touch patterns, we applied SVM classifiers, which boost both the on-body and near-body methods to support up to the 28-button layouts by learning individual touch patterns. However, using generalized touch patterns did not significantly improve accuracy for more complex layouts, highlighting considerable differences in individual touch habits. When evaluating user experience metrics such as workload perception, confidence, convenience, and willingness-to-use, users consistently favored the 20-button layout regardless of the touch technique used. Remarkably, the 20-button layout, when applied to on-body touch methods, does not necessitate personal touch patterns, showcasing an optimal balance of practicality, effectiveness, and user experience without the need for trained models. In contrast, the near-body touch targeting the 20-button layout needs a personalized model; otherwise, the 12-button layout offers the best immediate practicality.

Skip Supplemental Material Section

Supplemental Material

References

  1. Karan Ahuja, Chris Harrison, Mayank Goel, and Robert Xiao. 2019. MeCap: Whole-Body Digitization for Low-Cost VR/AR Headsets. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 453--462. https://doi.org/10.1145/3332165.3347889Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Takumi Azai, Mai Otsuki, Fumihisa Shibata, and Asako Kimura. 2018. Open Palm Menu: A Virtual Menu Placed in Front of the Palm. In Proceedings of the 9th Augmented Human International Conference (Seoul, Republic of Korea) (AH '18). Association for Computing Machinery, New York, NY, USA, Article 17, 5 pages. https://doi.org/10.1145/3174910.3174929Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Joanna Bergström and Kasper Hornbæk. 2019. Human--Computer Interaction on the Skin. ACM Comput. Surv. 52, 4, Article 77 (aug 2019), 14 pages. https://doi.org/10.1145/3332166Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Joanna Bergstrom-Lehtovirta, Sebastian Boring, and Kasper Hornbæk. 2017. Placing and Recalling Virtual Items on the Skin (CHI '17). Association for Computing Machinery, New York, NY, USA, 1497--1507. https://doi.org/10.1145/3025453.3026030Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Benoît Bossavit, Asier Marzo, Oscar Ardaiz, and Alfredo Pina. 2013. Hierarchical Menu Selection with a Body-Centered Remote Interface. Interacting with Computers 26, 5 (08 2013), 389--402. https://doi.org/10.1093/iwc/iwt043 arXiv:https://academic.oup.com/iwc/article-pdf/26/5/389/9644212/iwt043.pdfGoogle ScholarGoogle ScholarCross RefCross Ref
  6. D.A. Bowman and C.A. Wingrave. 2001. Design and evaluation of menu systems for immersive virtual environments. In Proceedings IEEE Virtual Reality 2001. 149--156. https://doi.org/10.1109/VR.2001.913781Google ScholarGoogle ScholarCross RefCross Ref
  7. Stephen Brewster, Joanna Lumsden, Marek Bell, Malcolm Hall, and Stuart Tasker. 2003. Multimodal 'eyes-Free' Interaction Techniques for Wearable Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI '03). Association for Computing Machinery, New York, NY, USA, 473--480. https://doi.org/10.1145/642611.642694Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Liwei Chan, Yi-Ling Chen, Chi-Hao Hsieh, Rong-Hao Liang, and Bing-Yu Chen. 2015. CyclopsRing: Enabling Whole-Hand and Context-Aware Interactions Through a Fisheye Ring. In Proceedings of the 28th Annual ACM Symposium on User Interface Software amp; Technology (Charlotte, NC, USA) (UIST '15). Association for Computing Machinery, New York, NY, USA, 549--556. https://doi.org/10.1145/2807442.2807450Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Liwei Chan, Chi-Hao Hsieh, Yi-Ling Chen, Shuo Yang, Da-Yuan Huang, Rong-Hao Liang, and Bing-Yu Chen. 2015. Cyclops: Wearable and Single-Piece Full-Body Gesture Input Devices. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). Association for Computing Machinery, New York, NY, USA, 3001--3009. https://doi.org/10.1145/2702123.2702464Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Liwei Chan, Rong-Hao Liang, Ming-Chang Tsai, Kai-Yin Cheng, Chao-Huai Su, Mike Y. Chen, Wen-Huang Cheng, and Bing-Yu Chen. 2013. FingerPad: Private and Subtle Interaction Using Fingertips. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST '13). Association for Computing Machinery, New York, NY, USA, 255--260. https://doi.org/10.1145/2501988.2502016Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. A. Cockburn, P. Quinn, C. Gutwin, G. Ramos, and J. Looser. 2011. Air pointing: Design and evaluation of spatial target acquisition with and without visual feedback. International Journal of Human-Computer Studies 69, 6 (2011), 401--414. https://doi.org/10.1016/j.ijhcs.2011.02.005Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Jacob Cohen. 1988. Statistical power analysis for the behavioral sciences. Routledge.Google ScholarGoogle Scholar
  13. Corinna Cortes and Vladimir Vapnik. 1995. Support-vector networks. Machine learning 20, 3 (1995), 273--297.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Niloofar Dezfuli, Mohammadreza Khalilbeigi, Jochen Huber, Florian Müller, and Max Mühlhäuser. 2012. PalmRC: Imaginary Palm-Based Remote Control for Eyes-Free Television Interaction. In Proceedings of the 10th European Conference on Interactive TV and Video (Berlin, Germany) (EuroITV '12). Association for Computing Machinery, New York, NY, USA, 27--34. https://doi.org/10.1145/2325616.2325623Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Shariff AM Faleel, Michael Gammon, Kevin Fan, Da-Yuan Huang, Wei Li, and Pourang Irani. 2021. HPUI: Hand Proximate User Interfaces for One-Handed Interactions on Head Mounted Displays. IEEE Transactions on Visualization and Computer Graphics 27, 11 (2021), 4215--4225. https://doi.org/10.1109/TVCG.2021.3106493Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Jan Gugenheimer, David Dobbelstein, Christian Winkler, Gabriel Haas, and Enrico Rukzio. 2016. FaceTouch: Enabling Touch Interaction in Display Fixed UIs for Mobile Virtual Reality. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST '16). Association for Computing Machinery, New York, NY, USA, 49--60. https://doi.org/10.1145/2984511.2984576Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Sean G. Gustafson, Bernhard Rabe, and Patrick M. Baudisch. 2013. Understanding Palm-Based Imaginary Interfaces: The Role of Visual and Tactile Cues When Browsing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). Association for Computing Machinery, New York, NY, USA, 889--898. https://doi.org/10.1145/2470654.2466114Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Nur Al-huda Hamdan, Ravi Kanth Kosuru, Christian Corsten, and Jan Borchers. 2017. Run&Tap: Investigation of On-Body Tapping for Runners. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (Brighton, United Kingdom) (ISS 17). Association for Computing Machinery, New York, NY, USA, 280--286. https://doi.org/10.1145/3132272.3134140Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Jia Han, Gordon Waddington, Roger Adams, Judith Anson, and Yu Liu. 2016. Assessing proprioception: A critical review of methods. Journal of Sport and Health Science 5, 1 (2016), 80--90. https://doi.org/10.1016/j.jshs.2014.10.004Google ScholarGoogle ScholarCross RefCross Ref
  20. Chris Harrison, Hrvoje Benko, and Andrew D. Wilson. 2011. OmniTouch: Wearable Multitouch Interaction Everywhere. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 441--450. https://doi.org/10.1145/2047196.2047255Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Chris Harrison and Haakon Faste. 2014. Implications of Location and Touch for On-Body Projected Interfaces. In Proceedings of the 2014 Conference on Designing Interactive Systems (Vancouver, BC, Canada) (DIS '14). Association for Computing Machinery, New York, NY, USA, 543--552. https://doi.org/10.1145/2598510.2598587Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Chris Harrison, Desney Tan, and Dan Morris. 2010. Skinput: Appropriating the Body as an Input Surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI '10). Association for Computing Machinery, New York, NY, USA, 453--462. https://doi.org/10.1145/1753326.1753394Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Florian Heller, Stefan Ivanov, Chat Wacharamanotham, and Jan Borchers. 2014. FabriTouch: Exploring Flexible Touch Input on Textiles. In Proceedings of the 2014 ACM International Symposium on Wearable Computers (Seattle, Washington) (ISWC '14). Association for Computing Machinery, New York, NY, USA, 59--62. https://doi.org/10.1145/2634317.2634345Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Christian Holz and Patrick Baudisch. 2011. Understanding Touch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). Association for Computing Machinery, New York, NY, USA, 2501--2510. https://doi.org/10.1145/1978942.1979308Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Ryosuke Hori, Ryo Hachiuma, Mariko Isogawa, Dan Mikami, and Hideo Saito. 2022. Silhouette-Based 3D Human Pose Estimation Using a Single Wrist-Mounted 360° Camera. IEEE Access 10 (2022), 54957--54968. https://doi.org/10.1109/ACCESS.2022.3177623Google ScholarGoogle ScholarCross RefCross Ref
  26. Da-Yuan Huang, Liwei Chan, Shuo Yang, Fan Wang, Rong-Hao Liang, De-Nian Yang, Yi-Ping Hung, and Bing-Yu Chen. 2016. DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 1526--1537. https://doi.org/10.1145/2858036.2858483Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Dong-Hyun Hwang, Kohei Aso, Ye Yuan, Kris Kitani, and Hideki Koike. 2020. MonoEye: Multimodal Human Motion Capture System Using A Single Ultra-Wide Fisheye Camera. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST '20). Association for Computing Machinery, New York, NY, USA, 98--111. https://doi.org/10.1145/3379337.3415856Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Fan Jiang, Xubo Yang, and Lele Feng. 2016. Real-Time Full-Body Motion Reconstruction and Recognition for off-the-Shelf VR Devices. In Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1 (Zhuhai, China) (VRCAI '16). Association for Computing Machinery, New York, NY, USA, 309--318. https://doi.org/10.1145/3013971.3013987Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Haiyan Jiang, Dongdong Weng, Xiaonuo Dongye, and Yue Liu. 2022. PinchText: One-Handed Text Entry Technique Combining Pinch Gestures and Hand Positions for Head-Mounted Displays. International Journal of Human--Computer Interaction 0, 0 (2022), 1--17. https://doi.org/10.1080/10447318.2022.2115333 arXiv:https://doi.org/10.1080/10447318.2022.2115333Google ScholarGoogle ScholarCross RefCross Ref
  30. Haojian Jin, Zhijian Yang, Swarun Kumar, and Jason I. Hong. 2018. Towards Wearable Everyday Body-Frame Tracking Using Passive RFIDs. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 4, Article 145 (jan 2018), 23 pages. https://doi.org/10.1145/3161199Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Yujin Jung, Donghoon Kang, and Jinwook Kim. 2010. Upper body motion tracking with inertial sensors. In 2010 IEEE International Conference on Robotics and Biomimetics. 1746--1751. https://doi.org/10.1109/ROBIO.2010.5723595Google ScholarGoogle ScholarCross RefCross Ref
  32. Takashi Kikuchi, Yuta Sugiura, Katsutoshi Masai, Maki Sugimoto, and Bruce H. Thomas. 2017. EarTouch: Turning the Ear into an Input Surface. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (Vienna, Austria) (MobileHCI '17). Association for Computing Machinery, New York, NY, USA, Article 27, 6 pages. https://doi.org/10.1145/3098279.3098538Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Gierad Laput, Robert Xiao, Xiang 'Anthony' Chen, Scott E. Hudson, and Chris Harrison. 2014. Skin Buttons: Cheap, Small, Low-Powered and Clickable Fixed-Icon Laser Projectors. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST '14). Association for Computing Machinery, New York, NY, USA, 389--394. https://doi.org/10.1145/2642918.2647356Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Frank Chun Yat Li, David Dearman, and Khai N. Truong. 2009. Virtual Shelves: Interactions with Orientation Aware Devices. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (Victoria, BC, Canada) (UIST '09). Association for Computing Machinery, New York, NY, USA, 125--128. https://doi.org/10.1145/1622176.1622200Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Frank Chun Yat Li, David Dearman, and Khai N. Truong. 2010. Leveraging Proprioception to Make Mobile Phones More Accessible to Users with Visual Impairments. In Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility (Orlando, Florida, USA) (ASSETS '10). Association for Computing Machinery, New York, NY, USA, 187--194. https://doi.org/10.1145/1878803.1878837Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Zhen Li, Joannes Chan, Joshua Walton, Hrvoje Benko, Daniel Wigdor, and Michael Glueck. 2021. Armstrong: An Empirical Examination of Pointing at Non-Dominant Arm-Anchored UIs in Virtual Reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 123, 14 pages. https://doi.org/10.1145/3411764.3445064Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Jhe-Wei Lin, Chiuan Wang, Yi Yao Huang, Kuan-Ting Chou, Hsuan-Yu Chen, Wei-Luan Tseng, and Mike Y. Chen. 2015. BackHand: Sensing Hand Gestures via Back of the Hand. In Proceedings of the 28th Annual ACM Symposium on User Interface Software amp; Technology (Charlotte, NC, USA) (UIST '15). Association for Computing Machinery, New York, NY, USA, 557--564. https://doi.org/10.1145/2807442.2807462Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Shu-Yang Lin, Chao-Huai Su, Kai-Yin Cheng, Rong-Hao Liang, Tzu-Hao Kuo, and Bing-Yu Chen. 2011. Pub - Point upon Body: Exploring Eyes-Free Interaction and Methods on an Arm. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 481--488. https://doi.org/10.1145/2047196.2047259Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Wei Luo and Feng Wang. 2015. A Survey of Eyes-Free Based Interaction. In 2015 8th International Conference on Intelligent Networks and Intelligent Systems (ICINIS). 185--188. https://doi.org/10.1109/ICINIS.2015.28Google ScholarGoogle ScholarCross RefCross Ref
  40. Tzu-Wei Mi, Jia-Jun Wang, and Liwei Chan. 2023. LapTouch: Using the Lap for Seated Touch Interaction with HMDs. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 7, 3, Article 114 (sep 2023), 23 pages. https://doi.org/10.1145/3610878Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Florian Müller, Joshua McManus, Sebastian Günther, Martin Schmitz, Max Mühlhäuser, and Markus Funk. 2019. Mind the Tap: Assessing Foot-Taps for Interacting with Head-Mounted Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300707Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Ian Oakley and Jun-Seok Park. 2007. Designing Eyes-Free Interaction. In Proceedings of the 2nd International Conference on Haptic and Audio Interaction Design (Seoul, South Korea) (HAID'07). Springer-Verlag, Berlin, Heidelberg, 121--132.Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Masa Ogata, Yuta Sugiura, Yasutoshi Makino, Masahiko Inami, and Michita Imai. 2013. SenSkin: Adapting Skin as a Soft Interface. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST '13). Association for Computing Machinery, New York, NY, USA, 539--544. https://doi.org/10.1145/2501988.2502039Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Masa Ogata, Ryosuke Totsuka, and Michita Imai. 2015. SkinWatch: Adapting Skin as a Gesture Surface. In SIGGRAPH Asia 2015 Emerging Technologies (Kobe, Japan) (SA '15). Association for Computing Machinery, New York, NY, USA, Article 22, 2 pages. https://doi.org/10.1145/2818466.2818496Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Halley P. Profita, James Clawson, Scott Gilliland, Clint Zeagler, Thad Starner, Jim Budd, and Ellen Yi-Luen Do. 2013. Don't Mind Me Touching My Wrist: A Case Study of Interacting with on-Body Technology in Public. In Proceedings of the 2013 International Symposium on Wearable Computers (Zurich, Switzerland) (ISWC '13). Association for Computing Machinery, New York, NY, USA, 89--96. https://doi.org/10.1145/2493988.2494331Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Helge Rhodin, Christian Richardt, Dan Casas, Eldar Insafutdinov, Mohammad Shafiei, Hans-Peter Seidel, Bernt Schiele, and Christian Theobalt. 2016. EgoCap: Egocentric Marker-Less Motion Capture with Two Fisheye Cameras. ACM Trans. Graph. 35, 6, Article 162 (nov 2016), 11 pages. https://doi.org/10.1145/2980179.2980235Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Daniel Roetenberg, Henk Luinge, and Per Slycke. 2009. Xsens mvn: full 6dof human motion tracking using miniature inertial sensors. Xsens Motion Technologies BV. Technical Report.Google ScholarGoogle Scholar
  48. Marcos Serrano, Barrett M. Ens, and Pourang P. Irani. 2014. Exploring the Use of Hand-to-Face Input for Interacting with Head-Worn Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). Association for Computing Machinery, New York, NY, USA, 3181--3190. https://doi.org/10.1145/2556288.2556984Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Wei Sun, Franklin Mingzhe Li, Congshu Huang, Zhenyu Lei, Benjamin Steeper, Songyun Tao, Feng Tian, and Cheng Zhang. 2021. ThumbTrak: Recognizing Micro-Finger Poses Using a Ring with Proximity Sensing. In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction (Toulouse amp; Virtual, France) (MobileHCI '21). Association for Computing Machinery, New York, NY, USA, Article 2, 9 pages. https://doi.org/10.1145/3447526.3472060Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Denis Tome, Patrick Peluse, Lourdes Agapito, and Hernan Badino. 2019. xR-EgoPose: Egocentric 3D Human Pose From an HMD Camera. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV). 7727--7737. https://doi.org/10.1109/ICCV.2019.00782Google ScholarGoogle ScholarCross RefCross Ref
  51. Hsin-Ruey Tsai, Te-Yen Wu, Da-Yuan Huang, Min-Chieh Hsiu, Jui-Chun Hsiao, Yi-Ping Hung, Mike Y. Chen, and Bing-Yu Chen. 2017. SegTouch: Enhancing Touch Input While Providing Touch Gestures on Screens Using Thumb-To-Index-Finger Gestures. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI EA '17). Association for Computing Machinery, New York, NY, USA, 2164--2171. https://doi.org/10.1145/3027063.3053109Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. R. J. van Beers, Anne C. Sittig, and Jan J. Denier van der Gon. 1998. The precision of proprioceptive position sense. Experimental Brain Research 122, 4 (01 Oct 1998), 367--377. https://doi.org/10.1007/s002210050525Google ScholarGoogle ScholarCross RefCross Ref
  53. Velko Vechev, Alexandru Dancu, Simon T. Perrault, Quentin Roy, Morten Fjeld, and Shengdong Zhao. 2018. Body Mnemonics Portable device interaction design concept. In Proceedings of the 2018 International Conference on Advanced Visual Interfaces (Castiglione della Pescaia, Grosseto, Italy) (AVI '18). Association for Computing Machinery, New York, NY, USA, Article 28, 9 pages. https://doi.org/10.1145/3206505.3206527Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Velko Vechev, Alexandru Dancu, Simon T. Perrault, Quentin Roy, Morten Fjeld, and Shengdong Zhao. 2018. Movespace: On-Body Athletic Interaction for Running and Cycling. In Proceedings of the 2018 International Conference on Advanced Visual Interfaces (Castiglione della Pescaia, Grosseto, Italy) (AVI '18). Association for Computing Machinery, New York, NY, USA, Article 28, 9 pages. https://doi.org/10.1145/3206505.3206527Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Dong-Bach Vo, Eric Lecolinet, and Yves Guiard. 2014. Belly Gestures: Body Centric Gestures on the Abdomen. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (Helsinki, Finland) (NordiCHI '14). Association for Computing Machinery, New York, NY, USA, 687--696. https://doi.org/10.1145/2639189.2639210Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Julie Wagner, Mathieu Nancel, Sean G. Gustafson, Stephane Huot, and Wendy E. Mackay. 2013. Body-Centric Design Space for Multi-Surface Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). Association for Computing Machinery, New York, NY, USA, 1299--1308. https://doi.org/10.1145/2470654.2466170Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Chuyu Wang, Jian Liu, Yingying Chen, Lei Xie, Hong Bo Liu, and Sanclu Lu. 2018. RF-Kinect: A Wearable RFID-Based Approach Towards 3D Body Movement Tracking. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 1, Article 41 (mar 2018), 28 pages. https://doi.org/10.1145/3191773Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Cheng-Yao Wang, Min-Chieh Hsiu, Po-Tsung Chiu, Chiao-Hui Chang, Liwei Chan, Bing-Yu Chen, and Mike Y. Chen. 2015. PalmGesture: Using Palms as Gesture Interfaces for Eyes-Free Input. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (Copenhagen, Denmark) (MobileHCI '15). Association for Computing Machinery, New York, NY, USA, 217--226. https://doi.org/10.1145/2785830.2785885Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Yueting Weng, Chun Yu, Yingtian Shi, Yuhang Zhao, Yukang Yan, and Yuanchun Shi. 2021. FaceSight: Enabling Hand-to-Face Gesture Interaction on AR Glasses with a Downward-Facing Camera Vision. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 10, 14 pages. https://doi.org/10.1145/3411764.3445484Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, and Mayank Goel. 2017. DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-Mounted Displays. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 113 (sep 2017), 21 pages. https://doi.org/10.1145/3130978Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Erwin Wu, Ye Yuan, Hui-Shyong Yeo, Aaron Quigley, Hideki Koike, and Kris M. Kitani. 2020. Back-Hand-Pose: 3D Hand Pose Estimation for a Wrist-Worn Camera via Dorsum Deformation Network. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST '20). Association for Computing Machinery, New York, NY, USA, 1147--1160. https://doi.org/10.1145/3379337.3415897Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Xuhai Xu, Haitian Shi, Xin Yi, WenJia Liu, Yukang Yan, Yuanchun Shi, Alex Mariakakis, Jennifer Mankoff, and Anind K. Dey. 2020. EarBuddy: Enabling On-Face Interaction via Wireless Earbuds. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376836Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Yukang Yan, Chun Yu, Xiaojuan Ma, Shuai Huang, Hasan Iqbal, and Yuanchun Shi. 2018. Eyes-Free Target Acquisition in Interaction Space around the Body for Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3173574.3173616Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Chuang-Wen You, Ya-Fang Lin, Elle Luo, Hung-Yeh Lin, and Hsin-Liu (Cindy) Kao. 2019. Understanding Social Perceptions towards Interacting with On-Skin Interfaces in Public. In Proceedings of the 23rd International Symposium on Wearable Computers (London, United Kingdom) (ISWC '19). Association for Computing Machinery, New York, NY, USA, 244--253. https://doi.org/10.1145/3341163.3347751Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Clint Zeagler. 2017. Where to Wear It: Functional, Technical, and Social Considerations in on-Body Location for Wearable Technology 20 Years of Designing for Wearability. In Proceedings of the 2017 ACM International Symposium on Wearable Computers (Maui, Hawaii) (ISWC '17). Association for Computing Machinery, New York, NY, USA, 150--157. https://doi.org/10.1145/3123021.3123042Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Cheng Zhang, AbdelKareem Bedri, Gabriel Reyes, Bailey Bercik, Omer T. Inan, Thad E. Starner, and Gregory D. Abowd. 2016. TapSkin: Recognizing On-Skin Input for Smartwatches. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (Niagara Falls, Ontario, Canada) (ISS '16). Association for Computing Machinery, New York, NY, USA, 13--22. https://doi.org/10.1145/2992154.2992187Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Yang Zhang, Wolf Kienzle, Yanjun Ma, Shiu S. Ng, Hrvoje Benko, and Chris Harrison. 2019. ActiTouch: Robust Touch Detection for On-Skin AR/VR Interfaces. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 1151--1159. https://doi.org/10.1145/3332165.3347869Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Yang Zhang, Junhan Zhou, Gierad Laput, and Chris Harrison. 2016. SkinTrack: Using the Body as an Electrical Waveguide for Continuous Finger Tracking on the Skin. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 1491--1503. https://doi.org/10.1145/2858036.2858082Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Junhan Zhou, Yang Zhang, Gierad Laput, and Chris Harrison. 2016. AuraSense: Enabling Expressive Around-Smartwatch Interactions with Electric Field Sensing. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST '16). Association for Computing Machinery, New York, NY, USA, 81--86. https://doi.org/10.1145/2984511.2984568Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. BodyTouch: Investigating Eye-Free, On-Body and Near-Body Touch Interactions with HMDs

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
          Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 7, Issue 4
          December 2023
          1613 pages
          EISSN:2474-9567
          DOI:10.1145/3640795
          Issue’s Table of Contents

          Copyright © 2024 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 12 January 2024
          Published in imwut Volume 7, Issue 4

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader