Abstract
This paper presents a study on the touch precision of an eye-free, body-based interface using on-body and near-body touch methods with and without skin contact. We evaluate user touch accuracy on four different button layouts. These layouts progressively increase the number of buttons between adjacent body joints, resulting in 12, 20, 28, and 36 touch buttons distributed across the body. Our study indicates that the on-body method achieved an accuracy beyond 95% for the 12- and 20-button layouts, whereas the near-body method only for the 12-button layout. Investigating user touch patterns, we applied SVM classifiers, which boost both the on-body and near-body methods to support up to the 28-button layouts by learning individual touch patterns. However, using generalized touch patterns did not significantly improve accuracy for more complex layouts, highlighting considerable differences in individual touch habits. When evaluating user experience metrics such as workload perception, confidence, convenience, and willingness-to-use, users consistently favored the 20-button layout regardless of the touch technique used. Remarkably, the 20-button layout, when applied to on-body touch methods, does not necessitate personal touch patterns, showcasing an optimal balance of practicality, effectiveness, and user experience without the need for trained models. In contrast, the near-body touch targeting the 20-button layout needs a personalized model; otherwise, the 12-button layout offers the best immediate practicality.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, BodyTouch: Investigating Eye-Free, On-Body and Near-Body Touch Interactions with HMDs
- Karan Ahuja, Chris Harrison, Mayank Goel, and Robert Xiao. 2019. MeCap: Whole-Body Digitization for Low-Cost VR/AR Headsets. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 453--462. https://doi.org/10.1145/3332165.3347889Google ScholarDigital Library
- Takumi Azai, Mai Otsuki, Fumihisa Shibata, and Asako Kimura. 2018. Open Palm Menu: A Virtual Menu Placed in Front of the Palm. In Proceedings of the 9th Augmented Human International Conference (Seoul, Republic of Korea) (AH '18). Association for Computing Machinery, New York, NY, USA, Article 17, 5 pages. https://doi.org/10.1145/3174910.3174929Google ScholarDigital Library
- Joanna Bergström and Kasper Hornbæk. 2019. Human--Computer Interaction on the Skin. ACM Comput. Surv. 52, 4, Article 77 (aug 2019), 14 pages. https://doi.org/10.1145/3332166Google ScholarDigital Library
- Joanna Bergstrom-Lehtovirta, Sebastian Boring, and Kasper Hornbæk. 2017. Placing and Recalling Virtual Items on the Skin (CHI '17). Association for Computing Machinery, New York, NY, USA, 1497--1507. https://doi.org/10.1145/3025453.3026030Google ScholarDigital Library
- Benoît Bossavit, Asier Marzo, Oscar Ardaiz, and Alfredo Pina. 2013. Hierarchical Menu Selection with a Body-Centered Remote Interface. Interacting with Computers 26, 5 (08 2013), 389--402. https://doi.org/10.1093/iwc/iwt043 arXiv:https://academic.oup.com/iwc/article-pdf/26/5/389/9644212/iwt043.pdfGoogle ScholarCross Ref
- D.A. Bowman and C.A. Wingrave. 2001. Design and evaluation of menu systems for immersive virtual environments. In Proceedings IEEE Virtual Reality 2001. 149--156. https://doi.org/10.1109/VR.2001.913781Google ScholarCross Ref
- Stephen Brewster, Joanna Lumsden, Marek Bell, Malcolm Hall, and Stuart Tasker. 2003. Multimodal 'eyes-Free' Interaction Techniques for Wearable Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI '03). Association for Computing Machinery, New York, NY, USA, 473--480. https://doi.org/10.1145/642611.642694Google ScholarDigital Library
- Liwei Chan, Yi-Ling Chen, Chi-Hao Hsieh, Rong-Hao Liang, and Bing-Yu Chen. 2015. CyclopsRing: Enabling Whole-Hand and Context-Aware Interactions Through a Fisheye Ring. In Proceedings of the 28th Annual ACM Symposium on User Interface Software amp; Technology (Charlotte, NC, USA) (UIST '15). Association for Computing Machinery, New York, NY, USA, 549--556. https://doi.org/10.1145/2807442.2807450Google ScholarDigital Library
- Liwei Chan, Chi-Hao Hsieh, Yi-Ling Chen, Shuo Yang, Da-Yuan Huang, Rong-Hao Liang, and Bing-Yu Chen. 2015. Cyclops: Wearable and Single-Piece Full-Body Gesture Input Devices. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). Association for Computing Machinery, New York, NY, USA, 3001--3009. https://doi.org/10.1145/2702123.2702464Google ScholarDigital Library
- Liwei Chan, Rong-Hao Liang, Ming-Chang Tsai, Kai-Yin Cheng, Chao-Huai Su, Mike Y. Chen, Wen-Huang Cheng, and Bing-Yu Chen. 2013. FingerPad: Private and Subtle Interaction Using Fingertips. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST '13). Association for Computing Machinery, New York, NY, USA, 255--260. https://doi.org/10.1145/2501988.2502016Google ScholarDigital Library
- A. Cockburn, P. Quinn, C. Gutwin, G. Ramos, and J. Looser. 2011. Air pointing: Design and evaluation of spatial target acquisition with and without visual feedback. International Journal of Human-Computer Studies 69, 6 (2011), 401--414. https://doi.org/10.1016/j.ijhcs.2011.02.005Google ScholarDigital Library
- Jacob Cohen. 1988. Statistical power analysis for the behavioral sciences. Routledge.Google Scholar
- Corinna Cortes and Vladimir Vapnik. 1995. Support-vector networks. Machine learning 20, 3 (1995), 273--297.Google ScholarDigital Library
- Niloofar Dezfuli, Mohammadreza Khalilbeigi, Jochen Huber, Florian Müller, and Max Mühlhäuser. 2012. PalmRC: Imaginary Palm-Based Remote Control for Eyes-Free Television Interaction. In Proceedings of the 10th European Conference on Interactive TV and Video (Berlin, Germany) (EuroITV '12). Association for Computing Machinery, New York, NY, USA, 27--34. https://doi.org/10.1145/2325616.2325623Google ScholarDigital Library
- Shariff AM Faleel, Michael Gammon, Kevin Fan, Da-Yuan Huang, Wei Li, and Pourang Irani. 2021. HPUI: Hand Proximate User Interfaces for One-Handed Interactions on Head Mounted Displays. IEEE Transactions on Visualization and Computer Graphics 27, 11 (2021), 4215--4225. https://doi.org/10.1109/TVCG.2021.3106493Google ScholarDigital Library
- Jan Gugenheimer, David Dobbelstein, Christian Winkler, Gabriel Haas, and Enrico Rukzio. 2016. FaceTouch: Enabling Touch Interaction in Display Fixed UIs for Mobile Virtual Reality. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST '16). Association for Computing Machinery, New York, NY, USA, 49--60. https://doi.org/10.1145/2984511.2984576Google ScholarDigital Library
- Sean G. Gustafson, Bernhard Rabe, and Patrick M. Baudisch. 2013. Understanding Palm-Based Imaginary Interfaces: The Role of Visual and Tactile Cues When Browsing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). Association for Computing Machinery, New York, NY, USA, 889--898. https://doi.org/10.1145/2470654.2466114Google ScholarDigital Library
- Nur Al-huda Hamdan, Ravi Kanth Kosuru, Christian Corsten, and Jan Borchers. 2017. Run&Tap: Investigation of On-Body Tapping for Runners. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (Brighton, United Kingdom) (ISS 17). Association for Computing Machinery, New York, NY, USA, 280--286. https://doi.org/10.1145/3132272.3134140Google ScholarDigital Library
- Jia Han, Gordon Waddington, Roger Adams, Judith Anson, and Yu Liu. 2016. Assessing proprioception: A critical review of methods. Journal of Sport and Health Science 5, 1 (2016), 80--90. https://doi.org/10.1016/j.jshs.2014.10.004Google ScholarCross Ref
- Chris Harrison, Hrvoje Benko, and Andrew D. Wilson. 2011. OmniTouch: Wearable Multitouch Interaction Everywhere. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 441--450. https://doi.org/10.1145/2047196.2047255Google ScholarDigital Library
- Chris Harrison and Haakon Faste. 2014. Implications of Location and Touch for On-Body Projected Interfaces. In Proceedings of the 2014 Conference on Designing Interactive Systems (Vancouver, BC, Canada) (DIS '14). Association for Computing Machinery, New York, NY, USA, 543--552. https://doi.org/10.1145/2598510.2598587Google ScholarDigital Library
- Chris Harrison, Desney Tan, and Dan Morris. 2010. Skinput: Appropriating the Body as an Input Surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI '10). Association for Computing Machinery, New York, NY, USA, 453--462. https://doi.org/10.1145/1753326.1753394Google ScholarDigital Library
- Florian Heller, Stefan Ivanov, Chat Wacharamanotham, and Jan Borchers. 2014. FabriTouch: Exploring Flexible Touch Input on Textiles. In Proceedings of the 2014 ACM International Symposium on Wearable Computers (Seattle, Washington) (ISWC '14). Association for Computing Machinery, New York, NY, USA, 59--62. https://doi.org/10.1145/2634317.2634345Google ScholarDigital Library
- Christian Holz and Patrick Baudisch. 2011. Understanding Touch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). Association for Computing Machinery, New York, NY, USA, 2501--2510. https://doi.org/10.1145/1978942.1979308Google ScholarDigital Library
- Ryosuke Hori, Ryo Hachiuma, Mariko Isogawa, Dan Mikami, and Hideo Saito. 2022. Silhouette-Based 3D Human Pose Estimation Using a Single Wrist-Mounted 360° Camera. IEEE Access 10 (2022), 54957--54968. https://doi.org/10.1109/ACCESS.2022.3177623Google ScholarCross Ref
- Da-Yuan Huang, Liwei Chan, Shuo Yang, Fan Wang, Rong-Hao Liang, De-Nian Yang, Yi-Ping Hung, and Bing-Yu Chen. 2016. DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 1526--1537. https://doi.org/10.1145/2858036.2858483Google ScholarDigital Library
- Dong-Hyun Hwang, Kohei Aso, Ye Yuan, Kris Kitani, and Hideki Koike. 2020. MonoEye: Multimodal Human Motion Capture System Using A Single Ultra-Wide Fisheye Camera. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST '20). Association for Computing Machinery, New York, NY, USA, 98--111. https://doi.org/10.1145/3379337.3415856Google ScholarDigital Library
- Fan Jiang, Xubo Yang, and Lele Feng. 2016. Real-Time Full-Body Motion Reconstruction and Recognition for off-the-Shelf VR Devices. In Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1 (Zhuhai, China) (VRCAI '16). Association for Computing Machinery, New York, NY, USA, 309--318. https://doi.org/10.1145/3013971.3013987Google ScholarDigital Library
- Haiyan Jiang, Dongdong Weng, Xiaonuo Dongye, and Yue Liu. 2022. PinchText: One-Handed Text Entry Technique Combining Pinch Gestures and Hand Positions for Head-Mounted Displays. International Journal of Human--Computer Interaction 0, 0 (2022), 1--17. https://doi.org/10.1080/10447318.2022.2115333 arXiv:https://doi.org/10.1080/10447318.2022.2115333Google ScholarCross Ref
- Haojian Jin, Zhijian Yang, Swarun Kumar, and Jason I. Hong. 2018. Towards Wearable Everyday Body-Frame Tracking Using Passive RFIDs. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 4, Article 145 (jan 2018), 23 pages. https://doi.org/10.1145/3161199Google ScholarDigital Library
- Yujin Jung, Donghoon Kang, and Jinwook Kim. 2010. Upper body motion tracking with inertial sensors. In 2010 IEEE International Conference on Robotics and Biomimetics. 1746--1751. https://doi.org/10.1109/ROBIO.2010.5723595Google ScholarCross Ref
- Takashi Kikuchi, Yuta Sugiura, Katsutoshi Masai, Maki Sugimoto, and Bruce H. Thomas. 2017. EarTouch: Turning the Ear into an Input Surface. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (Vienna, Austria) (MobileHCI '17). Association for Computing Machinery, New York, NY, USA, Article 27, 6 pages. https://doi.org/10.1145/3098279.3098538Google ScholarDigital Library
- Gierad Laput, Robert Xiao, Xiang 'Anthony' Chen, Scott E. Hudson, and Chris Harrison. 2014. Skin Buttons: Cheap, Small, Low-Powered and Clickable Fixed-Icon Laser Projectors. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST '14). Association for Computing Machinery, New York, NY, USA, 389--394. https://doi.org/10.1145/2642918.2647356Google ScholarDigital Library
- Frank Chun Yat Li, David Dearman, and Khai N. Truong. 2009. Virtual Shelves: Interactions with Orientation Aware Devices. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (Victoria, BC, Canada) (UIST '09). Association for Computing Machinery, New York, NY, USA, 125--128. https://doi.org/10.1145/1622176.1622200Google ScholarDigital Library
- Frank Chun Yat Li, David Dearman, and Khai N. Truong. 2010. Leveraging Proprioception to Make Mobile Phones More Accessible to Users with Visual Impairments. In Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility (Orlando, Florida, USA) (ASSETS '10). Association for Computing Machinery, New York, NY, USA, 187--194. https://doi.org/10.1145/1878803.1878837Google ScholarDigital Library
- Zhen Li, Joannes Chan, Joshua Walton, Hrvoje Benko, Daniel Wigdor, and Michael Glueck. 2021. Armstrong: An Empirical Examination of Pointing at Non-Dominant Arm-Anchored UIs in Virtual Reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 123, 14 pages. https://doi.org/10.1145/3411764.3445064Google ScholarDigital Library
- Jhe-Wei Lin, Chiuan Wang, Yi Yao Huang, Kuan-Ting Chou, Hsuan-Yu Chen, Wei-Luan Tseng, and Mike Y. Chen. 2015. BackHand: Sensing Hand Gestures via Back of the Hand. In Proceedings of the 28th Annual ACM Symposium on User Interface Software amp; Technology (Charlotte, NC, USA) (UIST '15). Association for Computing Machinery, New York, NY, USA, 557--564. https://doi.org/10.1145/2807442.2807462Google ScholarDigital Library
- Shu-Yang Lin, Chao-Huai Su, Kai-Yin Cheng, Rong-Hao Liang, Tzu-Hao Kuo, and Bing-Yu Chen. 2011. Pub - Point upon Body: Exploring Eyes-Free Interaction and Methods on an Arm. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 481--488. https://doi.org/10.1145/2047196.2047259Google ScholarDigital Library
- Wei Luo and Feng Wang. 2015. A Survey of Eyes-Free Based Interaction. In 2015 8th International Conference on Intelligent Networks and Intelligent Systems (ICINIS). 185--188. https://doi.org/10.1109/ICINIS.2015.28Google ScholarCross Ref
- Tzu-Wei Mi, Jia-Jun Wang, and Liwei Chan. 2023. LapTouch: Using the Lap for Seated Touch Interaction with HMDs. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 7, 3, Article 114 (sep 2023), 23 pages. https://doi.org/10.1145/3610878Google ScholarDigital Library
- Florian Müller, Joshua McManus, Sebastian Günther, Martin Schmitz, Max Mühlhäuser, and Markus Funk. 2019. Mind the Tap: Assessing Foot-Taps for Interacting with Head-Mounted Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300707Google ScholarDigital Library
- Ian Oakley and Jun-Seok Park. 2007. Designing Eyes-Free Interaction. In Proceedings of the 2nd International Conference on Haptic and Audio Interaction Design (Seoul, South Korea) (HAID'07). Springer-Verlag, Berlin, Heidelberg, 121--132.Google ScholarDigital Library
- Masa Ogata, Yuta Sugiura, Yasutoshi Makino, Masahiko Inami, and Michita Imai. 2013. SenSkin: Adapting Skin as a Soft Interface. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST '13). Association for Computing Machinery, New York, NY, USA, 539--544. https://doi.org/10.1145/2501988.2502039Google ScholarDigital Library
- Masa Ogata, Ryosuke Totsuka, and Michita Imai. 2015. SkinWatch: Adapting Skin as a Gesture Surface. In SIGGRAPH Asia 2015 Emerging Technologies (Kobe, Japan) (SA '15). Association for Computing Machinery, New York, NY, USA, Article 22, 2 pages. https://doi.org/10.1145/2818466.2818496Google ScholarDigital Library
- Halley P. Profita, James Clawson, Scott Gilliland, Clint Zeagler, Thad Starner, Jim Budd, and Ellen Yi-Luen Do. 2013. Don't Mind Me Touching My Wrist: A Case Study of Interacting with on-Body Technology in Public. In Proceedings of the 2013 International Symposium on Wearable Computers (Zurich, Switzerland) (ISWC '13). Association for Computing Machinery, New York, NY, USA, 89--96. https://doi.org/10.1145/2493988.2494331Google ScholarDigital Library
- Helge Rhodin, Christian Richardt, Dan Casas, Eldar Insafutdinov, Mohammad Shafiei, Hans-Peter Seidel, Bernt Schiele, and Christian Theobalt. 2016. EgoCap: Egocentric Marker-Less Motion Capture with Two Fisheye Cameras. ACM Trans. Graph. 35, 6, Article 162 (nov 2016), 11 pages. https://doi.org/10.1145/2980179.2980235Google ScholarDigital Library
- Daniel Roetenberg, Henk Luinge, and Per Slycke. 2009. Xsens mvn: full 6dof human motion tracking using miniature inertial sensors. Xsens Motion Technologies BV. Technical Report.Google Scholar
- Marcos Serrano, Barrett M. Ens, and Pourang P. Irani. 2014. Exploring the Use of Hand-to-Face Input for Interacting with Head-Worn Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). Association for Computing Machinery, New York, NY, USA, 3181--3190. https://doi.org/10.1145/2556288.2556984Google ScholarDigital Library
- Wei Sun, Franklin Mingzhe Li, Congshu Huang, Zhenyu Lei, Benjamin Steeper, Songyun Tao, Feng Tian, and Cheng Zhang. 2021. ThumbTrak: Recognizing Micro-Finger Poses Using a Ring with Proximity Sensing. In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction (Toulouse amp; Virtual, France) (MobileHCI '21). Association for Computing Machinery, New York, NY, USA, Article 2, 9 pages. https://doi.org/10.1145/3447526.3472060Google ScholarDigital Library
- Denis Tome, Patrick Peluse, Lourdes Agapito, and Hernan Badino. 2019. xR-EgoPose: Egocentric 3D Human Pose From an HMD Camera. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV). 7727--7737. https://doi.org/10.1109/ICCV.2019.00782Google ScholarCross Ref
- Hsin-Ruey Tsai, Te-Yen Wu, Da-Yuan Huang, Min-Chieh Hsiu, Jui-Chun Hsiao, Yi-Ping Hung, Mike Y. Chen, and Bing-Yu Chen. 2017. SegTouch: Enhancing Touch Input While Providing Touch Gestures on Screens Using Thumb-To-Index-Finger Gestures. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI EA '17). Association for Computing Machinery, New York, NY, USA, 2164--2171. https://doi.org/10.1145/3027063.3053109Google ScholarDigital Library
- R. J. van Beers, Anne C. Sittig, and Jan J. Denier van der Gon. 1998. The precision of proprioceptive position sense. Experimental Brain Research 122, 4 (01 Oct 1998), 367--377. https://doi.org/10.1007/s002210050525Google ScholarCross Ref
- Velko Vechev, Alexandru Dancu, Simon T. Perrault, Quentin Roy, Morten Fjeld, and Shengdong Zhao. 2018. Body Mnemonics Portable device interaction design concept. In Proceedings of the 2018 International Conference on Advanced Visual Interfaces (Castiglione della Pescaia, Grosseto, Italy) (AVI '18). Association for Computing Machinery, New York, NY, USA, Article 28, 9 pages. https://doi.org/10.1145/3206505.3206527Google ScholarDigital Library
- Velko Vechev, Alexandru Dancu, Simon T. Perrault, Quentin Roy, Morten Fjeld, and Shengdong Zhao. 2018. Movespace: On-Body Athletic Interaction for Running and Cycling. In Proceedings of the 2018 International Conference on Advanced Visual Interfaces (Castiglione della Pescaia, Grosseto, Italy) (AVI '18). Association for Computing Machinery, New York, NY, USA, Article 28, 9 pages. https://doi.org/10.1145/3206505.3206527Google ScholarDigital Library
- Dong-Bach Vo, Eric Lecolinet, and Yves Guiard. 2014. Belly Gestures: Body Centric Gestures on the Abdomen. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (Helsinki, Finland) (NordiCHI '14). Association for Computing Machinery, New York, NY, USA, 687--696. https://doi.org/10.1145/2639189.2639210Google ScholarDigital Library
- Julie Wagner, Mathieu Nancel, Sean G. Gustafson, Stephane Huot, and Wendy E. Mackay. 2013. Body-Centric Design Space for Multi-Surface Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). Association for Computing Machinery, New York, NY, USA, 1299--1308. https://doi.org/10.1145/2470654.2466170Google ScholarDigital Library
- Chuyu Wang, Jian Liu, Yingying Chen, Lei Xie, Hong Bo Liu, and Sanclu Lu. 2018. RF-Kinect: A Wearable RFID-Based Approach Towards 3D Body Movement Tracking. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 1, Article 41 (mar 2018), 28 pages. https://doi.org/10.1145/3191773Google ScholarDigital Library
- Cheng-Yao Wang, Min-Chieh Hsiu, Po-Tsung Chiu, Chiao-Hui Chang, Liwei Chan, Bing-Yu Chen, and Mike Y. Chen. 2015. PalmGesture: Using Palms as Gesture Interfaces for Eyes-Free Input. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (Copenhagen, Denmark) (MobileHCI '15). Association for Computing Machinery, New York, NY, USA, 217--226. https://doi.org/10.1145/2785830.2785885Google ScholarDigital Library
- Yueting Weng, Chun Yu, Yingtian Shi, Yuhang Zhao, Yukang Yan, and Yuanchun Shi. 2021. FaceSight: Enabling Hand-to-Face Gesture Interaction on AR Glasses with a Downward-Facing Camera Vision. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 10, 14 pages. https://doi.org/10.1145/3411764.3445484Google ScholarDigital Library
- Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, and Mayank Goel. 2017. DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-Mounted Displays. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 113 (sep 2017), 21 pages. https://doi.org/10.1145/3130978Google ScholarDigital Library
- Erwin Wu, Ye Yuan, Hui-Shyong Yeo, Aaron Quigley, Hideki Koike, and Kris M. Kitani. 2020. Back-Hand-Pose: 3D Hand Pose Estimation for a Wrist-Worn Camera via Dorsum Deformation Network. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST '20). Association for Computing Machinery, New York, NY, USA, 1147--1160. https://doi.org/10.1145/3379337.3415897Google ScholarDigital Library
- Xuhai Xu, Haitian Shi, Xin Yi, WenJia Liu, Yukang Yan, Yuanchun Shi, Alex Mariakakis, Jennifer Mankoff, and Anind K. Dey. 2020. EarBuddy: Enabling On-Face Interaction via Wireless Earbuds. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376836Google ScholarDigital Library
- Yukang Yan, Chun Yu, Xiaojuan Ma, Shuai Huang, Hasan Iqbal, and Yuanchun Shi. 2018. Eyes-Free Target Acquisition in Interaction Space around the Body for Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3173574.3173616Google ScholarDigital Library
- Chuang-Wen You, Ya-Fang Lin, Elle Luo, Hung-Yeh Lin, and Hsin-Liu (Cindy) Kao. 2019. Understanding Social Perceptions towards Interacting with On-Skin Interfaces in Public. In Proceedings of the 23rd International Symposium on Wearable Computers (London, United Kingdom) (ISWC '19). Association for Computing Machinery, New York, NY, USA, 244--253. https://doi.org/10.1145/3341163.3347751Google ScholarDigital Library
- Clint Zeagler. 2017. Where to Wear It: Functional, Technical, and Social Considerations in on-Body Location for Wearable Technology 20 Years of Designing for Wearability. In Proceedings of the 2017 ACM International Symposium on Wearable Computers (Maui, Hawaii) (ISWC '17). Association for Computing Machinery, New York, NY, USA, 150--157. https://doi.org/10.1145/3123021.3123042Google ScholarDigital Library
- Cheng Zhang, AbdelKareem Bedri, Gabriel Reyes, Bailey Bercik, Omer T. Inan, Thad E. Starner, and Gregory D. Abowd. 2016. TapSkin: Recognizing On-Skin Input for Smartwatches. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (Niagara Falls, Ontario, Canada) (ISS '16). Association for Computing Machinery, New York, NY, USA, 13--22. https://doi.org/10.1145/2992154.2992187Google ScholarDigital Library
- Yang Zhang, Wolf Kienzle, Yanjun Ma, Shiu S. Ng, Hrvoje Benko, and Chris Harrison. 2019. ActiTouch: Robust Touch Detection for On-Skin AR/VR Interfaces. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 1151--1159. https://doi.org/10.1145/3332165.3347869Google ScholarDigital Library
- Yang Zhang, Junhan Zhou, Gierad Laput, and Chris Harrison. 2016. SkinTrack: Using the Body as an Electrical Waveguide for Continuous Finger Tracking on the Skin. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 1491--1503. https://doi.org/10.1145/2858036.2858082Google ScholarDigital Library
- Junhan Zhou, Yang Zhang, Gierad Laput, and Chris Harrison. 2016. AuraSense: Enabling Expressive Around-Smartwatch Interactions with Electric Field Sensing. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST '16). Association for Computing Machinery, New York, NY, USA, 81--86. https://doi.org/10.1145/2984511.2984568Google ScholarDigital Library
Index Terms
- BodyTouch: Investigating Eye-Free, On-Body and Near-Body Touch Interactions with HMDs
Recommendations
LapTouch: Using the Lap for Seated Touch Interaction with HMDs
Use of virtual reality while seated is common, but studies on seated interaction beyond the use of controllers or hand gestures have been sparse. This work present LapTouch, which makes use of the lap as a touch interface and includes two user studies to ...
A study on touch & hover based interaction for zooming
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing SystemsProximity is a useful medium for interaction with high interactive digital contents. It can be used in different contexts such as for navigation through depth in 3D space in zoomable interfaces. In this paper, we propose hover-based zoom interaction as ...
Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsZooming user interfaces are increasingly popular on mobile devices with touch screens. Swiping and pinching finger gestures anywhere on the screen manipulate the displayed portion of a page, and taps open objects within the page. This makes navigation ...
Comments