Abstract
We present PocketThumb, a wearable touch interface for smart-eyewear that is embedded into the fabrics of the front trouser pocket. The interface is reachable from outside and inside of the pocket to allow for a combined dual-sided touch input. The user can control an absolute cursor with their thumb sliding along the fabric from the inside, while at the same time tapping or swiping with fingers from the outside to perform joint gestures. This allows for resting the hand in a comfortable and quickly accessible position, while performing interaction with a high expressiveness that is feasible in mobile scenarios. In a cursor-based target selection study, we found that our introduced dual-sided touch interaction is significantly faster in comparison to common single-sided absolute as well as relative touch interaction (~19%, resp. ~23% faster). The effect is largest in the mobile conditions standing and walking (up to ~31% faster).
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, PocketThumb: a Wearable Dual-Sided Touch Interface for Cursor-based Control of Smart-Eyewear
- Daniel Ashbrook, Patrick Baudisch, and Sean White. 2011. Nenya: subtle and eyes-free mobile input with a magnetically-tracked finger ring. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2043--2046. Google ScholarDigital Library
- Daniel Lee Ashbrook. 2010. Enabling mobile microinteractions. (2010).Google Scholar
- Patrick Baudisch and Gerry Chu. 2009. Back-of-device interaction allows creating very small touch devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1923--1932. Google ScholarDigital Library
- Matthew Chalmers, Ian MacColl, and Marek Bell. 2003. Seamful design: Showing the seams in wearable computing. In Eurowearable, 2003. IEE. IET, 11--16.Google ScholarCross Ref
- Liwei Chan, Rong-Hao Liang, Ming-Chang Tsai, Kai-Yin Cheng, Chao-Huai Su, Mike Y Chen, Wen-Huang Cheng, and Bing-Yu Chen. 2013. FingerPad: private and subtle interaction using fingertips. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, 255--260. Google ScholarDigital Library
- Christian Corsten, Christian Cherek, Thorsten Karrer, and Jan Borchers. 2015. HaptiCase: Back-of-Device Tactile Landmarks for Eyes-Free Absolute Indirect Touch. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2171--2180. Google ScholarDigital Library
- David Dobbelstein, Philipp Hock, and Enrico Rukzio. 2015. Belt: An unobtrusive touch input device for head-worn displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2135--2138. Google ScholarDigital Library
- Florian Heller, Stefan Ivanov, Chat Wacharamanotham, and Jan Borchers. 2014. FabriTouch: exploring flexible touch input on textiles. In Proceedings of the 2014 ACM International Symposium on Wearable Computers. ACM, 59--62. Google ScholarDigital Library
- Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed endurance: a metric to quantify arm fatigue of mid-air interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1063--1072. Google ScholarDigital Library
- Paul Holleis, Albrecht Schmidt, Susanna Paasovaara, Arto Puikkonen, and Jonna Häkkilä. 2008. Evaluating capacitive touch input on clothes. In Proceedings of the 10th international conference on Human computer interaction with mobile devices and services. ACM, 81--90. Google ScholarDigital Library
- Christian Holz, Tovi Grossman, George Fitzmaurice, and Anne Agur. 2012. Implanted user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 503--512. Google ScholarDigital Library
- Scott E Hudson, Chris Harrison, Beverly L Harrison, and Anthony LaMarca. 2010. Whack gestures: inexact and inattentive interaction with mobile devices. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction. ACM, 109--112. Google ScholarDigital Library
- W ISO. 1998. 9241--11. Ergonomic requirements for office work with visual display terminals (VDTs). The international organization for standardization 45 (1998).Google Scholar
- Hsin-Liu Cindy Kao, Artem Dementyev, Joseph A Paradiso, and Chris Schmandt. 2015. NailO: fingernails as an input surface. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 3015--3018. Google ScholarDigital Library
- Thorsten Karrer, Moritz Wittenhagen, Leonhard Lichtschlag, Florian Heller, and Jan Borchers. 2011. Pinstripe: eyes-free continuous input on interactive clothing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1313--1322. Google ScholarDigital Library
- David Kim, Otmar Hilliges, Shahram Izadi, Alex D Butler, Jiawen Chen, Iason Oikonomidis, and Patrick Olivier. 2012. Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor. In Proceedings of the 25th annual ACM symposium on User interface software and technology. ACM, 167--176. Google ScholarDigital Library
- Christian Loclair, Sean Gustafson, and Patrick Baudisch. 2010. PinchWatch: a wearable device for one-handed microinteractions. In Proc. MobileHCI, Vol. 10.Google Scholar
- Kent Lyons. 2003. Everyday wearable computer use: A case study of an expert user. In International Conference on Mobile Human-Computer Interaction. Springer, 61--75.Google ScholarCross Ref
- Kent Lyons, Thad Starner, Daniel Plaisted, James Fusia, Amanda Lyons, Aaron Drew, and EW Looney. 2004. Twiddler typing: one-handed chording text entry for mobile phones. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 671--678. Google ScholarDigital Library
- L Maisonobe. 2007. Finding the circle that best fits a set of points. October 25th (2007).Google Scholar
- Thomas L Martin. 2002. Time and time again: Parallels in the development of the watch and the wearable computer. In Wearable Computers, 2002.(ISWC 2002). Proceedings. Sixth International Symposium on. IEEE, 5--11. Google ScholarDigital Library
- Alex Mason, Subhas Chandra Mukhopadhyay, Krishanthi Padmarani Jayasundera, and Nabarun Bhattacharyya. 2015. Sensing technology: Current status and future trends III. Springer. Google ScholarDigital Library
- John R Napier. 1956. The prehensile movements of the human hand. Bone 8 Joint Journal 38, 4 (1956), 902--913.Google Scholar
- Maggie Orth, Rehmi Post, and Emily Cooper. 1998. Fabric computing interfaces. In CHI 98 Cconference Summary on Human Factors in Computing Systems. ACM, 331--332. Google ScholarDigital Library
- Patrick Parzer, Kathrin Probst, Teo Babic, Christian Rendl, Anita Vogl, Alex Olwal, and Michael Haller. 2016. FlexTiles: A Flexible, Stretchable, Formable, Pressure-Sensitive, Tactile Input Sensor. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 3754--3757. Google ScholarDigital Library
- Ivan Poupyrev, Nan-Wei Gong, Shiho Fukuhara, M Emre Karagozler, Carsten Schwesig, and Karen Robinson. 2016. Project Jacquard: Manufacturing Digital Textiles at Scale. In Proceedings of the 34th Annual ACM Conference on Human Factors in Computing Systems. Google ScholarDigital Library
- Halley P Profita, James Clawson, Scott Gilliland, Clint Zeagler, Thad Starner, Jim Budd, and Ellen Yi-Luen Do. 2013. Don’t mind me touching my wrist: a case study of interacting with on-body technology in public. In Proceedings of the 2013 International Symposium on Wearable Computers. ACM, 89--96. Google ScholarDigital Library
- Jun Rekimoto. 2001. Gesturewrist and gesturepad: Unobtrusive wearable interaction devices. In Wearable Computers, 2001. Proceedings. Fifth International Symposium on. IEEE, 21--27. Google ScholarDigital Library
- Sami Ronkainen, Jonna Häkkilä, Saana Kaleva, Ashley Colley, and Jukka Linjama. 2007. Tap input as an embedded interaction method for mobile devices. In Proceedings of the 1st international conference on Tangible and embedded interaction. ACM, 263--270. Google ScholarDigital Library
- T Scott Saponas, Chris Harrison, and Hrvoje Benko. 2011. PocketTouch: through-fabric capacitive touch input. In Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, 303--308. Google ScholarDigital Library
- T Scott Saponas, Desney S Tan, Dan Morris, and Ravin Balakrishnan. 2008. Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 515--524. Google ScholarDigital Library
- Thad E Starner. 2002. Attention, memory, and wearable interfaces. IEEE pervasive computing 1, 4 (2002), 88--91. Google ScholarDigital Library
- Masanori Sugimoto and Keiichi Hiroki. 2006. HybridTouch: an intuitive manipulation technique for PDAs using their front and rear surfaces. In Proceedings of the 8th conference on Human-computer interaction with mobile devices and services. ACM, 137--140. Google ScholarDigital Library
- B Thomas, Karen Grimmer, J Zucco, and Steve Milanese. 2002. Where does the mouse go? An investigation into the placement of a body-attached touchpad mouse for wearable computers. Personal and Ubiquitous computing 6, 2 (2002), 97--112. Google ScholarDigital Library
- Katia Canepa Vega and Hugo Fuks. 2016. Beauty Technology: Designing Seamless Interfaces for Wearable Computing. Springer. Google ScholarDigital Library
- Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. Iskin: flexible, stretchable and visually customizable on-body touch sensors for mobile computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2991--3000. Google ScholarDigital Library
- Daniel Wigdor, Clifton Forlines, Patrick Baudisch, John Barnwell, and Chia Shen. 2007. Lucid touch: a see-through mobile device. In Proceedings of the 20th annual ACM symposium on User interface software and technology. ACM, 269--278. Google ScholarDigital Library
- Katrin Wolf, Christian Müller-Tomfelde, Kelvin Cheng, and Ina Wechsung. 2012. PinchPad: performance of touch-based gestures while grasping devices. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction. ACM, 103--110. Google ScholarDigital Library
- Yang Zhang, Junhan Zhou, Gierad Laput, and Chris Harrison. 2016. SkinTrack: Using the Body as an Electrical Waveguide for Continuous Finger Tracking on the Skin. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1491--1503. Google ScholarDigital Library
Index Terms
- PocketThumb: a Wearable Dual-Sided Touch Interface for Cursor-based Control of Smart-Eyewear
Recommendations
Belt: An Unobtrusive Touch Input Device for Head-worn Displays
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing SystemsBelt is a novel unobtrusive input device for wearable displays that incorporates a touch surface encircling the user's hip. The wide input space is leveraged for a horizontal spatial mapping of quickly accessible information and applications. We discuss ...
Demonstration of PocketThumb: a wearable dual-sided touch interface for cursor-based control of smart-eyewear
UbiComp '17: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable ComputersWe demonstrate PocketThumb, a wearable touch interface for smart-eyewear that is embedded into the fabrics of the front trouser pocket. The interface is reachable from outside and inside of the pocket to allow for a combined dual-sided touch input. The ...
FingerText: Exploring and Optimizing Performance for Wearable, Mobile and One-Handed Typing
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsTyping on wearables while situationally impaired, such as while walking, is challenging. However, while HCI research on wearable typing is diverse, existing work focuses on stationary scenarios and fine-grained input that will likely perform poorly when ...
Comments