Christian Corsten
Marcel Lahaye
Jan Borchers
Simon Voelker
ABSTRACT
Smartphones are used predominantly one-handed, using the thumb for input. Many smartphones, however, have grown beyond 5". Users cannot tap everywhere on these screens without destabilizing their grip. ForceRay (FR) lets users aim at an out-of-reach target by applying a force touch at a comfortable thumb location, casting a virtual ray towards the target. Varying pressure moves a cursor along the ray. When reaching the target, quickly lifting the thumb selects it. In a first study, FR was 195 ms slower and had a 3% higher selection error than the best existing technique, BezelCursor (BC), but FR caused significantly less device movement than all other techniques, letting users maintain a steady grip and removing their concerns about device drops. A second study showed that an hour of training speeds up both BC and FR, and that both are equally fast for targets at the screen border.
Supplemental Material
Available for Download
zip
paper212pvc.zip (1.1 KB)
Preview video captions
zip
pn4509vc.zip (2.8 KB)
Video figure captions
- Axel Antoine, Sylvain Malacria, and Géry Casiez. 2017. ForceEdge: Controlling Autoscroll on Both Desktop and Mobile Computers Using the Force. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3281--3292. Google Scholar
Digital Library
- Joanna Bergstrom-Lehtovirta and Antti Oulasvirta. 2014. Modeling the Functional Area of the Thumb on Mobile Touchscreen Surfaces. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1991--2000. Google ScholarDigital Library
- Sebastian Boring, David Ledo, Xiang 'Anthony' Chen, Nicolai Marquardt, Anthony Tang, and Saul Greenberg. 2012. The Fat Thumb: Using the Thumb's Contact Size for Single-Handed Mobile Interaction. In Proceedings of the 14th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '12). ACM, New York, NY, USA, 39--48. Google ScholarDigital Library
- Stephen A. Brewster and Michael Hughes. 2009. Pressure-Based Text Entry for Mobile Devices. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '09). ACM, New York, NY, USA, Article 9, 4 pages. Google ScholarDigital Library
- Géry Casiez, Nicolas Roussel, and Daniel Vogel. 2012. 1 Filter: A Simple Speed-Based Low-Pass Filter for Noisy Input in Interactive Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2527--2530. Google ScholarDigital Library
- Jared Cechanowicz, Pourang Irani, and Sriram Subramanian. 2007. Augmenting the Mouse with Pressure Sensitive Input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1385--1394. Google ScholarDigital Library
- Youli Chang, Sehi L'Yi, Kyle Koh, and Jinwook Seo. 2015. Understanding Users' Touch Behavior on Large Mobile Touch-Screens and Assisted Targeting by Tilting Gesture. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1499--1508. Google ScholarDigital Library
- Olivier Chapuis, Jean-Baptiste Labrune, and Emmanuel Pietriga. 2009. DynaSpot: Speed-dependent Area Cursor. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1391--1400. Google ScholarDigital Library
- Christian Corsten, Bjoern Daehlmann, Simon Voelker, and Jan Borchers. 2017. BackXPress: Using Back-of-Device Finger Pressure to Augment Touchscreen Input on Smartphones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4654--4666. Google ScholarDigital Library
- Christian Corsten, Simon Voelker, and Jan Borchers. 2017. Release, Don't Wait! Reliable Force Input Confrmation with Quick Release. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). ACM, New York, NY, USA, 246--251. Google ScholarDigital Library
- Christian Corsten, Simon Voelker, Andreas Link, and Jan Borchers. 2018. Use the ForcePicker, Luke: Space-Efcient Value Input on ForceSensitive Mobile Touchscreens. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 12. Google ScholarDigital Library
- Philip L. Davidson and Jeferson Y. Han. 2008. Extending 2D Object Arrangement with Pressure-Sensitive Layering Cues. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). ACM, New York, NY, USA, 87--90. Google ScholarDigital Library
- Rachel Eardley, Anne Roudaut, Steve Gill, and Stephen J. Thompson. 2017. Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4680--4691. Google ScholarDigital Library
- Rachel Eardley, Anne Roudaut, Steve Gill, and Stephen J. Thompson. 2018. Designing for Multiple Hand Grips and Body Postures Within the UX of a Moving Smartphone. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 611--621. Google ScholarDigital Library
- Rachel Eardley, Anne Roudaut, Steve Gill, and Stephen J. Thompson. 2018. Investigating How Smartphone Movement is Afected by Body Posture. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 202, 8 pages. Google ScholarDigital Library
- Jon Fingas. 2012. Shocker: Smartphone Users Like Bigger Screebs, Market Share May Respond Accordingly. http://engadget.com/2012/09/ 03/shocker-smartphone-users-like-bigger-screens/. {Online; accessed Sept 20, 2018}.Google Scholar
- Mayank Goel, Jacob Wobbrock, and Shwetak Patel. 2012. GripSense: Using Built-in Sensors to Detect Hand Posture and Pressure on Commodity Mobile Phones. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 545--554. Google ScholarDigital Library
- Tovi Grossman and Ravin Balakrishnan. 2005. The Bubble Cursor: Enhancing Target Acquisition by Dynamic Resizing of the Cursor's Activation Area. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). ACM, New York, NY, USA, 281--290. Google ScholarDigital Library
- Khalad Hasan, Junhyeok Kim, David Ahlström, and Pourang Irani. 2016. Thumbs-Up: 3D Spatial Thumb-Reachable Space for One-Handed Thumb Interaction on Smartphones. In Proceedings of the 2016 Symposium on Spatial User Interaction (SUI '16). ACM, New York, NY, USA, 103--106. Google ScholarDigital Library
- Nambu Hirotaka. 2003. Reassessing Current Cell Phone Designs: Using Thumb Input Efectively. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 938--939. Google ScholarDigital Library
- Apple Inc. 2018. iOS 11 UIKit API Reference. https://developer.apple. com/reference/uikit/uitouch. {Online; accessed Sept 20, 2018}.Google Scholar
- Apple Inc. 2018. Taking Advantage of 3D Touch. https://developer. apple.com/ios/3d-touch/. {Online; accessed Sept 20, 2018}.Google Scholar
- Amy K Karlson and Benjamin B Bederson. 2007. ThumbSpace: Generalized One-Handed Input for Touchscreen-Based Mobile Devices. In Human-Computer Interaction -- INTERACT 2007. Springer, Berlin, Heidelberg, Berlin, Heidelberg, 324--338. Google ScholarDigital Library
- Amy K. Karlson and Benjamin B. Bederson. 2008. One-Handed Touchscreen Input for Legacy Applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 1399--1408. Google ScholarDigital Library
- Amy K Karlson, Benjamin B Bederson, and Jose L Contreras-Vidal. 2008. Understanding One-Handed Use of Mobile Devices. In Handbook of Research on User Interface Design and Evaluation for Mobile Technology. IGI Global, 86--101.Google Scholar
- Sunjun Kim, Jihyun Yu, and Geehyuk Lee. 2012. Interaction Techniques for Unreachable Objects on the Touchscreen. In Proceedings of the 24th Australian Computer-Human Interaction Conference (OzCHI '12). ACM, New York, NY, USA, 295--298. Google ScholarDigital Library
- J. Lai and D. Zhang. 2015. ExtendedThumb: A Target Acquisition Approach for One-Handed Interaction With Touch-Screen Mobile Phones. IEEE Transactions on Human-Machine Systems 45, 3 (June 2015), 362--370.Google ScholarCross Ref
- Huy Viet Le, Patrick Bader, Thomas Kosch, and Niels Henze. 2016. Investigating Screen Shifting Techniques to Improve One-Handed Smartphone Usage. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). ACM, New York, NY, USA, Article 27, 10 pages. Google ScholarDigital Library
- Wing Ho Andy Li, Hongbo Fu, and Kening Zhu. 1. BezelCursor: BezelInitiated Cursor for One-Handed Target Acquisition on Mobile Touch Screens. International Journal of Mobile Human Computer Interaction (IJMHCI) 8, 1 (Jan. 1), 1--22. Google ScholarDigital Library
- Markus Löchtefeld, Christoph Hirtz, and Sven Gehring. 2013. Evaluation of Hybrid Front- and Back-of-Device Interaction on Mobile Devices. In Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia (MUM '13). ACM, New York, NY, USA, Article 17, 4 pages. Google ScholarDigital Library
- Markus Löchtefeld, Phillip Schardt, Antonio Krüger, and Sebastian Boring. 2015. Detecting Users Handedness for Ergonomic Adaptation of Mobile User Interfaces. In Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia (MUM '15). ACM, New York, NY, USA, 245--249. Google ScholarDigital Library
- Ross McLachlan, Daniel Boland, and Stephen Brewster. 2014. Transient and Transitional States: Pressure As an Auxiliary Input Modality for Bimanual Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 401--410. Google ScholarDigital Library
- Sachi Mizobuchi, Shinya Terasaki, Turo Keski-Jaskari, Jari Nousiainen, Matti Ryynanen, and Miika Silfverberg. 2005. Making an Impression: Force-Controlled Pen Input for Handheld Devices. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, New York, NY, USA, 1661--1664. Google ScholarDigital Library
- R. Kevin Nelson. 2015. Exploring Apple's 3D Touch. https://medium. com/. {Online; accessed Sept 20, 2018}.Google Scholar
- Siyuan Qiu, Lu Wang, and Laikuan Wong. 2016. Pressure-Based Touch Positioning Techniques for 3D Objects. In Proceedings of the 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D '16). ACM, New York, NY, USA, 199--200. Google ScholarDigital Library
- Gonzalo Ramos, Matthew Boulos, and Ravin Balakrishnan. 2004. Pressure Widgets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 487--494. Google ScholarDigital Library
- Jef Raskin. 2000. The Humane Interface: New Directions for Designing Interactive Systems. ACM Press/Addison-Wesley Publishing Co., New York, NY, USA. Google ScholarDigital Library
- Simon Rogers, John Williamson, Craig Stewart, and Roderick MurraySmith. 2011. AnglePose: Robust, Precise Capacitive Touch Tracking via 3D Orientation Estimation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2575--2584. Google ScholarDigital Library
- Anne Roudaut, Stéphane Huot, and Eric Lecolinet. 2008. TapTap and MagStick: Improving One-Handed Target Acquisition on Small Touch-Screens. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI '08). ACM, New York, NY, USA, 146--153. Google ScholarDigital Library
- Katie A. Siek, Yvonne Rogers, and Kay H. Connelly. 2005. Fat Finger Worries: How Older and Younger Users Physically Interact with PDAs. In Proceedings of the 2005 IFIP TC13 International Conference on Human-Computer Interaction (INTERACT'05). Springer-Verlag, Berlin, Heidelberg, 267--280. Google ScholarDigital Library
- Daniel Spelmezan, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2013. Controlling Widgets with One Power-Up Button. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 71--74. Google ScholarDigital Library
- Daniel Spelmezan, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2013. Side Pressure for Bidirectional Navigation on Small Devices. In Proceedings of the 15th International Conference on Humancomputer Interaction with Mobile Devices and Services (MobileHCI '13). ACM, New York, NY, USA, 11--20. Google ScholarDigital Library
- Craig Stewart, Michael Rohs, Sven Kratz, and Georg Essl. 2010. Characteristics of Pressure-Based Input for Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 801--810. Google ScholarDigital Library
- Qingkun Su, Oscar Kin-Chung Au, Pengfei Xu, Hongbo Fu, and ChiewLan Tai. 2016. 2D-Dragger: Unifed Touch-Based Target Acquisition with Constant Efective Width. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16). ACM, New York, NY, USA, 170--179. Google ScholarDigital Library
- Hsin-Ruey Tsai, Da-Yuan Huang, Chen-Hsin Hsieh, Lee-Ting Huang, and Yi-Ping Hung. 2016. MovingScreen: Selecting Hard-to-Reach Targets with Automatic Comfort Zone Calibration on Mobile Devices. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM, New York, NY, USA, 651--658. Google ScholarDigital Library
- Graham Wilson, Stephen Brewster, and Martin Halvey. 2013. Towards Utilising One-Handed Multi-Digit Pressure Input. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 1317--1322. Google ScholarDigital Library
- Graham Wilson, Stephen A. Brewster, Martin Halvey, Andrew Crossan, and Craig Stewart. 2011. The Efects of Walking, Feedback and Control Method on Pressure-Based Interaction. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '11). ACM, New York, NY, USA, 147-- 156. Google ScholarDigital Library
- Graham Wilson, Craig Stewart, and Stephen A. Brewster. 2010. Pressure-Based Menu Selection for Mobile Devices. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '10). ACM, New York, NY, USA, 181--190. Google ScholarDigital Library
- Xing-Dong Yang, Edward Mak, Pourang Irani, and Walter F. Bischof. 2009. Dual-Surface Input: Augmenting One-Handed Interaction with Coordinated Front and Behind-the-Screen Input. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '09). ACM, New York, NY, USA, Article 5, 10 pages. Google ScholarDigital Library
- Hyunjin Yoo, Jungwon Yoon, and Hyunsoo Ji. 2015. Index Finger Zone: Study on Touchable Area Expandability Using Thumb and Index Finger. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '15). ACM, New York, NY, USA, 803--810. Google ScholarDigital Library
- Neng-Hao Yu, Da-Yuan Huang, Jia-Jyun Hsu, and Yi-Ping Hung. 2013. Rapid Selection of Hard-to-Access Targets by Thumb on Mobile TouchScreens. In Proceedings of the 15th International Conference on Humancomputer Interaction with Mobile Devices and Services (MobileHCI '13). ACM, New York, NY, USA, 400--403. Google ScholarDigital Library
- Mingyuan Zhong, Chun Yu, Qian Wang, Xuhai Xu, and Yuanchun Shi. 2018. ForceBoard: Subtle Text Entry Leveraging Pressure. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 528, 10 pages. Google ScholarDigital Library
Index Terms
- ForceRay: Extending Thumb Reach via Force Input Stabilizes Device Grip for Mobile Touch Input
Recommendations
Expressive touch: studying tapping force on tabletops
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThis paper investigates users' ability to perform force-sensitive tapping and explores its potential as an input modality in touch-based systems. We study force-sensitive tapping using Expressive Touch, a tabletop interface that infers tapping force ...
DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsThumb-to-fingers interfaces augment touch widgets on fingers, which are manipulated by the thumb. Such interfaces are ideal for one-handed eyes-free input since touch widgets on the fingers enable easy access by the stylus thumb. This study presents ...
Force-enabled TouchPad in Cars: Improving Target Selection using Absolute Input
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsCurrent automotive interfaces rely heavily on touchscreen interfaces which leverage simple and intuitive direct touch interaction. Since input and output are co-located, displays have to be positioned within hand's reach. When the display is outside the ...
Comments