ABSTRACT
Many interaction techniques have been proposed to combat the finger occlusion and precision problem in multitouch platforms such as tablets and smartphones, supporting more accurate ways to select a target item with a finger. Recognising how the typical touch interactions on multitouch platforms are becoming more complex and composite, in this paper we study some combinations of basic occlusion-free/precision finger interaction techniques in the context of commonly-used composite user actions in realistic usage scenarios including copying and pasting a portion of text and drawing a curved line. We develop full-fledged tablet applications featuring the techniques to assess their usability impact on the rest of the actions. Usability testing with 25 participants qualitatively reveals how the integration of these techniques is useful for their intended part (i.e. accurate targeting) but negatively influence the remaining parts of the action. Insights from the study and areas that will benefit further investigation are discussed.
- Pär-Anders Albinsson and Shumin Zhai. 2003. High precision touch screen interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '03), 105--112. Google ScholarDigital Library
- Oscar Kin-Chung Au, Xiaojun Su and Rynson Lau. 2014. LinearDragger: a linear selector for one-finger target acquisition. In Proceeding Extended Abstracts on Human Factors in Computing Systems. (CHI EA '14), 2607--2616. Google ScholarDigital Library
- Patrick Baudisch and Gerry Chu. 2009. Back-of-device interaction allows creating very small touch devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '09), 1923--1932. Google ScholarDigital Library
- Patrick Baudisch, Edward Cutrell, Ken Hinckley and Adam Eversole. 2005. Snap-and-go: helping users align objects without the modality of traditional snapping. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '05), 301--310. Google ScholarDigital Library
- Hrvoje Benko and Daniel Wigdor. 2010. Imprecision, Inaccuracy, and Frustration: The Tale of Touch Input. In: Müller-Tomfelde C. (eds) Tabletops - Horizontal Interactive Displays. Human-Computer Interaction Series. Springer, London. 246--275.Google Scholar
- Hrvoje Benko, Andrew D. Wilson and Patrick Baudisch. 2006. Precise Selection Techniques for Multi-Touch Screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '06), 1263--1272. Google ScholarDigital Library
- Renaud Blanch, Yves Guiard and Michel Beaudouin-Lafon. 2004. Semantic pointing: improving target acquisition with control-display ratio adaptation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '04), 519--526. Google ScholarDigital Library
- William Buxton. 1990. A three-state model of graphical input. In Proceedings of the IFIP TC13 Third International Conference on Human-Computer Interaction. (INTERACT '90), 449--456. Google ScholarDigital Library
- Victor Cheung, Jens Heydekorn, Stacey Scott and Raimund Dachselt. 2012. Revisiting hovering: interaction guides for interactive surfaces. In Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces. (ITS '12), 355--358. Google ScholarDigital Library
- Katherine Fennedy, Hyowon Lee, Insuk Ko, Yi Ren Tan, Dongliang Zhang and Chunxiao Li. 2018. Augmenting User-Maintained Interaction Through Mode Locking and Reversing. 32nd British Computer Society Human Computer Interaction Conference. Google ScholarDigital Library
- Clifton Forlines, Chia Shen and Bill Buxton. 2005. Glimpse: a novel input model for multi-level devices. In CHI '05 Extended Abstracts on Human Factors in Computing Systems. (CHI EA '05), 1375--1378. http://0.1145/1056808.1056920 Google ScholarDigital Library
- Clifton Forlines, Daniel Vogel and Ravin Balakrishnan. 2006. HybridPointing: fluid switching between absolute and relative pointing with a direct input device. In Proceedings of the 19th annual ACM symposium on User interface software and technology. (UIST '06), 211--220. http://10.1145/1166253.1166286 Google ScholarDigital Library
- Clifton Forlines, Daniel Wigdor, Chia Shen, and Ravin Balakrishnan. 2007. Direct-touch vs. mouse input for tabletop displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 647--656. Google ScholarDigital Library
- Cédric Foucault, Manfred Micaux, David Bonnet and Michel Beaudouin-Lafon.. 2014. SPad: a bimanual interaction technique for productivity applications on multi-touch tablets. In CHI '14 Extended Abstracts on Human Factors in Computing Systems. (CHI EA '14), 1879--1884. Google ScholarDigital Library
- Dustin Freeman, Hrvoje Benko, Meredith Ringe Morris and Daniel Wigdor. 2009. ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. (ITS '09), 165--172. Google ScholarDigital Library
- Alix Goguey, Sylvain Malacria, Carl Gutwin. 2018. Improving Discoverability and Expert Performance in Force-Sensitive Text Selection for Touch Devices with Mode Gauges. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. (CHI '18), 477. Google ScholarDigital Library
- Alix Goguey, Mathieu Nancel, Géry Casiez, and Daniel Vogel. 2016. The Performance and Preference of Different Fingers and Chords for Pointing, Dragging, and Object Transformation. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4250--4261. Google ScholarDigital Library
- Tovi Grossman and Ravin Balakrishnan. 2005. The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). ACM, New York, NY, USA, 281--290. Google ScholarDigital Library
- Tiago Guerreiro, Hugo Nicolau, Joaquim Jorge and Daniel Gonçalves. 2010. Towards accessible touch interfaces. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility, (ASSETS '10), 19--26. Google ScholarDigital Library
- Carl Gutwin, Andy Cockburn, Joey Scarr, Sylvain Malacria and Scott C. Olson. 2014. Faster command selection on tablets with FastTap. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '14), 2617--2626. Google ScholarDigital Library
- William Hamilton, Andruid Kerne and Tom Robbins. 2012. High-performance pen + touch modality interactions: a real-time strategy game eSports context. In Proceedings of the 25th annual ACM symposium on User interface software and technology. (UIST '12), 309--318. Google ScholarDigital Library
- Jaehyun Han, Sunggeun Ahn and Geehyuk Lee. 2014. Push-push: a two-point touchscreen operation utilizing the pressed state and the hover state. In Proceedings of the adjunct publication of the 27th annual ACM symposium on User interface software and technology. (UIST'14 Adjunct), 103--104. Google ScholarDigital Library
- Mark S. Hancock and Kellogg S. Booth. 2004. Improving menu placement strategies for pen input. In Proceedings of Graphics Interface 2004. (GI '04), 221--230. Google ScholarDigital Library
- Ken Hinckley, Seongkook Heo, Michel Pahud, Christian Holz, Hrvoje Benko, Abigail Sellen, Richard Banks, Kenton O'Hara, Gavin Smyth and William Buxton. 2016. Pre-Touch Sensing for Mobile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. (CHI' 16), 2869--2881. Google ScholarDigital Library
- Ken Hinckley, Francois Guimbretiere, Patrick Baudisch, Raman Sarin, Maneesh Agrawala, and Ed Cutrell. 2006. The springboard: multiple modes in one spring-loaded control. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06), ACM, New York, NY, USA, 181--190. Google ScholarDigital Library
- Amy K. Karlson and Ben Bederson. 2007. Direct Versus Indirect Input Methods for One-Handed Touchscreen Mobile Computing. Technical report, Human-Computer Interaction lab, Computer Science Department, University of Maryland.Google Scholar
- Dominik P. Käser, Maneesh Agrawala and Mark Pauly. 2011. FingerGlass: efficient multiscale interaction on multitouch screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '11), 1601--1610. Google ScholarDigital Library
- Sunjun Kim, Jihyun Yu and Geehyuk Lee. 2012. Interaction techniques for unreachable objects on the touchscreen. In Proceedings of the 24th Australian Computer-Human Interaction Conference. (OzCHI '12), 295--298. Google ScholarDigital Library
- Jari Kleimola, Markku Laine, Evgenia Litvinova and Petri Vuorimaa. 2013. TouchModifier: enriched multitouch gestures for tablet browsers. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. (ITS '13), 445--448. Google ScholarDigital Library
- Yu Ren Lai and T. K. Philip Hwang. 2015. Virtual Touchpad for Cursor Control of Touchscreen Thumb Operation in the Mobile Context. In: Marcus A. (eds) Design, User Experience, and Usability: Users and Interactions. Lecture Notes in Computer Science, vol. 9187. Springer, Cham. Google ScholarDigital Library
- Jianwei Lai and Dongsong Zhang. 2014. ExtendedThumb: a motion-based virtual thumb for improving one-handed target acquisition on touchscreen mobile devices. In CHI '14 Extended Abstracts on Human Factors in Computing Systems. (CHI EA '14), 1825--1830. Google ScholarDigital Library
- David Lee, KyoungHee Son, Joon Hyub Lee and Seok-Hyung Bae. 2012. PhantomPen: virtualization of pen head for digital drawing free from pen occlusion & visual parallax. In Proceedings of the 25th annual ACM symposium on User interface software and technology. (UIST '12), 331--340. http://10.1145/2380116.2380159 Google ScholarDigital Library
- Justin Matejka, Tovi Grossman, Jessica Lo and George Fitzmaurice. 2009. The design and evaluation of multifinger mouse emulation techniques. In Proceeding of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '09), 1073--1082. Google ScholarDigital Library
- Fabrice Matulic and Moira C. Norrie. 2013. Pen and Touch Gestural Environment for Document Editing on Interactive Tabletops. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces (ITS '13), 41--50. Google ScholarDigital Library
- David C. McCallum and Pourang Irani. 2009. ARC-Pad: Absolute+Relative Cursor Positioning for Large Displays with a Mobile Touchscreen. In Proceedings of the 22nd annual ACM symposium on User interface software and technology. (UIST '09), 153--156. http://10.1145/1622176.1622205 Google ScholarDigital Library
- Mathieu Nancel and Edward Lank. 2017. Modeling User Performance on Curved Constrained Paths. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 244--254. Google ScholarDigital Library
- Mathieu Nancel, Daniel Vogel and Edward Lank. 2015. Clutching Is Not (Necessarily) the Enemy. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. (CHI '15), 4199--4202. Google ScholarDigital Library
- Alex Olwal, Steven Feiner, and Susanna Heyman. 2008. Rubbing and tapping for precise and rapid selection on touch-screen displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 295--304. Google ScholarDigital Library
- Anna Ostberg and Nada Matic. 2015. Hover Cursor: Improving Touchscreen Acquisition Of Small Targets With Hover-enabled Pre-selection. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. (CHI EA '15), 1723--1728. http://10.1145/2702613.2732903 Google ScholarDigital Library
- Ken Pfeuffer, Ken Hinckley, Michel Pahud and Bill Buxton. 2017. Thumb+ Pen Interaction on Tablets. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. (CHI '17), 3254--3266. Google ScholarDigital Library
- Richard L. Potter, Linda J. Weldon and Ben Shneiderman. 1988. Improving The Accuracy of Touch Screens: An Experimental Evaluation of Three Strategies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '88) 27--32. Google ScholarDigital Library
- Anne Roudaut, Stéphane Huot and Eric Lecolinet. 2008. TapTap and MagStick: Improving One-Handed Target Acquisition on small touch-screens. In Proceedings of the working conference on Advanced visual interfaces. (AVI '08), 146--153. Google ScholarDigital Library
- Andrew Sears and Ben Shneiderman.1991. High Precision Touchscreens: Design Strategies and Comparisons with a Mouse. International Journal of Man-Machine 34, 4: 593--613. Google ScholarDigital Library
- Hemant Bhaskar Surale, Fabrice Matulic, and Daniel Vogel. 2017. Experimental Analysis of Mode Switching Techniques in Touch-based User Interfaces. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3267--3280. Google ScholarDigital Library
- Md. Sami Uddin, Carl Gutwin and Benjamin Lafreniere. 2016. HandMark Menus: Rapid Command Selection and Large Command Sets on Multi- Touch Displays. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 5836--5848. Google ScholarDigital Library
- Daniel Vogel and Ravin alakrishnan. 2010. Direct Pen Interaction With a Conventional Graphical User Interface. In Human-Computer Interaction 25, 4: 324--388.Google ScholarCross Ref
- Daniel Vogel and Ravin Balakrishnan. 2010. Occlusion-aware interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '10), 263--272. Google ScholarDigital Library
- Daniel Vogel and Patrick Baudisch. 2007. Shift: A Technique for Operating Pen-Based Interfaces Using Touch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '07), 657--666. http://0.1145/1240624.1240727 Google ScholarDigital Library
- Chat Wacharamanotham, Jan Hurtmanns, Alexander Mertens, Martin Kronenbuerger, Christopher Schlick and Jan Borchers. 2011. Evaluating swabbing: a touchscreen input method for elderly users with tremor. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '11), 623--626. http://10.1145/1978942.1979031 Google ScholarDigital Library
- Feng Wang, Xiang Cao, Xiangshi Ren and Pourang Irani. 2009. Detecting and Leveraging Finger Orientation for Interaction with Direct-Touch Surfaces. In Proceedings of the 22nd annual ACM symposium on User interface software and technology. (UIST '09), 23--32. Google ScholarDigital Library
- Daniel Wigdor, Clifton Forlines, Patrick Baudisch, John Barnwell and Chia Shen. 2007. Lucid Touch: a see-through mobile device. In Proceedings of the 20th annual ACM symposium on User interface software and technology. (UIST '07), 269--278. Google ScholarDigital Library
- Katrin Wolf and Niels Henze. 2014. Comparing pointing techniques for grasping hands on tablets. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services. (MobileHCI '14), 53--62. Google ScholarDigital Library
- Koji Yatani, Kurt Partridge, Marshall Bern, and Mark W. Newman. 2008. Escape: a target selection technique using visually-cued gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 285--294. Google ScholarDigital Library
- Stanislaw Zabramski, Suman Shrestha, and Wolfgang Stuerzlinger. 2013. Easy vs. Tricky: The Shape Effect in Tracing, Selecting, and Steering With Mouse, Stylus, and Touch. In Proceedings of International Conference on Making Sense of Converging Media (AcademicMindTrek '13), Artur Lugmayr, Heljä Franssila, Janne Paavilainen, and Hannu Kärkkäinen (Eds.). ACM, New York, NY, USA, Pages 99, 5 pages. Google ScholarDigital Library
Index Terms
- Usability Impact of Occlusion-free Techniques on Commonly-used Multitouch Actions
Recommendations
A Multitouch Drawing Application with Occlusion-Free Interaction Strategies
Human-Computer Interaction – INTERACT 2019AbstractIncreasing number of desktop applications are becoming available on smartphones and tablets today with multitouch capabilities, allowing the users’ fingers to perform sophisticated or fine-grained interactivities. However, finger occlusion and ...
Extended multitouch: recovering touch posture and differentiating users using a depth camera
UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technologyMultitouch surfaces are becoming prevalent, but most existing technologies are only capable of detecting the user's actual points of contact on the surface and not the identity, posture, and handedness of the user. In this paper, we define the concept ...
Tangible actions
ITS '11: Proceedings of the ACM International Conference on Interactive Tabletops and SurfacesWe present Tangible Actions, an ad-hoc, just-in-time, visual programming by example language designed for large multitouch interfaces. With the design of Tangible Actions, we contribute a continually-created system of programming tokens that occupy the ...
Comments