skip to main content
10.1145/3328243.3328256acmotherconferencesArticle/Chapter ViewAbstractPublication PageschiuxidConference Proceedingsconference-collections
research-article

Usability Impact of Occlusion-free Techniques on Commonly-used Multitouch Actions

Authors Info & Claims
Published:01 April 2019Publication History

ABSTRACT

Many interaction techniques have been proposed to combat the finger occlusion and precision problem in multitouch platforms such as tablets and smartphones, supporting more accurate ways to select a target item with a finger. Recognising how the typical touch interactions on multitouch platforms are becoming more complex and composite, in this paper we study some combinations of basic occlusion-free/precision finger interaction techniques in the context of commonly-used composite user actions in realistic usage scenarios including copying and pasting a portion of text and drawing a curved line. We develop full-fledged tablet applications featuring the techniques to assess their usability impact on the rest of the actions. Usability testing with 25 participants qualitatively reveals how the integration of these techniques is useful for their intended part (i.e. accurate targeting) but negatively influence the remaining parts of the action. Insights from the study and areas that will benefit further investigation are discussed.

References

  1. Pär-Anders Albinsson and Shumin Zhai. 2003. High precision touch screen interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '03), 105--112. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Oscar Kin-Chung Au, Xiaojun Su and Rynson Lau. 2014. LinearDragger: a linear selector for one-finger target acquisition. In Proceeding Extended Abstracts on Human Factors in Computing Systems. (CHI EA '14), 2607--2616. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Patrick Baudisch and Gerry Chu. 2009. Back-of-device interaction allows creating very small touch devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '09), 1923--1932. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Patrick Baudisch, Edward Cutrell, Ken Hinckley and Adam Eversole. 2005. Snap-and-go: helping users align objects without the modality of traditional snapping. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '05), 301--310. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Hrvoje Benko and Daniel Wigdor. 2010. Imprecision, Inaccuracy, and Frustration: The Tale of Touch Input. In: Müller-Tomfelde C. (eds) Tabletops - Horizontal Interactive Displays. Human-Computer Interaction Series. Springer, London. 246--275.Google ScholarGoogle Scholar
  6. Hrvoje Benko, Andrew D. Wilson and Patrick Baudisch. 2006. Precise Selection Techniques for Multi-Touch Screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '06), 1263--1272. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Renaud Blanch, Yves Guiard and Michel Beaudouin-Lafon. 2004. Semantic pointing: improving target acquisition with control-display ratio adaptation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '04), 519--526. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. William Buxton. 1990. A three-state model of graphical input. In Proceedings of the IFIP TC13 Third International Conference on Human-Computer Interaction. (INTERACT '90), 449--456. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Victor Cheung, Jens Heydekorn, Stacey Scott and Raimund Dachselt. 2012. Revisiting hovering: interaction guides for interactive surfaces. In Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces. (ITS '12), 355--358. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Katherine Fennedy, Hyowon Lee, Insuk Ko, Yi Ren Tan, Dongliang Zhang and Chunxiao Li. 2018. Augmenting User-Maintained Interaction Through Mode Locking and Reversing. 32nd British Computer Society Human Computer Interaction Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Clifton Forlines, Chia Shen and Bill Buxton. 2005. Glimpse: a novel input model for multi-level devices. In CHI '05 Extended Abstracts on Human Factors in Computing Systems. (CHI EA '05), 1375--1378. http://0.1145/1056808.1056920 Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Clifton Forlines, Daniel Vogel and Ravin Balakrishnan. 2006. HybridPointing: fluid switching between absolute and relative pointing with a direct input device. In Proceedings of the 19th annual ACM symposium on User interface software and technology. (UIST '06), 211--220. http://10.1145/1166253.1166286 Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Clifton Forlines, Daniel Wigdor, Chia Shen, and Ravin Balakrishnan. 2007. Direct-touch vs. mouse input for tabletop displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 647--656. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Cédric Foucault, Manfred Micaux, David Bonnet and Michel Beaudouin-Lafon.. 2014. SPad: a bimanual interaction technique for productivity applications on multi-touch tablets. In CHI '14 Extended Abstracts on Human Factors in Computing Systems. (CHI EA '14), 1879--1884. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Dustin Freeman, Hrvoje Benko, Meredith Ringe Morris and Daniel Wigdor. 2009. ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. (ITS '09), 165--172. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Alix Goguey, Sylvain Malacria, Carl Gutwin. 2018. Improving Discoverability and Expert Performance in Force-Sensitive Text Selection for Touch Devices with Mode Gauges. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. (CHI '18), 477. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Alix Goguey, Mathieu Nancel, Géry Casiez, and Daniel Vogel. 2016. The Performance and Preference of Different Fingers and Chords for Pointing, Dragging, and Object Transformation. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4250--4261. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Tovi Grossman and Ravin Balakrishnan. 2005. The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). ACM, New York, NY, USA, 281--290. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Tiago Guerreiro, Hugo Nicolau, Joaquim Jorge and Daniel Gonçalves. 2010. Towards accessible touch interfaces. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility, (ASSETS '10), 19--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Carl Gutwin, Andy Cockburn, Joey Scarr, Sylvain Malacria and Scott C. Olson. 2014. Faster command selection on tablets with FastTap. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '14), 2617--2626. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. William Hamilton, Andruid Kerne and Tom Robbins. 2012. High-performance pen + touch modality interactions: a real-time strategy game eSports context. In Proceedings of the 25th annual ACM symposium on User interface software and technology. (UIST '12), 309--318. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Jaehyun Han, Sunggeun Ahn and Geehyuk Lee. 2014. Push-push: a two-point touchscreen operation utilizing the pressed state and the hover state. In Proceedings of the adjunct publication of the 27th annual ACM symposium on User interface software and technology. (UIST'14 Adjunct), 103--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Mark S. Hancock and Kellogg S. Booth. 2004. Improving menu placement strategies for pen input. In Proceedings of Graphics Interface 2004. (GI '04), 221--230. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Ken Hinckley, Seongkook Heo, Michel Pahud, Christian Holz, Hrvoje Benko, Abigail Sellen, Richard Banks, Kenton O'Hara, Gavin Smyth and William Buxton. 2016. Pre-Touch Sensing for Mobile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. (CHI' 16), 2869--2881. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Ken Hinckley, Francois Guimbretiere, Patrick Baudisch, Raman Sarin, Maneesh Agrawala, and Ed Cutrell. 2006. The springboard: multiple modes in one spring-loaded control. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06), ACM, New York, NY, USA, 181--190. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Amy K. Karlson and Ben Bederson. 2007. Direct Versus Indirect Input Methods for One-Handed Touchscreen Mobile Computing. Technical report, Human-Computer Interaction lab, Computer Science Department, University of Maryland.Google ScholarGoogle Scholar
  27. Dominik P. Käser, Maneesh Agrawala and Mark Pauly. 2011. FingerGlass: efficient multiscale interaction on multitouch screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '11), 1601--1610. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Sunjun Kim, Jihyun Yu and Geehyuk Lee. 2012. Interaction techniques for unreachable objects on the touchscreen. In Proceedings of the 24th Australian Computer-Human Interaction Conference. (OzCHI '12), 295--298. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Jari Kleimola, Markku Laine, Evgenia Litvinova and Petri Vuorimaa. 2013. TouchModifier: enriched multitouch gestures for tablet browsers. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. (ITS '13), 445--448. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Yu Ren Lai and T. K. Philip Hwang. 2015. Virtual Touchpad for Cursor Control of Touchscreen Thumb Operation in the Mobile Context. In: Marcus A. (eds) Design, User Experience, and Usability: Users and Interactions. Lecture Notes in Computer Science, vol. 9187. Springer, Cham. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Jianwei Lai and Dongsong Zhang. 2014. ExtendedThumb: a motion-based virtual thumb for improving one-handed target acquisition on touchscreen mobile devices. In CHI '14 Extended Abstracts on Human Factors in Computing Systems. (CHI EA '14), 1825--1830. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. David Lee, KyoungHee Son, Joon Hyub Lee and Seok-Hyung Bae. 2012. PhantomPen: virtualization of pen head for digital drawing free from pen occlusion & visual parallax. In Proceedings of the 25th annual ACM symposium on User interface software and technology. (UIST '12), 331--340. http://10.1145/2380116.2380159 Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Justin Matejka, Tovi Grossman, Jessica Lo and George Fitzmaurice. 2009. The design and evaluation of multifinger mouse emulation techniques. In Proceeding of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '09), 1073--1082. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Fabrice Matulic and Moira C. Norrie. 2013. Pen and Touch Gestural Environment for Document Editing on Interactive Tabletops. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces (ITS '13), 41--50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. David C. McCallum and Pourang Irani. 2009. ARC-Pad: Absolute+Relative Cursor Positioning for Large Displays with a Mobile Touchscreen. In Proceedings of the 22nd annual ACM symposium on User interface software and technology. (UIST '09), 153--156. http://10.1145/1622176.1622205 Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Mathieu Nancel and Edward Lank. 2017. Modeling User Performance on Curved Constrained Paths. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 244--254. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Mathieu Nancel, Daniel Vogel and Edward Lank. 2015. Clutching Is Not (Necessarily) the Enemy. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. (CHI '15), 4199--4202. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Alex Olwal, Steven Feiner, and Susanna Heyman. 2008. Rubbing and tapping for precise and rapid selection on touch-screen displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 295--304. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Anna Ostberg and Nada Matic. 2015. Hover Cursor: Improving Touchscreen Acquisition Of Small Targets With Hover-enabled Pre-selection. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. (CHI EA '15), 1723--1728. http://10.1145/2702613.2732903 Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Ken Pfeuffer, Ken Hinckley, Michel Pahud and Bill Buxton. 2017. Thumb+ Pen Interaction on Tablets. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. (CHI '17), 3254--3266. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Richard L. Potter, Linda J. Weldon and Ben Shneiderman. 1988. Improving The Accuracy of Touch Screens: An Experimental Evaluation of Three Strategies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '88) 27--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Anne Roudaut, Stéphane Huot and Eric Lecolinet. 2008. TapTap and MagStick: Improving One-Handed Target Acquisition on small touch-screens. In Proceedings of the working conference on Advanced visual interfaces. (AVI '08), 146--153. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Andrew Sears and Ben Shneiderman.1991. High Precision Touchscreens: Design Strategies and Comparisons with a Mouse. International Journal of Man-Machine 34, 4: 593--613. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Hemant Bhaskar Surale, Fabrice Matulic, and Daniel Vogel. 2017. Experimental Analysis of Mode Switching Techniques in Touch-based User Interfaces. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3267--3280. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Md. Sami Uddin, Carl Gutwin and Benjamin Lafreniere. 2016. HandMark Menus: Rapid Command Selection and Large Command Sets on Multi- Touch Displays. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 5836--5848. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Daniel Vogel and Ravin alakrishnan. 2010. Direct Pen Interaction With a Conventional Graphical User Interface. In Human-Computer Interaction 25, 4: 324--388.Google ScholarGoogle ScholarCross RefCross Ref
  47. Daniel Vogel and Ravin Balakrishnan. 2010. Occlusion-aware interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '10), 263--272. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Daniel Vogel and Patrick Baudisch. 2007. Shift: A Technique for Operating Pen-Based Interfaces Using Touch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '07), 657--666. http://0.1145/1240624.1240727 Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Chat Wacharamanotham, Jan Hurtmanns, Alexander Mertens, Martin Kronenbuerger, Christopher Schlick and Jan Borchers. 2011. Evaluating swabbing: a touchscreen input method for elderly users with tremor. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '11), 623--626. http://10.1145/1978942.1979031 Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Feng Wang, Xiang Cao, Xiangshi Ren and Pourang Irani. 2009. Detecting and Leveraging Finger Orientation for Interaction with Direct-Touch Surfaces. In Proceedings of the 22nd annual ACM symposium on User interface software and technology. (UIST '09), 23--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Daniel Wigdor, Clifton Forlines, Patrick Baudisch, John Barnwell and Chia Shen. 2007. Lucid Touch: a see-through mobile device. In Proceedings of the 20th annual ACM symposium on User interface software and technology. (UIST '07), 269--278. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Katrin Wolf and Niels Henze. 2014. Comparing pointing techniques for grasping hands on tablets. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services. (MobileHCI '14), 53--62. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Koji Yatani, Kurt Partridge, Marshall Bern, and Mark W. Newman. 2008. Escape: a target selection technique using visually-cued gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 285--294. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Stanislaw Zabramski, Suman Shrestha, and Wolfgang Stuerzlinger. 2013. Easy vs. Tricky: The Shape Effect in Tracing, Selecting, and Steering With Mouse, Stylus, and Touch. In Proceedings of International Conference on Making Sense of Converging Media (AcademicMindTrek '13), Artur Lugmayr, Heljä Franssila, Janne Paavilainen, and Hannu Kärkkäinen (Eds.). ACM, New York, NY, USA, Pages 99, 5 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Usability Impact of Occlusion-free Techniques on Commonly-used Multitouch Actions

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      CHIuXiD'19: Proceedings of the 5th International ACM In-Cooperation HCI and UX Conference
      April 2019
      205 pages
      ISBN:9781450361873
      DOI:10.1145/3328243

      Copyright © 2019 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 1 April 2019

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate22of50submissions,44%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader