research-article

Expanding touch input vocabulary by using consecutive distant taps

Authors:

Geehyuk LeeAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2597 - 2606

https://doi.org/10.1145/2556288.2557234

Published: 26 April 2014 Publication History

Abstract

In recent years, touch screens have emerged and matured as the main input interface for mobile and tablet computers calling for extended touch input possibilities. In this paper, we explore the use of consecutive distant taps to expand the touch screen input vocabulary. We analyzed time intervals and distances between consecutive taps during common applications on a tablet and verified that consecutive distant taps can be used conflict-free with existing touch gestures. We designed the two interaction techniques Ta-tap and Ta-Ta-tap that utilize consecutive distant taps. Ta-tap uses two consecutive distant taps to invoke alternative touch operations for multi-touch emulation, whereas Ta-Ta-tap uses a series of consecutive distant taps to define a spatial gesture. We verified the feasibility of both interaction techniques through a series of experiments and a user study. The high recognition rate of Ta-tap and Ta-Ta-tap gestures, the few conflicts with existing gestures, and the positive feedback from the participants assert the potential of consecutive distant taps as a new design space to enrich touch screen interactions.

Supplementary Material

suppl.mov (pn1473-file3.mp4)

Supplemental video

Download
31.23 MB

References

[1]

Adams, A. and Cox, A. L. Questionnaires, in-depth interviews and focus groups. In P. Cairns and A. L. Cox, eds., Research Methods for Human Computer Interaction. Cambridge University Press (2008), 17--34.

[2]

Benko, H., Wilson, A., and Baudisch, P. Precise selection techniques for multi-touch screens. In proc. CHI '06, ACM (2006), 1263--1272.

Digital Library

[3]

Bonnet, D., Appert, C., and Beaudouin-Lafon, M. Extending the Vocabulary of Touch Events with ThumbRock. In proc. GI '13, ACM (2013).

Digital Library

[4]

Boring, S., Ledo, D., Chen, X., Marquardt, N., Tang, A., and Greenberg, S. The Fat Thumb: Using the Thumb's Contact Size for Single-Handed Mobile Interaction. In proc. MobileHCI '12, ACM (2012), 39--48.

Digital Library

[5]

Davidson, P. L. and Han, J. Y. Extending 2D object arrangement with pressure-sensitive layering cues. In proc. UIST '08, ACM (2008), 87--90.

Digital Library

[6]

Findlater, L., Wobbrock, J. O. and Wigdor, D. Typing on flat glass: examining ten-finger expert typing patterns on touch surfaces. In proc. CHI '11, ACM (2011), 2453--2462.

Digital Library

[7]

Forlines, C., Wigdor, D., Shen, C., and Balakrishnan, R. Direct-touch vs. mouse input for tabletop displays. In proc. CHI '07, ACM (2007), 647--656.

Digital Library

[8]

Goel, M., Wobbrock, J. O., and Patel, S. N. GripSense: Using Built-In Sensors to Detect Hand Posture and Pressure on Commodity Mobile Phones. In proc. UIST '12, ACM (2012), 545--554.

Digital Library

[9]

Gustafson, S., Holz, C., and Baudisch, P. Imaginary Phone: learning imaginary interfaces by transferring spatial memory from a familiar device. In proc. UIST '11, ACM (2011), 283--292.

Digital Library

[10]

Harrison, C. and Hudson, S. Using Shear as a Supplemental Two-Dimensional Input Channel for Rich Touchscreen Interaction. In proc. CHI '12, ACM (2012), 3149--3152.

Digital Library

[11]

Harrison, C., Schwarz, J. and Hudson, S. E. TapSense: enhancing finger interaction on touch surfaces. In proc. UIST '11, ACM (2011), 627--634.

Digital Library

[12]

Heo, S. and Lee, G. Force gestures: augmenting touch screen gestures with normal and tangential forces. In proc. UIST '11, ACM (2011), 621--626.

Digital Library

[13]

Heo, S. and Lee, G. ForceTap: extending the input vocabulary of mobile touch screens by adding tap gestures. In proc. MobileHCI '11, ACM (2011), 113--122.

Digital Library

[14]

Heo, S. and Lee, G. Indirect shear force estimation for multi-point shear force operations. In proc. CHI '13, ACM (2013), 281--284.

Digital Library

[15]

Hinckley, K. and Song, H. Sensor synaesthesia: touch in motion, and motion in touch. In proc. CHI '11, ACM (2011), 801--810.

Digital Library

[16]

Karat, J., McDonald, J. E., and Anderson, M. A comparison of menu selection techniques: touch panel, mouse and keyboard. International Journal of ManMachine Studies 25, 1 (1986), 73--88.

Digital Library

[17]

Kin, K., Agrawala, M., and DeRose, T. Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation. In proc. GI '09, Canadian Information Processing Society (2009), 119--124.

Digital Library

[18]

Microsoft MSDN, http://msdn.microsoft.com/enus/library/windows/desktop/bb760404(v=vs.85).aspx

[19]

Miyaki, T. and Rekimoto, J. GraspZoom: zooming and scrolling control model for single-handed mobile interaction. In proc. MobileHCI '09, ACM (2009), 11:1--11:4.

Digital Library

[20]

Müller, H., Gove, J., and Webb, J. Understanding Tablet Use: A Multi-Method Exploration. In proc. MobileHCI '12, ACM (2012), 1--10.

Digital Library

[21]

Myers, C. S. and Rabiner, L. R. A comparative study of several dynamic time-warping algorithms for connected word recognition. The Bell System Technical J. 60, 7 (1981), 1389--1409.

[22]

Research In Motion™, SurePress™ Technology. http://us.blackberry.com/specifications/communication/surepress-touch-screen.html

[23]

Roth, V. and Turner, T., Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices. In proc. CHI '09, ACM (2009), 1523--1526.

Digital Library

[24]

Roudaut, A., Lecolinet, E., and Guiard, Y. MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb. In proc. CHI '09, ACM (2009), 927--936.

Digital Library

[25]

Rubine, D. Specifying gestures by example. In proc. SIGGRAPH '91, ACM (1991), 329--337.

Digital Library

[26]

Sears, A. and Shneiderman, B. High precision touchscreens: design strategies and comparisons with a mouse. International Journal of Man-Machine Studies 34, 4 (1991), 593--613.

Digital Library

[27]

Serrano, M., Lecolinet, E., and Guiard, Y. Bezel-Tap gestures: quick activation of commands from sleep mode on tablets. In proc. CHI '13, ACM (2013), 3027--3036.

Digital Library

[28]

Wagner, J., Huot, S., and Mackay, W. BiTouch and BiPad: designing bimanual interaction for hand-held tablets. In proc. CHI '12, ACM (2012), 2317--2326.

Digital Library

[29]

Wang, F., and Ren, X. Empirical evaluation for finger input properties in multi-touch interaction. In proc. CHI '09, ACM (2009), 1063--1072.

Digital Library

[30]

Wang, F., Cao, X., Ren, X., and Irani, P. Detecting and leveraging finger orientation for interaction with directtouch surfaces, In proc. UIST '09, ACM (2009), 23--32.

Digital Library

[31]

Wobbrock, J., Wilson, A., and Li, Y. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In Proc. UIST '07, ACM (2007), 159--168.

Digital Library

[32]

Zhao, S., Maneesh, A., and Hinckley, K. Zone and polygon menus: using relative position to increase the breadth of multi-stroke marking menus, In Proc. CHI '06, ACM (2006), 1077--1086.

Digital Library

Cited By

Alghofaili RSendhilnathan NZhang TGrossman TGlueck MJonker TLafreniere B(2024)Interactive Mediation Techniques for Error-Aware Gesture Input SystemsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670964(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670964
Lee DKim SNoh JLee B(2024)User Performance in Consecutive Temporal Pointing: An Exploratory StudyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642904(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642904
Yamanaka SUsuba HSato J(2024)Behavioral Differences between Tap and Swipe: Observations on Time, Error, Touch-point Distribution, and Trajectory for Tap-and-swipe Enabled TargetsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642272(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642272
Show More Cited By

Index Terms

Expanding touch input vocabulary by using consecutive distant taps
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

One-Handed Interaction Technique for Single-Touch Gesture Input on Large Smartphones
SUI '19: Symposium on Spatial User Interaction

We propose a one-handed interaction technique using cursor based on touch pressure to enable users to perform various single-touch gestures such as a tap, swipe, drag, and double-tap on unreachable targets. In the proposed technique, cursor mode is ...
B2B-Swipe: Swipe Gesture for Rectangular Smartwatches from a Bezel to a Bezel
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

We present B2B-Swipe, a single-finger swipe gesture for a rectangular smartwatch that starts at a bezel and ends at a bezel to enrich input vocabulary. There are 16 possible B2B-Swipes because a rectangular smartwatch has four bezels. Moreover, B2B-...
Identifying unintentional touches on handheld touch screen devices
DIS '12: Proceedings of the Designing Interactive Systems Conference

Accidental triggering of unwanted interaction when using a handheld touch screen device is a problem for many users. Accidental touches on capacitive touch screen based mobile telephones were analyzed in a user test. Patterns that are characteristic of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
844
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)1

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Alghofaili RSendhilnathan NZhang TGrossman TGlueck MJonker TLafreniere B(2024)Interactive Mediation Techniques for Error-Aware Gesture Input SystemsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670964(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670964
Lee DKim SNoh JLee B(2024)User Performance in Consecutive Temporal Pointing: An Exploratory StudyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642904(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642904
Yamanaka SUsuba HSato J(2024)Behavioral Differences between Tap and Swipe: Observations on Time, Error, Touch-point Distribution, and Trajectory for Tap-and-swipe Enabled TargetsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642272(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642272
Nishida NIkematsu KSato JYamanaka STsubouchi K(2023)Single-tap Latency Reduction with Single- or Double- tap PredictionProceedings of the ACM on Human-Computer Interaction10.1145/36042717:MHCI(1-26)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604271
Mackamul ECasiez GMalacria S(2023)Exploring Visual Signifier Characteristics to Improve the Perception of Affordances of In-Place Touch InputsProceedings of the ACM on Human-Computer Interaction10.1145/36042577:MHCI(1-32)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604257
Lafreniere BR. Jonker TSantosa SParent MGlueck MGrossman TBenko HWigdor D(2021)False Positives vs. False NegativesThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474735(54-68)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474735
Ikematsu KYamanaka S(2020)ScraTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34118314:3(1-19)Online publication date: 4-Sep-2020
https://dl.acm.org/doi/10.1145/3411831
Ikematsu KTsubouchi KYamanaka SBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)PredicTaps: Latency Reduction Technique for Single-taps Based on Recognition for Single-tap or Double-tapExtended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3382933(1-9)Online publication date: 25-Apr-2020
https://dl.acm.org/doi/10.1145/3334480.3382933
Ikematsu KYamanaka SBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)ScraTouchExtended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3382858(1-10)Online publication date: 25-Apr-2020
https://dl.acm.org/doi/10.1145/3334480.3382858
Sei YFunakoshi MShizuki B(2019)Expanding One-Handed Touch Input Vocabulary Using Index Finger on and Above Back-of-DeviceProceedings of the 31st Australian Conference on Human-Computer-Interaction10.1145/3369457.3369537(585-589)Online publication date: 2-Dec-2019
https://dl.acm.org/doi/10.1145/3369457.3369537
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten