poster

Adding haptic feedback to touch screens at the right time

Authors:

Betty Lemaire-SemailAuthors Info & Claims

ICMI '11: Proceedings of the 13th international conference on multimodal interfaces

Pages 73 - 80

https://doi.org/10.1145/2070481.2070497

Published: 14 November 2011 Publication History

Abstract

The lack of haptics on touch screens often causes errors and user frustration. However, adding haptic feedback to touch screens in order to address this problem needs to be effected at an appropriate stage. In this paper we present two experiments to explore when best to add haptic feedback during the user's interaction. We separate the interaction process into three stages: Locating, Navigation and Interaction. We compare two points in the Navigation stage in order to establish the optimal time for adding haptic feedback at that stage. We also compare applying haptic feedback at the Navigation stage and the Interaction stage to establish the latest point at which haptic feedback can be added. Combining previous research with our own, we find that the optimal time for applying haptic feedback to the target GUI at the Navigation stage is when the user reaches his destination and that haptic feedback improves user's performance only if it is added before the Interaction stage. These results should alert designers to the need to take into consideration timing when adding haptic feedback to touch screens.

References

[1]

Levin, M. and Woo, A. 2009. Tactile-feedback solutions for an enhanced user experience. Information Display, 25 (10). 18--21.

[2]

Banter, B. 2010. Touch screens and touch surfaces are enriched by haptic force-feedback. Information Display, 26 (3). 26--30.

[3]

Buxton, W., Hill, R. and Rowley, P. 1985. Issues and techniques in touch-sensitive tablet input. In SIGGRAPH Comput. Graph. 19 (3). 215--224.

Digital Library

[4]

Brewster, S., Chohan, F. and Brown, L.2007. Tactile feedback for mobile interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, CA, United states, April 28--May 3, 2007), CHI '07. ACM, New York, NY, 159--162.

Digital Library

[5]

Alison, I.O., Adams, A., Brewster, S. and Gray, P. 2002. Guidelines for the Design of Haptic Widgets. In Proceedings of British HCI 2002. British Computer Society, 195--212.

[6]

Yatani, K. and Truong, K.N.2009. SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (Victoria, British Columbia, Canada October 4--7, 2009). UIST '09. ACM, New York, NY, 111--120.

Digital Library

[7]

Brewster, S.A. and King, A. 2005. The design and evaluation of a vibrotactile progress bar. In Proceedings of World Haptics 2005. 499--500.

Digital Library

[8]

Hoggan, E., Anwar, S. and Brewster, S.A. 2007. Mobile multi-actuator tactile displays. In Proceedings of the 2nd international conference on Haptic and audio interaction design (Seoul, South Korea, 2007), Springer-Verlag, 22--33.

Digital Library

[9]

Leung, R., MacLean, K., Bertelsen, M.B. and Saubhasik, M. 2007. Evaluation of haptically augmented touchscreen gui elements under cognitive load. In Proceedings of the 9th international conference on Multimodal interfaces (Nagoya, Aichi, Japan, November 12--15, 2007), ICMI'07, ACM, New York, NY, 374--381.

Digital Library

[10]

Sun, M., Ren, X. and Cao, X. 2011. Effects of Multimodal Error Feedback on Human Performance in Steering Tasks. Information and Media Technologies, 6 (1). 193--201.

[11]

Dennerlein, J.T., Martin, D.B. and Hasser, C. 2000. Force-feedback improves performance for steering and combined steering-targeting tasks. In Proceedings of the SIGCHI conference on Human factors in computing systems (The Hague, The Netherlands, April 01 - 06, 2000). CHI '00. ACM, New York, NY, 423--429.

Digital Library

[12]

Campbell, C.S., Zhai, S., May, K.W. and Maglio, P.P. 1999. What You Feel Must Be What You See: Adding Tactile Feedback to the Trackpoint. In Proceedings of 7th IFIP Conference on Human Computer Interaction. INTERACT'99, IOS Press, 383--390.

[13]

Pakkanen, T., Raisamo, R., Raisamo, J., Salminen, K. and Surakka, V. 2010. Comparison of three designs for haptic button edges on touchscreens. In Proceedings of Haptics Symposium 2010, IEEE, 219--225.

Digital Library

[14]

Hoggan, E., Brewster, S.A. and Johnston, J. 2008. Investigating the effectiveness of tactile feedback for mobile touchscreens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 5--10, 2008). CHI '08. ACM, New York, NY, 1573--1582.

Digital Library

[15]

Oakley, I., McGee, M.R., Brewster, S. and Gray, P. 2000. Putting the feel in "look and feel". In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (The Hague, The Netherlands, April 01 - 06, 2000). CHI '00. ACM, New York, NY, 415--422.

Digital Library

[16]

Poupyrev, I., Okabe, M. and Maruyama, S. 2004. Haptic feedback for pen computing: directions and strategies. In CHI '04 extended abstracts on Human factors in computing systems (Vienna, Austria, April 24--29, 2004), ACM, New York, NY, 1309--1312.

Digital Library

[17]

Poupyrev, I., Maruyama, S. and Rekimoto, J. 2002. Ambient touch: designing tactile interfaces for handheld devices. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (Paris, France, October 27--30, 2002). UIST '03. ACM, New York, NY, 51--60.

Digital Library

[18]

Akamatsu, M., Mackenzie, I.S. and Hasbroucq, T.1995.A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device. Ergonomics, 38 (4). 816--827.

[19]

Koskinen, E., Kaaresoja, T. and Laitinen, P. 2008. Feel-good touch: finding the most pleasant tactile feedback for a mobile touch screen button. In Proceedings of the 10th international conference on Multimodal interfaces (Chania, Crete, Greece, October 20--22, 2008), ICMI'08, ACM, New York, 297--304.

Digital Library

[20]

Forlines, C. and Balakrishnan, R. 2008. Evaluating tactile feedback and direct vs. indirect stylus input in pointing and crossing selection tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 5--10, 2008). CHI '08. ACM, New York, NY, 1563--1572.

Digital Library

[21]

Gosselin, C., Poulin, R. and Laurendeau, D.2008. A planar parallel 3-dof cable-driven haptic interface. In Proceedings of the the 12nd World Multi-Conference on Systemics, Cybernetics and Informatics (Orlando, Florida, USA, 2008) WM-SCI '08. 266--271.

[22]

ISO. Ergonomic requirements for office work with visual display terminals (VDTs), Part 9: Requirements for non-keyboard input devices. 2000.

[23]

Farzan, S., I. Scott, M. and Stacey, D.S.2009. Evaluation of Mouse and Touch Input for a Tabletop Display Using Fitts' Reciprocal Tapping Task. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 839--843.

[24]

Touchsense Tactile Feedback Overview, Immersion Corporation.

[25]

Tashiro, K., Shiokawa, Y., Aono, T. and Maeno, T. 2009. A Virtual Button with Tactile Feedback Using Ultrasonic Vibration. Virtual and Mixed Reality, LNCS 5622, 385--393.

Digital Library

Cited By

Wang XFang XZheng XDeng XLi YWang M(2022)Brain Oscillatory Representations of Vibrotactile Parameters: An EEG Study2022 5th International Conference on Computing and Informatics (ICCI)10.1109/ICCI54321.2022.9756106(035-043)Online publication date: 9-Mar-2022
https://doi.org/10.1109/ICCI54321.2022.9756106
Bermejo CLee LChojecki PPrzewozny DHui P(2021)Exploring Button Designs for Mid-air Interaction in Virtual Reality: A Hexa-metric Evaluation of Key Representations and Multi-modal CuesProceedings of the ACM on Human-Computer Interaction10.1145/34571415:EICS(1-26)Online publication date: 29-May-2021
https://dl.acm.org/doi/10.1145/3457141
Han JLee G(2021)Finding a More Pleasant Compliance Illusion Method for a Hand-Held DeviceIEEE Access10.1109/ACCESS.2021.31376149(168154-168161)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3137614
Show More Cited By

Index Terms

Adding haptic feedback to touch screens at the right time
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
      2. Touch screens
    2. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Keyboard with tactile feedback on smartphone touch screen
AVI '18: Proceedings of the 2018 International Conference on Advanced Visual Interfaces

Pressing buttons on a smartphone touch screen is difficult if you are not looking at the screen. We developed a numerical keyboard that provides a tactile feedback using phone short vibrations. The feedback is provided both when the user swipes the ...
Enhancing Touch Screen Games Through a Cable-driven Force Feedback Device
ICVRV '12: Proceedings of the 2012 International Conference on Virtual Reality and Visualization

An increasing number of touch screen interfaces have promoted plenty of applications. A great part of the applications is game. However, the lack of haptic feedback on touch screens also degrades the enjoyment of touch screen games. We present the ...
EV-pen: an electrovibration haptic feedback pen for touchscreens
SA '16: SIGGRAPH ASIA 2016 Emerging Technologies

This paper presents an Electrovibration Pen (EV-Pen) which incorporates electrovibration into pen interactions. The EV-Pen not only exploits the advantages of conventional pen-based interactions but also provides a wide range of haptic feedback modes ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '11: Proceedings of the 13th international conference on multimodal interfaces

November 2011

432 pages

ISBN:9781450306416

DOI:10.1145/2070481

General Chairs:
Hervé Bourlard
Idiap Research Institute, Switzerland
,
Thomas S. Huang
University of Illinois, USA
,
Enrique Vidal
Universitat Politécnica Valéncia, Spain
,
Program Chairs:
Daniel Gatica-Perez
Idiap Research Institute, Switzerland
,
Louis-Philippe Morency
University of Southern California, USA
,
Nicu Sebe
University of Trento, Italy

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

ICMI'11

Sponsor:

SIGCHI

ICMI'11: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 14 - 18, 2011

Alicante, Spain

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
511
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang XFang XZheng XDeng XLi YWang M(2022)Brain Oscillatory Representations of Vibrotactile Parameters: An EEG Study2022 5th International Conference on Computing and Informatics (ICCI)10.1109/ICCI54321.2022.9756106(035-043)Online publication date: 9-Mar-2022
https://doi.org/10.1109/ICCI54321.2022.9756106
Bermejo CLee LChojecki PPrzewozny DHui P(2021)Exploring Button Designs for Mid-air Interaction in Virtual Reality: A Hexa-metric Evaluation of Key Representations and Multi-modal CuesProceedings of the ACM on Human-Computer Interaction10.1145/34571415:EICS(1-26)Online publication date: 29-May-2021
https://dl.acm.org/doi/10.1145/3457141
Han JLee G(2021)Finding a More Pleasant Compliance Illusion Method for a Hand-Held DeviceIEEE Access10.1109/ACCESS.2021.31376149(168154-168161)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3137614
Yang YZhang YLemaire-Semail BDai X(2014)Enhancing the Simulation of Boundaries by Coupling Tactile and Kinesthetic FeedbackHaptics: Neuroscience, Devices, Modeling, and Applications10.1007/978-3-662-44196-1_3(19-26)Online publication date: 15-Oct-2014
https://doi.org/10.1007/978-3-662-44196-1_3
El-Glaly YQuek FSmith-Jackson TDhillon GJordà SParés N(2013)Touch-screens are not tangibleProceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction10.1145/2460625.2460665(245-253)Online publication date: 10-Feb-2013
https://dl.acm.org/doi/10.1145/2460625.2460665
Ranasinghe NCheok ANakatsu RMorency LBohus DAghajan HCassell JNijholt AEpps J(2012)Taste/IPProceedings of the 14th ACM international conference on Multimodal interaction10.1145/2388676.2388768(409-416)Online publication date: 22-Oct-2012
https://dl.acm.org/doi/10.1145/2388676.2388768

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten