research-article

PaperPhone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays

Authors:

Audrey Girouard,

Winslow Burleson,

Roel VertegaalAuthors Info & Claims

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1303 - 1312

https://doi.org/10.1145/1978942.1979136

Published: 07 May 2011 Publication History

Abstract

Flexible displays potentially allow for interaction styles that resemble those used in paper documents. Bending the display, e.g., to page forward, shows particular promise as an interaction technique. In this paper, we present an evaluation of the effectiveness of various bend gestures in executing a set of tasks with a flexible display. We discuss a study in which users designed bend gestures for common computing actions deployed on a smartphone-inspired flexible E Ink prototype called PaperPhone. We collected a total of 87 bend gesture pairs from ten participants and their appropriateness over twenty actions in five applications. We identified six most frequently used bend gesture pairs out of 24 unique pairs. Results show users preferred bend gestures and bend gesture pairs that were conceptually simpler, e.g., along one axis, and less physically demanding. There was a strong agreement among participants to use the same three pairs in applications: (1) side of display, up/down (2) top corner, up/down (3) bottom corner, up/down. For actions with a strong directional cue, we found strong consensus on the polarity of the bend gestures (e.g., navigating left is performed with an upwards bend gesture, navigating right, downwards). This implies that bend gestures that take directional cues into account are likely more natural to users.

Supplementary Material

MOV File (paper649.mov)

Download
41.37 MB

References

[1]

Arduino. http://www.arduino.cc.

[2]

Balakrishnan, R., Fitzmaurice, G., Kurtenbach, G., and Singh, K. Exploring interactive curve and surface manipulation using a bend and twist sensitive input strip. In Proc. Interactive 3D Graphics. I3D '99 (1999), 111--118.

Digital Library

[3]

Bowdon, E., Douglas, S. and Stanford, C. Testing the Principle of Orthogonality in Language Design. Human-Computer Interaction (4) 2 (1989), 95 --" 120.

Digital Library

[4]

Card, S.K.; Thomas, T.P.; Newell, A. The Psychology of Human-Computer Interaction London: Lawrence Erbaum (1983).

Digital Library

[5]

E Ink Inc. http://www.eink.co.

[6]

Flexpoint Inc. http://www.flexpoint.co.

[7]

Gumstix Inc. http://www.gumstix.co.

[8]

Gallant, D.T., Seniuk, A.G., and Vertegaal, R. Towards more paper-like input: flexible input devices for foldable interaction styles. In Proc. UIST '08 (2008).

Digital Library

[9]

Herkenrath, G., Karrer, T., and Borchers, J. Twend: twisting and bending as new interaction gesture in mobile devices. CHI 2008 Extended Abstracts (2008).

Digital Library

[10]

Holman, D., Vertegaal, R., Altosaar, M., Troje, N., and Johns, D. Paper windows: interaction techniques for digital paper. In Proc. CHI '05 (2005), 591--599.

Digital Library

[11]

Jacob, R.J., Girouard, A., Hirshfield, L.M., et al. Reality-based interaction: a framework for post-WIMP interfaces. Proc. CHI'08 (2008), 201--"210.

Digital Library

[12]

Lee, J.C., Hudson, S.E., and Tse, E. Foldable interactive displays. In Proc. UIST '08 (2008), 287--290.

Digital Library

[13]

Lee, S. et al. How users manipulate deformable displays as input devices. In Proc. CHI '10 (2010), 1647--1656.

Digital Library

[14]

Max 5. http://www.cycling74.com \ Morris, M.R., Wobbrock, J.O., Wilson, A.D. Understanding Users' Preferences for Surface Gestures. Proc. of Graphics Interface (GI '10) (2010), 261--268.

Digital Library

[15]

Readius. http://www.winstron.co.

[16]

Watanabe, J., Mochizuki, A., and Horry, Y. Bookisheet: bendable device for browsing content using the metaphor of leafing through the pages, Proc. UbiComp (2008), 360 -- 369.

Digital Library

[17]

Wobbrock, J.O., Aung, H.H., Rothrock, B. and Myers, B.A. Maximizing the guessability of symbolic input. Ext. Abstracts CHI '05 (2005), 1869--1872.

Digital Library

[18]

Wobbrock, J.O., Morris, M.R., and Wilson, A.D. User-defined gestures for surface computing. In Proc. CHI '09 (2009), 1083--1092.

Digital Library

[19]

Schwesig, C., Poupyrev, I., and Mori, E. Gummi: a bendable computer. In Proc. CHI '04 (2004), 263--270.

Digital Library

[20]

Sellen, A. J. and Harper, R. H. The Myth of the Paperless Office MIT Press (2003).

Digital Library

[21]

Stroustrup, B. The C++ Programming Language Special Edition. O'Reilly Media, Inc. (2000).

Digital Library

Cited By

Xiao C(2025)ReactFold: Towards Camera-based Tangible Interaction on Passive Paper ArtifactsProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704926(1-12)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3704926
Eady AGuerrero ACheung VThue DGirouard A(2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670960
Yeh YIrudayaraj AVogel D(2024)Single-handed Folding Interactions with a Modified Clamshell Flip PhoneProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642554(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642554
Show More Cited By

Index Terms

PaperPhone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices

Index terms have been assigned to the content through auto-classification.

Recommendations

Snaplet: using body shape to inform function in mobile flexible display devices
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

With recent advances in flexible displays, computer displays are no longer restricted to flat, rigid form factors. In this paper, we propose that the physical form of a flexible display, depending on the way it is held or worn, can help shape its ...
PaperTab: tablets as thin and flexible as paper
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

We present PaperTab, a paper tablet computer that allows physical manipulation of windows embodied in multiple flexible displays. PaperTab offers the benefits of updating electronic information on the fly, while maintaining the haptic/kinesthetic ...
FlexView: an evaluation of depth navigation on deformable mobile devices
TEI '13: Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction

We present FlexView, a set of interaction techniques for Z-axis navigation on touch-enabled flexible mobile devices. FlexView augments touch input with bend to navigate through depth-arranged content. To investigate Z-axis navigation with FlexView, we ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2011

3530 pages

ISBN:9781450302289

DOI:10.1145/1978942

General Chair:
Desney Tan
Microsoft Research
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Carl Gutwin
University of Saskatchewan
,
Bo Begole
PARC
,
Wendy A. Kellogg
IBM Research

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '11

Sponsor:

SIGCHI

CHI '11: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2011

BC, Vancouver, Canada

Acceptance Rates

CHI '11 Paper Acceptance Rate 410 of 1,532 submissions, 27%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

151
Total Citations
View Citations
2,565
Total Downloads

Downloads (Last 12 months)51
Downloads (Last 6 weeks)4

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Xiao C(2025)ReactFold: Towards Camera-based Tangible Interaction on Passive Paper ArtifactsProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704926(1-12)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3704926
Eady AGuerrero ACheung VThue DGirouard A(2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670960
Yeh YIrudayaraj AVogel D(2024)Single-handed Folding Interactions with a Modified Clamshell Flip PhoneProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642554(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642554
Tong WZhu-Tian CXia MLo LYuan LBach BQu H(2023)Exploring Interactions with Printed Data Visualizations in Augmented RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320938629:1(418-428)Online publication date: 27-Jan-2023
https://doi.org/10.1109/TVCG.2022.3209386
Wei QLi MHu J(2023)Mediated Social Touch With Mobile Devices: A Review of Designs and EvaluationsIEEE Transactions on Haptics10.1109/TOH.2023.332750616:4(785-804)Online publication date: Oct-2023
https://doi.org/10.1109/TOH.2023.3327506
Borah PSorathia K(2023)Investigating user performance and preference for two magnitude levels of size and angle of bend on a smartphone-sized flexible deviceBehaviour & Information Technology10.1080/0144929X.2023.2245062(1-27)Online publication date: 13-Sep-2023
https://doi.org/10.1080/0144929X.2023.2245062
Neves MSilva SBozzi C(2023)Interactions to Be: The Case of Speculative Interactive Print MediaDevelopments in Design Research and Practice II10.1007/978-3-031-32280-8_29(416-430)Online publication date: 9-May-2023
https://doi.org/10.1007/978-3-031-32280-8_29
Ch NTosca DCrump TAnsah AKun AShaer OJi YJeon M(2022)Gesture and Voice Commands to Interact With AR Windshield Display in Automated Vehicle: A Remote Elicitation StudyProceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3543174.3545257(171-182)Online publication date: 17-Sep-2022
https://dl.acm.org/doi/10.1145/3543174.3545257
Gheran BVillarreal-Narvaez SVatavu RVanderdonckt JBottoni PPanizzi E(2022)RepliGES and GEStory: Visual Tools for Systematizing and Consolidating Knowledge on User-Defined GesturesProceedings of the 2022 International Conference on Advanced Visual Interfaces10.1145/3531073.3531112(1-9)Online publication date: 6-Jun-2022
https://dl.acm.org/doi/10.1145/3531073.3531112
Sun ZWang SLiu CMa X(2022)Metaphoraction: Support Gesture-based Interaction Design with Metaphorical MeaningsACM Transactions on Computer-Human Interaction10.1145/351189229:5(1-33)Online publication date: 20-Oct-2022
https://dl.acm.org/doi/10.1145/3511892
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten