research-article

ReFlex: A Flexible Smartphone with Active Haptic Feedback for Bend Input

Authors:

Paul Strohmeier,

Juan Pablo Carrascal,

Vincent Levesque,

Roel VertegaalAuthors Info & Claims

TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

Pages 185 - 192

https://doi.org/10.1145/2839462.2839494

Published: 14 February 2016 Publication History

Abstract

ReFlex is a flexible smartphone with bend input and active haptic feedback. ReFlex's features allow the introduction of sensations such as friction or resistance. We report results from an experiment using ReFlex in a targeting task, as well as initial users' reactions to the prototype. We explore both absolute and relative tactile haptic feedback, paired with two types of bend input mappings: position-control and rate-control. We observed that position-controlled cursors paired well with relative bend feedback, while rate-controlled cursors paired well with absolute bend feedback to indicate targets. We also explored an eyes-free condition. Results suggest that while eyes-free, haptic feedback conditions were more error-prone than visual-only conditions, the size of the error was relatively small, and users were able to complete the task in all cases. We present two application scenarios that take advantage of the unique input and output modalities of ReFlex and discuss its potential for within document navigation.

References

[1]

Motoyuki Akamatsu, I. Scott MacKenzie, and Thierry Hasbrouc. 1995. A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device. Ergonomics 38: 816--827.

[2]

Olivier Bau, Ivan Poupyrev, Ali Israr, and Chris Harrison. 2010. TeslaTouch: electrovibration for touch surfaces. In Proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST '10). ACM, New York, NY, USA, 283--292.

Digital Library

[3]

Frank Biocca, Jin Kim, and Yung Choi. 2011. Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multi-Modal Interfaces, and Cross-Modal Sensory Illusions. Presence, 10: 247--265.

Digital Library

[4]

Nicholas Chen, Francois Guimbretiere, Morgan Dixon, Cassandra Lewis, and Maneesh Agrawala. 2008. Navigation techniques for dual-display e-book readers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 1779--1788.

Digital Library

[5]

Clifton Forlines and Ravin Balakrishnan. 2008. Evaluating tactile feedback and direct vs. indirect stylus input in pointing and crossing selection tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 1563--1572.

Digital Library

[6]

Audrey Girouard, Aneesh Tarun, and Roel Vertegaal. 2012. DisplayStacks: interaction techniques for stacks of flexible thin-film displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2431--2440.

Digital Library

[7]

Chris Harrison, Zhiquan Yeo, and Scott E. Hudson. 2010. Faster progress bars: manipulating perceived duration with visual augmentations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 1545--1548.

Digital Library

[8]

Masaharu Hirose, Karin Iwazaki, Kozue Nojiri, Minato Takeda, Yuta Sugiura, and Masahiko Inami. 2015. Gravitamine spice: a system that changes the perception of eating through virtual weight sensation. In Proceedings of the 6th Augmented Human International Conference (AH '15). ACM, New York, NY, USA, 33--40.

Digital Library

[9]

David Holman and Roel Vertegaal. 2008. Organic user interfaces: designing computers in any way, shape, or form. Commun. ACM 51, 6 (June 2008), 48--55.

Digital Library

[10]

Johan Kildal. 2010. 3D-press: haptic illusion of compliance when pressing on a rigid surface. In International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction (ICMI-MLMI '10). ACM, New York, NY, USA, Article 21, 8 pages.

Digital Library

[11]

Johan Kildal, Susanna Paasovaara, and Viljakaisa Aaltonen. 2012. Kinetic device: designing interactions with a deformable mobile interface. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 1871--1876.

Digital Library

[12]

Johan Kildal and Graham Wilson. 2012. Feeling it: the roles of stiffness, deformation range and feedback in the control of deformable ui. In Proceedings of the 14th ACM international conference on Multimodal interaction (ICMI '12). ACM, New York, NY, USA, 393--400.

Digital Library

[13]

Roberta L. Klatzky and Susan J. Lederman. 2006. The perceived roughness of resistive virtual textures: I. rendering by a force-feedback mouse. ACM Trans. Appl. Percept. 3, 1 (January 2006), 1--14.

Digital Library

[14]

Byron Lahey, Audrey Girouard, Winslow Burleson, and Roel Vertegaal. 2011. PaperPhone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 1303--1312.

Digital Library

[15]

Susan J. Lederman and Lynette A. Jones. 2011. Tactile and Haptic Illusions. IEEE Transactions on Haptics 4, 4: 273--294.

Digital Library

[16]

Catherine C. Marshall and Sara Bly. 2005. Turning the page on navigation. In Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries (JCDL '05). ACM, New York, NY, USA, 225--234.

Digital Library

[17]

Yusuke Nakagawa, Akiya Kamimura, and Yoichiro Kawaguchi. 2012. MimicTile: a variable stiffness deformable user interface for mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 745--748.

Digital Library

[18]

Donald Norman. 1988. The Psychology of Everyday Things. Basic Books.

[19]

Kenton O'Hara and Abigail Sellen. 1997. A comparison of reading paper and on-line documents. In Proceedings of the ACM SIGCHI Conference on Human factors in computing systems (CHI '97). ACM, New York, NY, USA, 335--342.

Digital Library

[20]

Omega Engineering. Strain Gages. 2015. http://www.omega.ca/guides/straingages.html

[21]

Joseph D. Rutledge and Ted Selker. 1990. Force-to-motion functions for pointing. In Proceedings of the IFIP TC13 Third International Conference on Human-Computer Interaction (INTERACT '90), Dan Diaper, David J. Gilmore, Gilbert Cockton, and Brian Shackel (Eds.). North-Holland Publishing Co., Amsterdam, The Netherlands, The Netherlands, 701--706.

Digital Library

[22]

Carsten Schwesig, Ivan Poupyrev, and Eijiro Mori. 2004. Gummi: a bendable computer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 263--270.

Digital Library

[23]

M.A. Srinivasan, G.L. Beauregard, and D.L. Brock. The Impact of Visual Information on the Haptic Perception of Stiffness in Virtual Environments. In Proceedings of ASME Dynamic Systems and Control Division (1996), 58. 555--559.

[24]

Tactile Labs. Hapuator Mark II. 2012. http://www.tactilelabs.com/products/haptics/haptuator-mark-ii-v2/

[25]

Hsin-yun Yao and Vincent Hayward. 2006. An experiment on length perception with a virtual rolling stone. In Proceedings of EuroHaptics 2006. Springer-Verlag, 325--330.

[26]

Shumin Zhai. 1995. Human Performance in Six Degree of Freedom Input Control. Ph.D Dissertation. University of Toronto, Toronto, ON.

Cited By

Sabnis NOtaran AWittchen DDidion JSteimle JStrohmeier P(2025)Foot Pedal Control: The Role of Vibrotactile Feedback in Performance and Perceived ControlProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704937(1-15)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3704937
Vega GMartinez-Missir VWittchen DSabnis NGirouard ACochrane KStrohmeier P(2024)vARitouch: Back of the Finger Device for Adding Variable Compliance to Rigid ObjectsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642828(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642828
Yeh YIrudayaraj AVogel D(2024)Single-handed Folding Interactions with a Modified Clamshell Flip PhoneProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642554(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642554
Show More Cited By

Index Terms

ReFlex: A Flexible Smartphone with Active Haptic Feedback for Bend Input
1. Human-centered computing

Recommendations

WhammyPhone: Exploring Tangible Audio Manipulation Using Bend Input on a Flexible Smartphone
UIST '16 Adjunct: Adjunct Proceedings of the 29th Annual ACM Symposium on User Interface Software and Technology

We present WhammyPhone, a novel audio interface that supports physical manipulation of digital audio through bend gestures. WhammyPhone combines a high-resolution flexible display, bend sensors, and a set of intuitive interaction techniques that enable ...
FlexView: an evaluation of depth navigation on deformable mobile devices
TEI '13: Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction

We present FlexView, a set of interaction techniques for Z-axis navigation on touch-enabled flexible mobile devices. FlexView augments touch input with bend to navigate through depth-arranged content. To investigate Z-axis navigation with FlexView, we ...
MagicWand: Exploring Physical Affordances with a Handheld Cylindrical Display Object
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

We introduce MagicWand, a cylindrical handheld display object made out of 2 Flexible Organic Light-Emitting Diode (FOLED) screens. Magic Wand features a smartphone running the Android operating system. Gesture recognition allows movements of the wand as ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2016

820 pages

ISBN:9781450335829

DOI:10.1145/2839462

Conference Chairs:
Saskia Bakker,
Caroline Hummels,
Brygg Ullmer,
Program Chairs:
Luc Geurts,
Bart Hengeveld,
Daniel Saakes,
Publications Chair:
Mendel Broekhuijsen

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 February 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

TEI '16

TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

February 14 - 17, 2016

Eindhoven, Netherlands

Acceptance Rates

TEI '16 Paper Acceptance Rate 45 of 178 submissions, 25%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
803
Total Downloads

Downloads (Last 12 months)43
Downloads (Last 6 weeks)7

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sabnis NOtaran AWittchen DDidion JSteimle JStrohmeier P(2025)Foot Pedal Control: The Role of Vibrotactile Feedback in Performance and Perceived ControlProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704937(1-15)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3704937
Vega GMartinez-Missir VWittchen DSabnis NGirouard ACochrane KStrohmeier P(2024)vARitouch: Back of the Finger Device for Adding Variable Compliance to Rigid ObjectsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642828(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642828
Yeh YIrudayaraj AVogel D(2024)Single-handed Folding Interactions with a Modified Clamshell Flip PhoneProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642554(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642554
Ding YSabnis NStrohmeier P(2024)Motionless Movement: Towards Vibrotactile Kinesthetic DisplaysProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642499(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642499
Jingu ASabnis NStrohmeier PSteimle J(2024)Shaping Compliance: Inducing Haptic Illusion of Compliance in Different Shapes with Electrotactile GrainsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641907(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641907
Wittchen DMartinez-Missir VMavali SSabnis NReed CStrohmeier PWard JMcGill MMarky K(2023)Designing Interactive Shoes for Tactile Augmented RealityProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582728(1-14)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3582728
Pruszko LGu HBourgeois JLaurillau YCoutrix C(2023)Modular Tangible User Interfaces: Impact of Module Shape and Bonding Strength on InteractionProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572731(1-15)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3572731
Sabnis NWittchen DVega GReed CStrohmeier P(2023)Tactile Symbols with Continuous and Motion-Coupled Vibration: An Exploration of using Embodied Experiences for Hermeneutic DesignProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581356(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581356
Sabnis NWittchen DReed CPourjafarian NSteimle JStrohmeier P(2023)Haptic Servos: Self-Contained Vibrotactile Rendering System for Creating or Augmenting Material ExperiencesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580716(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580716
Tong WZhu-Tian CXia MLo LYuan LBach BQu H(2023)Exploring Interactions with Printed Data Visualizations in Augmented RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320938629:1(418-428)Online publication date: 27-Jan-2023
https://doi.org/10.1109/TVCG.2022.3209386
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten