Work in Progress

Exploring Eyes-free Interaction with Wrist-Worn Deformable Materials

Authors:

Alex Keith Eady,

Audrey GirouardAuthors Info & Claims

TEI '17: Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction

Pages 521 - 528

https://doi.org/10.1145/3024969.3025087

Published: 20 March 2017 Publication History

Abstract

Recent work has explored how on-the-wrist devices can be augmented with displays, sensors, and aesthetics to produce a new genre of wearable, digital jewelry. Most often, these devices are augmented with hardware (e.g., touch-screens, gyroscopes) to receive wearer input. Breakthroughs in sensing materials allow novel inputs such as squeeze, bend, and stretch, which may be more suited to interaction with a discreet wearable.

We explore interactions with a flexible bracelet that can be manipulated through bend, stretch, and touch. We discuss the process involved in fabricating materials that convert these actions into measurable parameters. We particularly focus on eyes-free interactions with bracelets that take advantage of the tactile feedback from the act of deformation, and demonstrate some early, low-fidelity prototype concepts.

References

[1]

Apple Inc. Watch. 2016. http://www.apple.com/watch/.

[2]

Buchenau, M. and Suri, J. Experience prototyping. Designing Interactive Systems, (2000), 424--433.

Digital Library

[3]

Chien, C., Liang, R.-H., Lin, L.-F., Chan, L., and Chen, B.-Y. FlexiBend: Enabling Interactivity of Multi-Part, Deformable Fabrications Using Single Shape-Sensing Strip. ACM Symposium on User Interface Software & Technology, (2015), 659--663.

Digital Library

[4]

Dijkstra, R., Perez, C., and Vertegaal, R. Evaluating effects of structural holds on pointing and dragging performance with flexible displays. SIGCHI Conference on Human Factors in Computing Systems, ACM Press (2011), 1293--1302.

Digital Library

[5]

Fitbit Inc. Fitbit Flex 2TM Fitness Wristband. 2016. https://www.fitbit.com/ca/flex2.

[6]

Fortmann, J., Root, E., Boll, S., and Heuten, W. Tangible Apps Bracelet: Designing Modular Wrist-Worn Digital Jewellery for Multiple Purposes. ACM Conference on Designing Interactive Systems, (2016), 841--852.

Digital Library

[7]

Gotsch, D. HoloFlex?: A Flexible Holographic Smartphone with Bend Input. CHI Extended Abstracts on Human Factors in Computing Systems, (2016), 3675--3678.

Digital Library

[8]

Hoang, T.N., Smith, R.T., and Thomas, B.H. Passive Deformable Haptic glove to support 3D interactions in mobile augmented reality environments. 2013 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2013, (2013), 257--258.

[9]

Holman, D., Fellion, N., and Vertegaal, R. Sensing Touch Using Resistive Graphs. Proceedings of the 2014 conference on Designing interactive systems DIS '14, (2014), 195--198.

Digital Library

[10]

Kang, B.B., Lee, H., In, H., Jeong, U., Chung, J., and Cho, K.J. Development of a polymer-based tendondriven wearable robotic hand. Proceedings IEEE International Conference on Robotics and Automation 2016--June, (2016), 3750--3755.

Digital Library

[11]

Kim, D.H. and Park, H.S. Thumb joint angle estimation for soft wearable hand robotic devices. IEEE International Conference on Rehabilitation Robotics 2015--Septe, (2015), 91--94.

[12]

Kinnaird, P. and Talgam-Cohen, I., eds. Wearable Computing: Getting Dressed in Tech. XRDS 20, 2 (2013).

Digital Library

[13]

Kumbay Yildiz, S., Mutlu, R., and Alici, G. Fabrication and characterisation of highly stretchable elastomeric strain sensors for prosthetic hand applications. Sensors and Actuators A 247, (2016), 514--521.

[14]

Lee, S.-S., Kim, S., Jin, B., et al. How users manipulate deformable displays as input devices. SIGCHI Conference on Human Factors in Computing Systems, (2010), 1647--1656.

Digital Library

[15]

Lo, J. and Girouard, A. Fabricating Bendy: Design and Development of Deformable Prototypes. IEEE Pervasive Computing Special Issue on Fabrication and Printing 13, 3 (2014), 40--46.

[16]

Lyons, K., Nguyen, D., Ashbrook, D., and White, S. Facet: A Multi-Segment Wrist Worn System. ACM Symposium on User Interface Software & Technology, (2012), 123--130.

Digital Library

[17]

Mattmann, C., Clemens, F., and Tröster, G. Sensor for measuring strain in textile. Sensors 8, 6 (2008), 3719--3732.

[18]

Mei, H., Wang, R., Wang, Z., Feng, J., Xia, Y., and Zhang, T. A flexible pressure-sensitive array based on soft substrate. Sensors & Actuators: A. Physical 222, (2015), 80--86.

[19]

Miner, C., Chan, D., and Campbell, C. Digital jewelry: wearable technology for everyday life. Extended Abstracts on Human Factors in Computing Systems, (2001), 45--46.

Digital Library

[20]

Oakley, I. and Park, J.-S. Designing Eyes-Free Interaction. In Haptic and Audio Interaction Design. 2007, 121--132.

Digital Library

[21]

Pakanen, M., Colley, A., Häkkilä, J., Kildal, J., and Lantz, V. Squeezy Bracelet -Designing a Wearable Communication Device for Tactile Interaction. Nordic Conference on Human-Computer Interaction, (2014), 305--314.

Digital Library

[22]

Panasonic Corporation. Panasonic Develops a Stretchable Resin Film and Its Application Materials For Stretchable Electronics | Headquarters News | Panasonic Newsroom Global. Press Release, 2015, 1. http://news.panasonic.com/global/press/data/2015/12/ en151224-3/en151224-3.html.

Digital Library

[23]

Panëels, S. and Strachan, S. Exploring Interactions with a Flexible Tactile Device for Multi-Context Interaction. Extended Abstracts on Human Factors in Computing Systems, (2016), 2632--2639.

Digital Library

[24]

Perrault, S.T., Lecolinet, Eagan, J., and Guiard, Y. Watchit: simple gestures and eyes-free interaction for wristwatches and bracelets. SIGCHI Conference on Human Factors in Computing Systems, (2013), 1451--1460.

Digital Library

[25]

Strohmeier, P., Vertegaal, R., and Girouard, A. With a flick of the wrist: Stretch Sensors as Lightweight Input for Mobile Devices. Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction - TEI '12, (2012), 307.

Digital Library

[26]

Sugiura, Y., Inami, M., and Igarashi, T. A thin stretchable interface for tangential force measurement. User Interface Software and Technology, (2012), 529--536.

Digital Library

[27]

Tarun, A.P., Burleson, W., Environments, M., Lahey, B., Girouard, A., and Vertegaal, R. Snaplet?: Using Body Shape to Inform Function in Mobile Flexible Display Devices. (2011), 329--334.

Digital Library

[28]

Under Armor Inc. Under Armour UA Band | Sleep Fitness Tracker | US. 2016. https://www.underarmour.com/en-us/ua-band.

[29]

Wessely, M., Tsandilas, T., and Mackay, W.E. Stretchis?: Fabricating Highly Stretchable User Interfaces. User Interface Software and Technology, (2016), 697--704.

Digital Library

Cited By

Borah PSorathia K(2023)Investigating user performance and preference for two magnitude levels of size and angle of bend on a smartphone-sized flexible deviceBehaviour & Information Technology10.1080/0144929X.2023.2245062(1-27)Online publication date: 13-Sep-2023
https://doi.org/10.1080/0144929X.2023.2245062
Yin JWu MBai SLiu HWei S(2023)A scrolling performance model based on two-dimensional touch peephole interactionsBehaviour & Information Technology10.1080/0144929X.2023.222677743:9(1758-1768)Online publication date: 20-Jun-2023
https://doi.org/10.1080/0144929X.2023.2226777
van Berkel NMerritt TBruun ASkov M(2022)Tangible Self-Report Devices: Accuracy and Resolution of Participant InputProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501309(1-14)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501309
Show More Cited By

Index Terms

Exploring Eyes-free Interaction with Wrist-Worn Deformable Materials
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Watchit: simple gestures and eyes-free interaction for wristwatches and bracelets
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We present WatchIt, a prototype device that extends interaction beyond the watch surface to the wristband, and two interaction techniques for command selection and execution. Because the small screen of wristwatch computers suffers from visual occlusion ...
Exploring Interaction with a Simulated Wrist-Worn Projection Display
ISWC '05: Proceedings of the Ninth IEEE International Symposium on Wearable Computers

One of the major limitations of portable computing devices is the small size of their built-in displays. Fortunately, extremely small projection systems are being developed that can be integrated into devices that are small enough to be body-worn, yet ...
Deformable tangible slider for eyes-free one-handed thumb interaction on mobile devices
IHM '17: Proceedings of the 29th Conference on l'Interaction Homme-Machine

Graphical sliders are widely used on mobile devices. However, with a single hand, reaching for far values is difficult : users change their grip and can drop the device. Moreover, sliders require visual attention to operate them. Envisioning mobile ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '17: Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction

March 2017

806 pages

ISBN:9781450346764

DOI:10.1145/3024969

General Chairs:
Masa Inakage
Masa Inakage, Keio University, Japan
,
Hiroshi Ishii
Massachusetts Institute of Technology, USA
,
Ellen Yi-Luen Do
National University of Singapore, Singapore
,
Program Chairs:
Jürgen Steimle
Saarland University, Germany
,
Orit Shaer
Wellesley College, Massachusetts, USA
,
Kai Kunze
Keio University, Japan
,
Publications Chair:
Roshan Peiris
Keio University, Japan

Copyright © 2017 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 March 2017

Check for updates

Author Tags

Qualifiers

Work in progress

Funding Sources

Natural Sciences and Engineering Research Council of Canada

Conference

TEI '17

Sponsor:

SIGCHI

TEI '17: Eleventh International Conference on Tangible, Embedded, and Embodied Interaction

March 20 - 23, 2017

Yokohama, Japan

Acceptance Rates

TEI '17 Paper Acceptance Rate 41 of 151 submissions, 27%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
331
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)3

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Borah PSorathia K(2023)Investigating user performance and preference for two magnitude levels of size and angle of bend on a smartphone-sized flexible deviceBehaviour & Information Technology10.1080/0144929X.2023.2245062(1-27)Online publication date: 13-Sep-2023
https://doi.org/10.1080/0144929X.2023.2245062
Yin JWu MBai SLiu HWei S(2023)A scrolling performance model based on two-dimensional touch peephole interactionsBehaviour & Information Technology10.1080/0144929X.2023.222677743:9(1758-1768)Online publication date: 20-Jun-2023
https://doi.org/10.1080/0144929X.2023.2226777
van Berkel NMerritt TBruun ASkov M(2022)Tangible Self-Report Devices: Accuracy and Resolution of Participant InputProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501309(1-14)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501309
Borah PSeth JSorathia K(2021)Gesture Action Mapping for Deformation-based One-handed Landscape Mode Interaction with Flexible Smartphone-sized DevicesProceedings of the 12th Indian Conference on Human-Computer Interaction10.1145/3506469.3506470(1-10)Online publication date: 19-Nov-2021
https://dl.acm.org/doi/10.1145/3506469.3506470
Everitt AEady AGirouard A(2021)Enabling Multi-Material 3D Printing for Designing and Rapid Prototyping of Deformable and Interactive WearablesProceedings of the 20th International Conference on Mobile and Ubiquitous Multimedia10.1145/3490632.3490635(1-11)Online publication date: 5-Dec-2021
https://dl.acm.org/doi/10.1145/3490632.3490635
Wong PZhu KYang XFu HBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Exploring Eyes-free Bezel-initiated Swipe on Round SmartwatchesProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376393(1-11)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376393
Nanjappan VShi RLiang HLau KYue YAtkinson K(2019)Towards a Taxonomy for In-Vehicle Interactions Using Wearable Smart Textiles: Insights from a User-Elicitation StudyMultimodal Technologies and Interaction10.3390/mti30200333:2(33)Online publication date: 9-May-2019
https://doi.org/10.3390/mti3020033
Nanjappan VShi RLiang HXiao HLau KHasan K(2019)Design of Interactions for Handheld Augmented Reality Devices Using Wearable Smart Textiles: Findings from a User Elicitation StudyApplied Sciences10.3390/app91531779:15(3177)Online publication date: 5-Aug-2019
https://doi.org/10.3390/app9153177

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten