skip to main content
10.1145/3474349.3480213acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
poster

Bendable Color ePaper Displays for Novel Wearable Applications and Mobile Visualization

Published: 10 October 2021 Publication History

Abstract

This paper presents a toolkit that allows to easily prototype with bendable color ePaper displays for designing and studying novel body-worn interfaces in mobile scenarios. We introduce a software and hardware platform that enables researchers for the first time to implement fully-functional wearable and UbiComp applications with interactive, curved color pixel displays. Further, we provide a set of visual and sensory-rich materials for customization and mounting options. To technically validate our approach and demonstrate its promising potential, we implemented eight real-world applications ranging from personal information and mobile data visualizations over active notifications to media controls. Finally, we report on first usage experiences and conclude with a research roadmap that outlines future applications and directions.

References

[1]
Adafruit. 2021 [Online]. Adafruit Feather nRF52840 Sense. Web: https://www.adafruit.com/product/4516. Accessed: 2021-05-16.
[2]
Adafruit. 2021 [Online]. Arduino Core for Adafruit Bluefruit nRF52 Boards. Web: https://github.com/adafruit/Adafruit_nRF52_Arduino. Accessed: 2021-05-16.
[3]
Adafruit. 2021 [Online]. GFX Library. Web: https://github.com/adafruit/Adafruit-GFX-Library. Accessed: 2021-05-16.
[4]
Apple. 2021 [Online]. Apple Notification Center Service (ANCS) Specification. Web: https://developer.apple.com/library/archive/documentation/CoreBluetooth/Reference/AppleNotificationCenterServiceSpecification/. Accessed: 2021-05-16.
[5]
Arduino. 2021 [Online]. Arduino.cc - Open-source electronic prototyping platform. Web: https://www.arduino.cc. Accessed: 2021-05-16.
[6]
Tanja Blascheck, Lonni Besançon, Anastasia Bezerianos, Bongshin Lee, and Petra Isenberg. 2019. Glanceable Visualization: Studies of Data Comparison Performance on Smartwatches. IEEE Transactions on Visualization and Computer Graphics 25, 1(2019), 630–640. https://doi.org/10.1109/TVCG.2018.2865142
[7]
Bosch Sensortec. 2021 [Online]. BMP280 Sensor - Absolute barometric pressure sensor. Web: https://www.bosch-sensortec.com/products/environmental-sensors/pressure-sensors/bmp280/. Accessed: 2021-05-16.
[8]
Broadcom. 2021 [Online]. APDS-9960 - Digital RGB, Ambient Light, Proximity and Gesture Sensor. Web: https://www.broadcom.com/products/optical-sensors/integrated-ambient-light-and-proximity-sensors/apds-9960. Accessed: 2021-06-20.
[9]
Jesse Burstyn, Paul Strohmeier, and Roel Vertegaal. 2015. DisplaySkin: Exploring Pose-Aware Displays on a Flexible Electrophoretic Wristband. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (Stanford, California, USA) (TEI ’15). Association for Computing Machinery, New York, NY, USA, 165–172. https://doi.org/10.1145/2677199.2680596
[10]
Laura Devendorf, Joanne Lo, Noura Howell, Jung Lin Lee, Nan-Wei Gong, M. Emre Karagozler, Shiho Fukuhara, Ivan Poupyrev, Eric Paulos, and Kimiko Ryokai. 2016. ”I Don’t Want to Wear a Screen”: Probing Perceptions of and Possibilities for Dynamic Displays on Clothing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 6028–6039. https://doi.org/10.1145/2858036.2858192
[11]
Christine Dierk, Molly Jane Pearce Nicholas, and Eric Paulos. 2018. AlterWear: Battery-Free Wearable Displays for Opportunistic Interactions(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3173794
[12]
Steven M. Drucker, Danyel Fisher, Ramik Sadana, Jessica Herron, and m.c. schraefel. 2013. TouchViz: A Case Study Comparing Two Interfaces for Data Analytics on Tablets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 2301–2310. https://doi.org/10.1145/2470654.2481318
[13]
E Ink. 2021 [Online]. Advanced Color ePaper (ACeP)- E Ink Gallery Palette. Web: https://www.eink.com/color-technology.html. Accessed: 2021-05-16.
[14]
Jutta Fortmann, Erika Root, Susanne Boll, and Wilko Heuten. 2016. Tangible Apps Bracelet: Designing Modular Wrist-Worn Digital Jewellery for Multiple Purposes. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (Brisbane, QLD, Australia) (DIS ’16). Association for Computing Machinery, New York, NY, USA, 841–852. https://doi.org/10.1145/2901790.2901838
[15]
Anna Fuste and Chris Schmandt. 2018. ARTextiles for Promoting Social Interactions Around Personal Interests. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3170427.3188589
[16]
Antonio Gomes, Lahiru Lakmal Priyadarshana, Aaron Visser, Juan Pablo Carrascal, and Roel Vertegaal. 2018. Magicscroll: A Rollable Display Device with Flexible Screen Real Estate and Gestural Input. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (Barcelona, Spain) (MobileHCI ’18). Association for Computing Machinery, New York, NY, USA, Article 6, 11 pages. https://doi.org/10.1145/3229434.3229442
[17]
Antonio Gomes and Roel Vertegaal. 2015. PaperFold: Evaluating Shape Changes for Viewport Transformations in Foldable Thin-Film Display Devices. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (Stanford, California, USA) (TEI ’15). Association for Computing Machinery, New York, NY, USA, 153–160. https://doi.org/10.1145/2677199.2680572
[18]
Tobias Grosse-Puppendahl, Steve Hodges, Nicholas Chen, John Helmes, Stuart Taylor, James Scott, Josh Fromm, and David Sweeney. 2016. Exploring the Design Space for Energy-Harvesting Situated Displays. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 41–48. https://doi.org/10.1145/2984511.2984513
[19]
Ollie Hanton, Michael Wessely, Stefanie Mueller, Mike Fraser, and Anne Roudaut. 2020. ProtoSpray: Combining 3D Printing and Spraying to Create Interactive Displays with Arbitrary Shapes. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376543
[20]
Florian Heller and Kris Luyten. 2019. TaskHerder: A Wearable Minimal Interaction Interface for Mobile and Long-Lived Task Execution. In Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (Valencia, Spain) (EICS ’19). Association for Computing Machinery, New York, NY, USA, Article 4, 5 pages. https://doi.org/10.1145/3319499.3328226
[21]
Niels Henze, Alireza Sahami Shrazi, Albrecht Schmidt, Martin Pielot, and Florian Michahelles. 2013. Empirical Research through Ubiquitous Data Collection. Computer 46, 6 (June 2013), 74–76. https://doi.org/10.1109/MC.2013.202
[22]
David Holman, Jesse Burstyn, Ryan Brotman, Audrey Younkin, and Roel Vertegaal. 2013. Flexkit: A Rapid Prototyping Platform for Flexible Displays. In Proceedings of the Adjunct Publication of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13 Adjunct). Association for Computing Machinery, New York, NY, USA, 17–18. https://doi.org/10.1145/2508468.2514934
[23]
Alaul Islam, Anastasia Bezerianos, Bongshin Lee, Tanja Blascheck, and Petra Isenberg. 2020. Visualizing Information on Watch Faces: A Survey with Smartwatch Users. In 2020 IEEE Visualization Conference (VIS). 156–160. https://doi.org/10.1109/VIS47514.2020.00038
[24]
Pradthana Jarusriboonchai, Hong Li, Emmi Harjuniemi, Heiko Müller, and Jonna Häkkilä. 2020. Always with Me: Exploring Wearable Displays as a Lightweight Intimate Communication Channel. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction (Sydney NSW, Australia) (TEI ’20). Association for Computing Machinery, New York, NY, USA, 771–783. https://doi.org/10.1145/3374920.3375011
[25]
Yuhua Jin, Isabel Qamar, Michael Wessely, Aradhana Adhikari, Katarina Bulovic, Parinya Punpongsanon, and Stefanie Mueller. 2019. Photo-Chromeleon: Re-Programmable Multi-Color Textures Using Photochromic Dyes. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology(New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 701–712. https://doi.org/10.1145/3332165.3347905
[26]
Konstantin Klamka and Raimund Dachselt. 2017. IllumiPaper: Illuminated Interactive Paper. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5605–5618. https://doi.org/10.1145/3025453.3025525
[27]
Konstantin Klamka and Raimund Dachselt. 2018. ARCord: Visually Augmented Interactive Cords for Mobile Interaction. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3170427.3188456
[28]
Konstantin Klamka, Raimund Dachselt, and Jürgen Steimle. 2020. Rapid Iron-On User Interfaces: Hands-on Fabrication of Interactive Textile Prototypes. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376220
[29]
Konstantin Klamka, Tom Horak, and Raimund Dachselt. 2020. Watch+Strap: Extending Smartwatches with Interactive StrapDisplays. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376199
[30]
Byron Lahey, Audrey Girouard, Winslow Burleson, and Roel Vertegaal. 2011. PaperPhone: Understanding the Use of Bend Gestures in Mobile Devices with Flexible Electronic Paper Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 1303–1312. https://doi.org/10.1145/1978942.1979136
[31]
Plastic Logic. 2021 [Online]. 2.1” Legio Colour Display. Web: https://www.plasticlogic.com/?product=2-1-legio-colour-display. Accessed: 2021-06-20.
[32]
Plastic Logic. 2021 [Online]. Feather LegioTM / LectumTM Shield. Web: https://www.plasticlogic.com/?product=feather-nrf52840-express-for-2-1-legio-colour-display. Accessed: 2021-06-20.
[33]
Plastic Logic. 2021 [Online]. PL_smallEPD Arduino Library. Web: https://github.com/plasticlogic/PL_smallEPD. Accessed: 2021-06-20.
[34]
Matthew Mauriello, Michael Gubbels, and Jon E. Froehlich. 2014. Social Fabric Fitness: The Design and Evaluation of Wearable E-Textile Displays to Support Group Running. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 2833–2842. https://doi.org/10.1145/2556288.2557299
[35]
Ali Neshati, Bradley Rey, Ahmed Shariff Mohommed Faleel, Sandra Bardot, Celine Latulipe, and Pourang Irani. 2021. BezelGlide: Interacting with Graphs on Smartwatches with Minimal Screen Occlusion. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 501, 13 pages. https://doi.org/10.1145/3411764.3445201
[36]
Simon Olberding, Michael Wessely, and Jürgen Steimle. 2014. PrintScreen: Fabricating Highly Customizable Thin-Film Touch-Displays(UIST ’14). Association for Computing Machinery, New York, NY, USA, 281–290. https://doi.org/10.1145/2642918.2647413
[37]
Christian Rendl, David Kim, Patrick Parzer, Sean Fanello, Martin Zirkl, Gregor Scheipl, Michael Haller, and Shahram Izadi. 2016. FlexCase: Enhancing Mobile Interaction with a Flexible Sensing and Display Cover. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 5138–5150. https://doi.org/10.1145/2858036.2858314
[38]
Albrecht Schmidt, Florian Alt, and Ville Mäkelä. 2021. Evaluation in Human-Computer Interaction – Beyond Lab Studies. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 142, 4 pages. https://doi.org/10.1145/3411763.3445022
[39]
Nordic Semiconductor. 2021 [Online]. nRF52840 - System-on-Chip. Web: https://www.nordicsemi.com/Products/Low-power-short-range-wireless/nRF52840. Accessed: 2021-05-16.
[40]
Sensirion. 2021 [Online]. Digital Humidity Sensor SHT31. Web: https://www.sensirion.com/en/environmental-sensors/humidity-sensors/digital-humidity-sensors-for-various-applications/. Accessed: 2021-06-20.
[41]
Sony. 2019 [Online]. Sony FES Watch U - ePaper Fashion Watch. Web: https://www.sony.co.uk/electronics/fes-watch-u-collection/fes-wa1. Accessed: 2019-12-12.
[42]
STMicroelectronics. 2021 [Online]. LIS3MDL - Digital Output Magnetic Sensor. Web: https://www.st.com/en/mems-and-sensors/lis3mdl.html. Accessed: 2021-06-20.
[43]
STMicroelectronics. 2021 [Online]. LSM6DS33 - iNEMO Inertial Module. Web: https://www.st.com/en/mems-and-sensors/lsm6ds33.html. Accessed: 2021-05-16.
[44]
STMicroelectronics. 2021 [Online]. MP34DT01-M - Digital MEMS microphone. Web: https://www.st.com/en/audio-ics/mp34dt01-m.html. Accessed: 2021-06-20.
[45]
Paul Strohmeier, Jesse Burstyn, and Roel Vertegaal. 2015. Effects of Display Sizes on a Scrolling Task Using a Cylindrical Smartwatch. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Copenhagen, Denmark) (MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 846–853. https://doi.org/10.1145/2786567.2793710
[46]
David Sweeney, Nicholas Chen, Steve Hodges, and Tobias Grosse-Puppendahl. 2016. Displays as a Material: A Route to Making Displays More Pervasive. IEEE Pervasive Computing 15, 3 (2016), 77–82. https://doi.org/10.1109/MPRV.2016.56
[47]
Spectra Symbol. 2021 [Online]. Linear ThinPot, 50mm - TSP-L-0050-103-3%-ST. Web: https://www.spectrasymbol.com/product/thinpot/. Accessed: 2021-05-16.
[48]
Aneesh P. Tarun, Peng Wang, Audrey Girouard, Paul Strohmeier, Derek Reilly, and Roel Vertegaal. 2013. PaperTab: An Electronic Paper Computer with Multiple Large Flexible Electrophoretic Displays. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (Paris, France) (CHI EA ’13). Association for Computing Machinery, New York, NY, USA, 3131–3134. https://doi.org/10.1145/2468356.2479628
[49]
Ulrich von Zadow, Wolfgang Büschel, Ricardo Langner, and Raimund Dachselt. 2014. SleeD: Using a Sleeve Display to Interact with Touch-Sensitive Display Walls. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (Dresden, Germany) (ITS ’14). Association for Computing Machinery, New York, NY, USA, 129–138. https://doi.org/10.1145/2669485.2669507
[50]
Dirk Wenig, Florian Heller, and Johannes Schöning. 2016. StrapMaps: Bringing Map-Based Navigation to the Straps of Bags. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (Heidelberg, Germany) (UbiComp ’16). Association for Computing Machinery, New York, NY, USA, 225–228. https://doi.org/10.1145/2968219.2993411
[51]
Michael Wessely, Yuhua Jin, Cattalyya Nuengsigkapian, Aleksei Kashapov, Isabel P. S. Qamar, Dzmitry Tsetserukou, and Stefanie Mueller. 2021. ChromoUpdate: Fast Design Iteration of Photochromic Color Textures Using Grayscale Previews and Local Color Updates. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 666, 13 pages. https://doi.org/10.1145/3411764.3445391
[52]
Yuanyang Zhong, Tobias Isenberg, and Petra Isenberg. 2020. Black-and-White Textures for Visualization on E-ink Displays. Posters of IEEE Visualization. https://hal.inria.fr/hal-02944212 Poster.

Cited By

View all
  • (2024)Power-over-Skin: Full-Body Wearables Powered By Intra-Body RF EnergyProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676394(1-13)Online publication date: 13-Oct-2024
  • (2023)Demonstrating Thermotion: Design and Fabrication of Thermofluidic Composites for Animation Effects on Object SurfacesExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583907(1-5)Online publication date: 19-Apr-2023
  • (2023)Thermotion: Design and Fabrication of Thermofluidic Composites for Animation Effects on Object SurfacesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580743(1-19)Online publication date: 19-Apr-2023
  • Show More Cited By

Index Terms

  1. Bendable Color ePaper Displays for Novel Wearable Applications and Mobile Visualization
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Conferences
          UIST '21 Adjunct: Adjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology
          October 2021
          182 pages
          ISBN:9781450386555
          DOI:10.1145/3474349
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Sponsors

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 10 October 2021

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. ACeP
          2. Color
          3. E-Ink
          4. EPD
          5. HCI
          6. StrapDisplay
          7. bendable
          8. ePaper
          9. electrophoretic
          10. flexible
          11. mobileVis
          12. personal InfoVis
          13. toolkit
          14. wearable

          Qualifiers

          • Poster
          • Research
          • Refereed limited

          Funding Sources

          Conference

          UIST '21

          Acceptance Rates

          Overall Acceptance Rate 355 of 1,733 submissions, 20%

          Upcoming Conference

          UIST '25
          The 38th Annual ACM Symposium on User Interface Software and Technology
          September 28 - October 1, 2025
          Busan , Republic of Korea

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)51
          • Downloads (Last 6 weeks)1
          Reflects downloads up to 16 Feb 2025

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)Power-over-Skin: Full-Body Wearables Powered By Intra-Body RF EnergyProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676394(1-13)Online publication date: 13-Oct-2024
          • (2023)Demonstrating Thermotion: Design and Fabrication of Thermofluidic Composites for Animation Effects on Object SurfacesExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583907(1-5)Online publication date: 19-Apr-2023
          • (2023)Thermotion: Design and Fabrication of Thermofluidic Composites for Animation Effects on Object SurfacesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580743(1-19)Online publication date: 19-Apr-2023
          • (2022)FabricatINK: Personal Fabrication of Bespoke Displays Using Electronic Ink from Upcycled E ReadersProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501844(1-15)Online publication date: 29-Apr-2022

          View Options

          Login options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format.

          HTML Format

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media