research-article

FlexTouch: Enabling Large-Scale Interaction Sensing Beyond Touchscreens Using Flexible and Conductive Materials

Authors:

Tengxiang Zhang,

Yuanchun ShiAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 3, Issue 3

Article No.: 109, Pages 1 - 20

https://doi.org/10.1145/3351267

Published: 09 September 2019 Publication History

Abstract

In this paper, we present FlexTouch, a technique that enables large-scale interaction sensing beyond the spatial constraints of capacitive touchscreens using passive low-cost conductive materials. This is achieved by customizing 2D circuit-like patterns with an array of conductive strips that can be easily attached to the sensing nodes on the edge of the touchscreen. FlexTouch requires no hardware modification, and is compatible with various conductive materials (copper foil tape, silver nanoparticle ink, ITO frames, and carbon paint), as well as fabrication methods (cutting, coating, and ink-jet printing). Through a series of studies and illustrative examples, we demonstrate that FlexTouch can support long-range touch sensing for up to 4 meters and everyday object presence detection for up to 2 meters. Finally, we show the versatility and feasibility of FlexTouch through applications such as body posture recognition, human-object interaction as well as enhanced fitness training experiences.

Supplementary Material

wang (wang.zip)

Supplemental movie, appendix, image and software files for, FlexTouch: Enabling Large-Scale Interaction Sensing Beyond Touchscreens Using Flexible and Conductive Materials

Download
208.29 MB

References

[1]

Liwei Chan, Stefanie Müller, Anne Roudaut, and Patrick Baudisch. 2012. CapStones and ZebraWidgets: Sensing Stacks of Building Blocks, Dials and Sliders on Capacitive Touch Screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2189--2192.

Digital Library

[2]

Jerry Alan Fails and Dan Olsen Jr. 2002. Light Widgets: Interacting in Every-day Spaces. In Proceedings of the 7th International Conference on Intelligent User Interfaces (IUI '02). ACM, New York, NY, USA, 63--69.

Digital Library

[3]

Chuhan Gao, Xinyu Zhang, and Suman Banerjee. 2018. Conductive Inkjet Printed Passive 2D TrackPad for VR Interaction. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking, MobiCom 2018, New Delhi, India, October 29 - November 02, 2018. 83--98.

Digital Library

[4]

Nan-Wei Gong, Jürgen Steimle, Simon Olberding, Steve Hodges, Nicholas Edward Gillian, Yoshihiro Kawahara, and Joseph A. Paradiso. 2014. PrintSense: A Versatile Sensing Technique to Support Multimodal Flexible Surface Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1407--1410.

Digital Library

[5]

Tobias Grosse-Puppendahl, Christian Holz, Gabe Cohn, Raphael Wimmer, Oskar Bechtold, Steve Hodges, Matthew S. Reynolds, and Joshua R. Smith. 2017. Finding Common Ground: A Survey of Capacitive Sensing in Human-Computer Interaction. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3293--3315.

Digital Library

[6]

Anhong Guo, Robert Xiao, and Chris Harrison. 2015. CapAuth: Identifying and Differentiating User Handprints on Commodity Capacitive Touchscreens. Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces - ITS '15 (2015), 59--62.

Digital Library

[7]

Chris Harrison and Scott E. Hudson. 2008. Scratch Input: Creating Large, Inexpensive, Unpowered and Mobile Finger Input Surfaces. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). ACM, New York, NY, USA, 205--208.

Digital Library

[8]

Christian Holz, Senaka Buthpitiya, and Marius Knaust. 2015. Bodyprint: Biometric User Identification on Mobile Devices Using the Capacitive Touchscreen to Scan Body Parts. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3011--3014.

Digital Library

[9]

Kaori Ikematsu and Itiro Siio. 2018. Ohmic-Touch: Extending Touch Interaction by Indirect Touch Through Resistive Objects. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 521, 8 pages.

Digital Library

[10]

Kunihiro Kato and Homei Miyashita. 2015. Creating a Mobile Head-mounted Display with Proprietary Controllers for Interactive Virtual Reality Content. Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST '15 Adjunct (2015), 35--36.

Digital Library

[11]

Kunihiro Kato and Homei Miyashita. 2015. ExtensionSticker: A Proposal for a Striped Pattern Sticker to Extend Touch Interfaces and Its Assessment. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1851--1854.

Digital Library

[12]

Kunihiro Kato and Homei Miyashita. 2016. 3D Printed Physical Interfaces That Can Extend Touch Devices. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16 Adjunct). ACM, New York, NY, USA, 47--49.

Digital Library

[13]

Yoshihiro Kawahara, Steve Hodges, Benjamin S. Cook, Cheng Zhang, and Gregory D. Abowd. 2013. Instant Inkjet Circuits: Lab-based Inkjet Printing to Support Rapid Prototyping of UbiComp Devices. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '13). ACM, New York, NY, USA, 363--372.

Digital Library

[14]

Huy Viet Le, Thomas Kosch, Patrick Bader, Sven Mayer, and Niels Henze. 2018. PalmTouch: Using the Palm As an Additional Input Modality on Commodity Smartphones. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 360, 13 pages.

Digital Library

[15]

Simon Olberding, Nan-Wei Gong, John Tiab, Joseph A. Paradiso, and Jürgen Steimle. 2013. A Cuttable Multi-touch Sensor. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 245--254.

Digital Library

[16]

Simon Olberding, Sergio Soto Ortega, Klaus Hildebrandt, and Jürgen Steimle. 2015. Foldio: Digital Fabrication of Interactive and Shape-Changing Objects With Foldable Printed Electronics. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST '15). ACM, New York, NY, USA, 223--232.

Digital Library

[17]

Simon Olberding, Michael Wessely, and Jürgen Steimle. 2014. PrintScreen: Fabricating Highly Customizable Thin-film Touch-displays. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 281--290.

Digital Library

[18]

Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2013. Touch and Activate: Adding Interactivity to Existing Objects Using Active Acoustic Sensing. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 31--40.

Digital Library

[19]

Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2014. A Rapid Prototyping Toolkit for Touch Sensitive Objects Using Active Acoustic Sensing. In Proceedings of the Adjunct Publication of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST'14 Adjunct). ACM, New York, NY, USA, 35--36.

Digital Library

[20]

Joseph A. Paradiso, Che King Leo, Nisha Checka, and Kaijen Hsiao. 2002. Passive Acoustic Knock Tracking for Interactive Windows. In CHI '02 Extended Abstracts on Human Factors in Computing Systems (CHI EA '02). ACM, New York, NY, USA, 732--733.

Digital Library

[21]

Claudio Pinhanez. 2001. The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces. In Ubicomp 2001: Ubiquitous Computing, Gregory D. Abowd, Barry Brumitt, and Steven Shafer (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 315--331.

Digital Library

[22]

Jun Rekimoto. 2002. SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02). ACM, New York, NY, USA, 113--120.

Digital Library

[23]

Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touché: Enhancing Touch Interaction on Humans, Screens, Liquids, and Everyday Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 483--492.

Digital Library

[24]

Valkyrie Savage, Xiaohan Zhang, and Björn Hartmann. 2012. Midas: Fabricating Custom Capacitive Touch Sensors to Prototype Interactive Objects. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 579--588.

Digital Library

[25]

Martin Schmitz, Martin Herbers, Niloofar Dezfuli, Sebastian Günther, and Max Mühlhäuser. 2018. Off-Line Sensing: Memorizing Interactions in Passive 3D-Printed Objects. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 182, 8 pages.

Digital Library

[26]

Martin Schmitz, Urgen Steimle, Jochen Huber, Niloofar Dezfuli, and Max Uhlhäuser. 2017. Flexibles: Deformation-Aware 3D-Printed Tangibles for Capacitive Touchscreens. CHI '17 Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (2017), 1001--1014.

Digital Library

[27]

Alien Technology. 2018. ITO manufacture. http://www.h-nxc.com/.

[28]

Nirzaree Vadgama and Jürgen Steimle. 2017. Flexy: Shape-Customizable, Single-Layer, Inkjet Printable Patterns for 1D and 2D Flex Sensing. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI '17). ACM, New York, NY, USA, 153--162.

Digital Library

[29]

Andrew D. Wilson and Hrvoje Benko. 2010. Combining Multiple Depth Cameras and Projectors for Interactions on, Above and Between Surfaces. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). ACM, New York, NY, USA, 273--282.

Digital Library

[30]

Robert Xiao, Chris Harrison, and Scott E. Hudson. 2013. WorldKit: Rapid and Easy Creation of Ad-hoc Interactive Applications on Everyday Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 879--888.

Digital Library

[31]

Neng-Hao Yu, Sung-Sheng Tsai, I-Chun Hsiao, Dian-Je Tsai, Meng-Han Lee, Mike Y. Chen, and Yi-Ping Hung. 2011. Clip-on Gadgets: Expanding Multi-touch Interaction Area with Unpowered Tactile Controls. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 367--372.

Digital Library

[32]

Yang Zhang and Chris Harrison. 2018. Pulp Nonfiction: Low-Cost Touch Tracking for Paper. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 117, 11 pages.

Digital Library

[33]

Yang Zhang, Gierad Laput, and Chris Harrison. 2017. Electrick: Low-Cost Touch Sensing Using Electric Field Tomography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1--14.

Digital Library

[34]

Yang Zhang, Chouchang (Jack) Yang, Scott E. Hudson, Chris Harrison, and Alanson Sample. 2018. Wall++: Room-Scale Interactive and Context-Aware Sensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 273, 15 pages.

Digital Library

Cited By

Wang ZHuang CYao X(2024)A Roadmap of Explainable Artificial Intelligence: Explain to Whom, When, What and How?ACM Transactions on Autonomous and Adaptive Systems10.1145/370200419:4(1-40)Online publication date: 5-Nov-2024
https://dl.acm.org/doi/10.1145/3702004
Buechley LBustos A(2024)Characteristics of Conductive Paints and Tapes for Interactive MuralsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785878:3(1-34)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678587
Ye QYong ZHan BYen CZheng C(2024)PaperTouch: Tangible Interfaces through Paper Craft and Touchscreen DevicesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642571(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642571
Show More Cited By

Index Terms

FlexTouch: Enabling Large-Scale Interaction Sensing Beyond Touchscreens Using Flexible and Conductive Materials
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
  2. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

Capricate: A Fabrication Pipeline to Design and 3D Print Capacitive Touch Sensors for Interactive Objects
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

3D printing is widely used to physically prototype the look and feel of 3D objects. Interaction possibilities of these prototypes, however, are often limited to mechanical parts or post-assembled electronics. In this paper, we present Capricate, a ...
Hybrid gold-copper stamp for rapid fabrication of microchips

Graphical abstractDisplay Omitted Highlights We have developed simple and low-cost fabrication method of metal stamps. The stamps are intended for fast and cheap replication of microfluidic structures. Inherent metal hardness allows hundreds of ...
Lithographic sonication patterning of large area GaN nanopillar forests grown on a Si substrate

This paper presents lithographic sonication patterning, a highly-scalable, material-independent method for patterning nanopillar forests. Through contact lithography, patterns with dimensions down to 3m were written across a 3-inch silicon wafer with a ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 3, Issue 3

September 2019

1415 pages

EISSN:2474-9567

DOI:10.1145/3361560

Issue’s Table of Contents

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 September 2019

Published in IMWUT Volume 3, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
1,119
Total Downloads

Downloads (Last 12 months)94
Downloads (Last 6 weeks)15

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang ZHuang CYao X(2024)A Roadmap of Explainable Artificial Intelligence: Explain to Whom, When, What and How?ACM Transactions on Autonomous and Adaptive Systems10.1145/370200419:4(1-40)Online publication date: 5-Nov-2024
https://dl.acm.org/doi/10.1145/3702004
Buechley LBustos A(2024)Characteristics of Conductive Paints and Tapes for Interactive MuralsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785878:3(1-34)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678587
Ye QYong ZHan BYen CZheng C(2024)PaperTouch: Tangible Interfaces through Paper Craft and Touchscreen DevicesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642571(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642571
Kato KIkematsu KNakamura HSuzaki HIgarashi Y(2024)FoodSkin: Fabricating Edible Gold Leaf Circuits on Food SurfacesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642372(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642372
Shi YYi XLiang CQin YWang YYan YCheng ZZhu PZhang SLi YLiu YWang XChen JZhou WWang YZhao DDu F(2024)HCI Research and Innovation in China: A 10-Year PerspectiveInternational Journal of Human–Computer Interaction10.1080/10447318.2024.232385840:8(1799-1831)Online publication date: 22-Mar-2024
https://doi.org/10.1080/10447318.2024.2323858
Waghmare AParizi FHoffman JWang YThompson MPatel S(2023)GlucoScreenProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808557:1(1-20)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580855
Ikematsu KKato K(2023)ShiftTouch: Extending Touchscreens with Passive Interfaces using Small Occluded Area for Discrete Touch InputProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572742(1-15)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3572742
Zhang YWu DHagen LSong IMostafa JOh SAnderson TShah CBishop BHopfgartner FEckert KFederer LSaltz J(2023)Data science curriculum in the iFieldJournal of the Association for Information Science and Technology10.1002/asi.2470174:6(641-662)Online publication date: 3-May-2023
https://dl.acm.org/doi/10.1002/asi.24701
Chen ZWang QBi YLin JYang WDeng CGuo SLiao M(2022)Analyzing Human Muscle State with Flexible SensorsJournal of Sensors10.1155/2022/52279552022(1-11)Online publication date: 11-Jul-2022
https://doi.org/10.1155/2022/5227955
Ishii AKato KIkematsu KKawahara YSiio I(2022)CircWood: Laser Printed Circuit Boards and Sensors for Affordable DIY WoodworkingProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501317(1-11)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501317
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents