skip to main content
10.1145/3675095.3676612acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
short-paper
Open access

Integrating Force Sensing with Electro-Tactile Feedback in 3D Printed Haptic Interfaces

Published: 05 October 2024 Publication History

Abstract

Tactile feedback mechanisms enhance the user experience of modern wearables by stimulating the sense of touch and enabling intuitive interactions. Electro-tactile stimulation-based tactile interfaces stand out due to their compact form factor and ability to deliver localized tactile sensations. Integrating force sensing with electro-tactile stimulation creates more responsive bidirectional systems that are beneficial in applications requiring precise control and feedback. However, current research often relies on separate sensors for force sensing, increasing system complexity and raising challenges in system scalability. We propose a novel approach that utilizes 3D-printed modified surfaces as the electro-tactile electrode interface to sense applied force and deliver feedback simultaneously without additional sensors. This method simplifies the system, maintains flexibility, and leverages the rapid prototyping capabilities of 3D printing. The functionality of this approach is validated through a user study (N=10), and two practical applications are proposed, both incorporating simultaneous sensing and tactile feedback.

References

[1]
Marta G. Carcedo, Soon Hau Chua, Simon Perrault, Paweł Wozniak, Raj Joshi, Mohammad Obaid, Morten Fjeld, and Shengdong Zhao. 2016. HaptiColor: Interpolating Color Information as Haptic Feedback to Assist the Colorblind. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 3572--3583. https://doi.org/10.1145/2858036.2858220
[2]
Heather Culbertson, Samuel B Schorr, and Allison M Okamura. 2018. Haptics: The present and future of artificial touch sensation. Annual Review of Control, Robotics, and Autonomous Systems, Vol. 1 (2018), 385--409.
[3]
Artem Dementyev, Alex Olwal, and Richard F. Lyon. 2020. Haptics with Input: Back-EMF in Linear Resonant Actuators to Enable Touch, Pressure and Environmental Awareness. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST '20). Association for Computing Machinery, New York, NY, USA, 420--429. https://doi.org/10.1145/3379337.3415823
[4]
Daniel Groeger, Martin Feick, Anusha Withana, and Jürgen Steimle. 2019. Tactlets: Adding Tactile Feedback to 3D Objects Using Custom Printed Controls. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 923--936. https://doi.org/10.1145/3332165.3347937
[5]
James Hallam. 2015. Haptic mirror therapy glove: aiding the treatment of a paretic limb after a stroke. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers (Osaka, Japan) (UbiComp/ISWC'15 Adjunct). Association for Computing Machinery, New York, NY, USA, 459--464. https://doi.org/10.1145/2800835.2801648
[6]
Vincent Hayward, Oliver R Astley, Manuel Cruz-Hernandez, Danny Grant, and Gabriel Robles-De-La-Torre. 2004. Haptic interfaces and devices. Sensor review, Vol. 24, 1 (2004), 16--29.
[7]
Arata Jingu, Nihar Sabnis, Paul Strohmeier, and Jürgen Steimle. 2024. Shaping Compliance: Inducing Haptic Illusion of Compliance in Different Shapes with Electrotactile Grains. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '24). Association for Computing Machinery, New York, NY, USA, Article 432, 13 pages. https://doi.org/10.1145/3613904.3641907
[8]
Hiroyuki Kajimoto. 2021. Electro-Tactile Display Kit for Fingertip. In 2021 IEEE World Haptics Conference (WHC). 587--587. https://doi.org/10.1109/WHC49131.2021.9517192
[9]
Hiroyuki Kajimoto, Naoki Kawakami, Taro Maeda, and Susumu Tachi. 2001. Electro-tactile display with force feedback. In Proc. World Multiconference on Systemics, Cybernetics and Informatics (SCI2001), Vol. 11. 95--99.
[10]
Hiroyuki Kajimoto, Naoki Kawakami, T Maeda, and S Tachi. 2004. Electro-tactile display with tactile primary color approach. Graduate School of Information and Technology, The University of Tokyo (2004).
[11]
Hiroyuki Kajimoto, Masaki Suzuki, and Yonezo Kanno. 2014. HamsaTouch: tactile vision substitution with smartphone and electro-tactile display. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI EA '14). Association for Computing Machinery, New York, NY, USA, 1273--1278. https://doi.org/10.1145/2559206.2581164
[12]
Johan Kildal. 2010. 3D-press: haptic illusion of compliance when pressing on a rigid surface. In International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction (Beijing, China) (ICMI-MLMI '10). Association for Computing Machinery, New York, NY, USA, Article 21, 8 pages. https://doi.org/10.1145/1891903.1891931
[13]
Panagiotis Kourtesis, Ferran Argelaguet, Sebastian Vizcay, Maud Marchal, and Claudio Pacchierotti. 2022. Electrotactile feedback applications for hand and arm interactions: A systematic review, meta-analysis, and future directions. IEEE transactions on haptics, Vol. 15, 3 (2022), 479--496.
[14]
K.J. Kuchenbecker, J. Fiene, and G. Niemeyer. 2006. Improving contact realism through event-based haptic feedback. IEEE Transactions on Visualization and Computer Graphics, Vol. 12, 2 (2006), 219--230. https://doi.org/10.1109/TVCG.2006.32
[15]
David Ledo, Fraser Anderson, Ryan Schmidt, Lora Oehlberg, Saul Greenberg, and Tovi Grossman. 2017. Pineal: Bringing Passive Objects to Life with Embedded Mobile Devices. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 2583--2593. https://doi.org/10.1145/3025453.3025652
[16]
Simon Olberding, Sergio Soto Ortega, Klaus Hildebrandt, and Jürgen Steimle. 2015. Foldio: Digital Fabrication of Interactive and Shape-Changing Objects With Foldable Printed Electronics. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST '15). Association for Computing Machinery, New York, NY, USA, 223--232. https://doi.org/10.1145/2807442.2807494
[17]
Daniel Pamungkas and Koren Ward. 2015. Electro-tactile feedback system for a prosthetic hand. (2015).
[18]
Daniel Pamungkas and Koren Ward. 2015. Immersive teleoperation of a robot arm using electro-tactile feedback. In 2015 6th International Conference on Automation, Robotics and Applications (ICARA). 300--305. https://doi.org/10.1109/ICARA.2015.7081164
[19]
Daniel Pamungkas and Koren Ward. 2015. Tactile sensing system using electro-tactile feedback. In 2015 6th International Conference on Automation, Robotics and Applications (ICARA). IEEE, 295--299.
[20]
Daniel Sutopo Pamungkas and Koren Ward. 2016. Electro-tactile feedback system to enhance virtual reality experience. (2016).
[21]
Patrick Parzer, Adwait Sharma, Anita Vogl, Jürgen Steimle, Alex Olwal, and Michael Haller. 2017. SmartSleeve: Real-time Sensing of Surface and Deformation Gestures on Flexible, Interactive Textiles, using a Hybrid Gesture Detection Pipeline. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST '17). Association for Computing Machinery, New York, NY, USA, 565--577. https://doi.org/10.1145/3126594.3126652
[22]
Rajni V Patel, S Farokh Atashzar, and Mahdi Tavakoli. 2022. Haptic feedback and force-based teleoperation in surgical robotics. Proc. IEEE, Vol. 110, 7 (2022), 1012--1027.
[23]
Bernd Petzold, Michael F Zaeh, Berthold Faerber, Barbara Deml, Hans Egermeier, Johannes Schilp, and Stella Clarke. 2004. A study on visual, auditory, and haptic feedback for assembly tasks. Presence: Teleoperators & Virtual Environments, Vol. 13, 1 (2004), 16--21.
[24]
Henning Pohl and Kasper Hornbæk. 2018. ElectricItch: Skin Irritation as a Feedback Modality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST '18). Association for Computing Machinery, New York, NY, USA, 765--778. https://doi.org/10.1145/3242587.3242647
[25]
Gabriel Reyes, Dingtian Zhang, Sarthak Ghosh, Pratik Shah, Jason Wu, Aman Parnami, Bailey Bercik, Thad Starner, Gregory D. Abowd, and W. Keith Edwards. 2016. Whoosh: non-voice acoustics for low-cost, hands-free, and rapid input on smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (Heidelberg, Germany) (ISWC '16). Association for Computing Machinery, New York, NY, USA, 120--127. https://doi.org/10.1145/2971763.2971765
[26]
Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). Association for Computing Machinery, New York, NY, USA, 483--492. https://doi.org/10.1145/2207676.2207743
[27]
Valkyrie Savage, Ryan Schmidt, Tovi Grossman, George Fitzmaurice, and Björn Hartmann. 2014. A series of tubes: adding interactivity to 3D prints using internal pipes. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST '14). Association for Computing Machinery, New York, NY, USA, 3--12. https://doi.org/10.1145/2642918.2647374
[28]
Martin Schmitz, Mohammadreza Khalilbeigi, Matthias Balwierz, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2015. Capricate: A Fabrication Pipeline to Design and 3D Print Capacitive Touch Sensors for Interactive Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST '15). Association for Computing Machinery, New York, NY, USA, 253--258. https://doi.org/10.1145/2807442.2807503
[29]
Kristen Shinohara and Jacob O. Wobbrock. 2011. In the shadow of misperception: assistive technology use and social interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). Association for Computing Machinery, New York, NY, USA, 705--714. https://doi.org/10.1145/1978942.1979044
[30]
Peter B Shull and Dana D Damian. 2015. Haptic wearables as sensory replacement, sensory augmentation and trainer--a review. Journal of neuroengineering and rehabilitation, Vol. 12 (2015), 1--13.
[31]
Paul Strohmeier, Seref Güngör, Luis Herres, Dennis Gudea, Bruno Fruchard, and Jürgen Steimle. 2020. bARefoot: Generating Virtual Materials using Motion Coupled Vibration in Shoes. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST '20). Association for Computing Machinery, New York, NY, USA, 579--593. https://doi.org/10.1145/3379337.3415828
[32]
Taiki Takami, Taiga Saito, Takayuki Kameoka, and Hiroyuki Kajimoto. 2023. ExtEdge: Haptic Augmentation of Visual Experiences of a Smartphone by Electro-Tactile Sensation Through the Edges. In Proceedings of the 2023 ACM Symposium on Spatial User Interaction (Sydney, NSW, Australia) (SUI '23). Association for Computing Machinery, New York, NY, USA, Article 7, 8 pages. https://doi.org/10.1145/3607822.3614543
[33]
Seiya Takei, Ryo Watanabe, Ryuta Okazaki, Taku Hachisu, and Hiroyuki Kajimoto. 2015. Presentation of softness using film-type electro-tactile display and pressure distribution measurement. Haptic Interaction: Perception, Devices and Applications (2015), 91--96.
[34]
Mayuko Tezuka, Norihide Kitamura, and Norihisa Miki. 2015. Micro-needle electro-tactile display. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 5781--5784. https://doi.org/10.1109/EMBC.2015.7319706
[35]
Keigo Ushiyama and Pedro Lopes. 2023. FeetThrough: Electrotactile Foot Interface that Preserves Real-World Sensations. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (San Francisco, CA, USA) (UIST '23). Association for Computing Machinery, New York, NY, USA, Article 10, 11 pages. https://doi.org/10.1145/3586183.3606808
[36]
Myla van Wegen, Just L Herder, Rolf Adelsberger, Manuela Pastore-Wapp, Erwin EH Van Wegen, Stephan Bohlhalter, Tobias Nef, Paul Krack, and Tim Vanbellingen. 2023. An overview of wearable haptic technologies and their performance in virtual object exploration. Sensors, Vol. 23, 3 (2023), 1563.
[37]
Martin Weigel and Jürgen Steimle. 2017. Deformwear: Deformation input on tiny wearable devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 1, 2 (2017), 1--23.
[38]
Anusha Withana. 2023. Co-Designing Personalized Assistive Devices Using Personal Fabrication. Commun. ACM, Vol. 66, 7 (jun 2023), 89--90. https://doi.org/10.1145/3589150
[39]
Anusha Withana, Daniel Groeger, and Jürgen Steimle. 2018. Tacttoo: A Thin and Feel-Through Tattoo for On-Skin Tactile Output. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST '18). Association for Computing Machinery, New York, NY, USA, 365--378. https://doi.org/10.1145/3242587.3242645
[40]
Chien-Min Wu, Chih-Wen Hsu, Tzu-Kuei Lee, and Shana Smith. 2017. A virtual reality keyboard with realistic haptic feedback in a fully immersive virtual environment. Virtual Reality, Vol. 21 (2017), 19--29.
[41]
Sang Ho Yoon, Siyuan Ma, Woo Suk Lee, Shantanu Thakurdesai, Di Sun, Flávio P. Ribeiro, and James D. Holbery. 2019. HapSense: A Soft Haptic I/O Device with Uninterrupted Dual Functionalities of Force Sensing and Vibrotactile Actuation. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 949--961. https://doi.org/10.1145/3332165.3347888
[42]
Jiakun Yu, Praneeth Bimsara Perera, Rahal Viddusha Perera, Mohammad Mirkhalaf Valashani, and Anusha Withana. 2024. Fabricating Customizable 3-D Printed Pressure Sensors by Tuning Infill Characteristics. IEEE Sensors Journal, Vol. 24, 6 (2024), 7604--7613. https://doi.org/10.1109/JSEN.2024.3358330

Index Terms

  1. Integrating Force Sensing with Electro-Tactile Feedback in 3D Printed Haptic Interfaces

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ISWC '24: Proceedings of the 2024 ACM International Symposium on Wearable Computers
    October 2024
    164 pages
    ISBN:9798400710599
    DOI:10.1145/3675095
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 October 2024

    Check for updates

    Author Tags

    1. 3d printing
    2. electro-tactile
    3. force sensing
    4. haptic

    Qualifiers

    • Short-paper

    Funding Sources

    • Australian Research Council Discovery Early Career Award (DECRA)
    • Neurodisability Assist Trust and Cerebral Palsy Alliance, Australia

    Conference

    UbiComp '24

    Acceptance Rates

    Overall Acceptance Rate 38 of 196 submissions, 19%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 334
      Total Downloads
    • Downloads (Last 12 months)334
    • Downloads (Last 6 weeks)87
    Reflects downloads up to 01 Mar 2025

    Other Metrics

    Citations

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media