Integrating Force Sensing with Electro-Tactile Feedback in 3D Printed Haptic Interfaces
Authors: 
Praneeth Bimsara Perera, Hansa Marasinghe, Taiki Takami, Hiroyuki Kajimoto, 
Anusha WithanaAuthors Info & Claims
Praneeth Bimsara Perera, Hansa Marasinghe, Taiki Takami, Hiroyuki Kajimoto, Anusha WithanaAuthors Info & ClaimsPages 48 - 54
Abstract
Tactile feedback mechanisms enhance the user experience of modern wearables by stimulating the sense of touch and enabling intuitive interactions. Electro-tactile stimulation-based tactile interfaces stand out due to their compact form factor and ability to deliver localized tactile sensations. Integrating force sensing with electro-tactile stimulation creates more responsive bidirectional systems that are beneficial in applications requiring precise control and feedback. However, current research often relies on separate sensors for force sensing, increasing system complexity and raising challenges in system scalability. We propose a novel approach that utilizes 3D-printed modified surfaces as the electro-tactile electrode interface to sense applied force and deliver feedback simultaneously without additional sensors. This method simplifies the system, maintains flexibility, and leverages the rapid prototyping capabilities of 3D printing. The functionality of this approach is validated through a user study (N=10), and two practical applications are proposed, both incorporating simultaneous sensing and tactile feedback.
References
[1]
Marta G. Carcedo, Soon Hau Chua, Simon Perrault, Paweł Wozniak, Raj Joshi, Mohammad Obaid, Morten Fjeld, and Shengdong Zhao. 2016. HaptiColor: Interpolating Color Information as Haptic Feedback to Assist the Colorblind. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 3572--3583. https://doi.org/10.1145/2858036.2858220
[2]
Heather Culbertson, Samuel B Schorr, and Allison M Okamura. 2018. Haptics: The present and future of artificial touch sensation. Annual Review of Control, Robotics, and Autonomous Systems, Vol. 1 (2018), 385--409.
[3]
Artem Dementyev, Alex Olwal, and Richard F. Lyon. 2020. Haptics with Input: Back-EMF in Linear Resonant Actuators to Enable Touch, Pressure and Environmental Awareness. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST '20). Association for Computing Machinery, New York, NY, USA, 420--429. https://doi.org/10.1145/3379337.3415823
[4]
Daniel Groeger, Martin Feick, Anusha Withana, and Jürgen Steimle. 2019. Tactlets: Adding Tactile Feedback to 3D Objects Using Custom Printed Controls. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 923--936. https://doi.org/10.1145/3332165.3347937
[5]
James Hallam. 2015. Haptic mirror therapy glove: aiding the treatment of a paretic limb after a stroke. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers (Osaka, Japan) (UbiComp/ISWC'15 Adjunct). Association for Computing Machinery, New York, NY, USA, 459--464. https://doi.org/10.1145/2800835.2801648
[6]
Vincent Hayward, Oliver R Astley, Manuel Cruz-Hernandez, Danny Grant, and Gabriel Robles-De-La-Torre. 2004. Haptic interfaces and devices. Sensor review, Vol. 24, 1 (2004), 16--29.
[7]
Arata Jingu, Nihar Sabnis, Paul Strohmeier, and Jürgen Steimle. 2024. Shaping Compliance: Inducing Haptic Illusion of Compliance in Different Shapes with Electrotactile Grains. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '24). Association for Computing Machinery, New York, NY, USA, Article 432, 13 pages. https://doi.org/10.1145/3613904.3641907
[8]
Hiroyuki Kajimoto. 2021. Electro-Tactile Display Kit for Fingertip. In 2021 IEEE World Haptics Conference (WHC). 587--587. https://doi.org/10.1109/WHC49131.2021.9517192
[9]
Hiroyuki Kajimoto, Naoki Kawakami, Taro Maeda, and Susumu Tachi. 2001. Electro-tactile display with force feedback. In Proc. World Multiconference on Systemics, Cybernetics and Informatics (SCI2001), Vol. 11. 95--99.
[10]
Hiroyuki Kajimoto, Naoki Kawakami, T Maeda, and S Tachi. 2004. Electro-tactile display with tactile primary color approach. Graduate School of Information and Technology, The University of Tokyo (2004).
[11]
Hiroyuki Kajimoto, Masaki Suzuki, and Yonezo Kanno. 2014. HamsaTouch: tactile vision substitution with smartphone and electro-tactile display. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI EA '14). Association for Computing Machinery, New York, NY, USA, 1273--1278. https://doi.org/10.1145/2559206.2581164
[12]
Johan Kildal. 2010. 3D-press: haptic illusion of compliance when pressing on a rigid surface. In International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction (Beijing, China) (ICMI-MLMI '10). Association for Computing Machinery, New York, NY, USA, Article 21, 8 pages. https://doi.org/10.1145/1891903.1891931
[13]
Panagiotis Kourtesis, Ferran Argelaguet, Sebastian Vizcay, Maud Marchal, and Claudio Pacchierotti. 2022. Electrotactile feedback applications for hand and arm interactions: A systematic review, meta-analysis, and future directions. IEEE transactions on haptics, Vol. 15, 3 (2022), 479--496.
[14]
K.J. Kuchenbecker, J. Fiene, and G. Niemeyer. 2006. Improving contact realism through event-based haptic feedback. IEEE Transactions on Visualization and Computer Graphics, Vol. 12, 2 (2006), 219--230. https://doi.org/10.1109/TVCG.2006.32
[15]
David Ledo, Fraser Anderson, Ryan Schmidt, Lora Oehlberg, Saul Greenberg, and Tovi Grossman. 2017. Pineal: Bringing Passive Objects to Life with Embedded Mobile Devices. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 2583--2593. https://doi.org/10.1145/3025453.3025652
[16]
Simon Olberding, Sergio Soto Ortega, Klaus Hildebrandt, and Jürgen Steimle. 2015. Foldio: Digital Fabrication of Interactive and Shape-Changing Objects With Foldable Printed Electronics. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST '15). Association for Computing Machinery, New York, NY, USA, 223--232. https://doi.org/10.1145/2807442.2807494
[17]
Daniel Pamungkas and Koren Ward. 2015. Electro-tactile feedback system for a prosthetic hand. (2015).
[18]
Daniel Pamungkas and Koren Ward. 2015. Immersive teleoperation of a robot arm using electro-tactile feedback. In 2015 6th International Conference on Automation, Robotics and Applications (ICARA). 300--305. https://doi.org/10.1109/ICARA.2015.7081164
[19]
Daniel Pamungkas and Koren Ward. 2015. Tactile sensing system using electro-tactile feedback. In 2015 6th International Conference on Automation, Robotics and Applications (ICARA). IEEE, 295--299.
[20]
Daniel Sutopo Pamungkas and Koren Ward. 2016. Electro-tactile feedback system to enhance virtual reality experience. (2016).
[21]
Patrick Parzer, Adwait Sharma, Anita Vogl, Jürgen Steimle, Alex Olwal, and Michael Haller. 2017. SmartSleeve: Real-time Sensing of Surface and Deformation Gestures on Flexible, Interactive Textiles, using a Hybrid Gesture Detection Pipeline. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST '17). Association for Computing Machinery, New York, NY, USA, 565--577. https://doi.org/10.1145/3126594.3126652
[22]
Rajni V Patel, S Farokh Atashzar, and Mahdi Tavakoli. 2022. Haptic feedback and force-based teleoperation in surgical robotics. Proc. IEEE, Vol. 110, 7 (2022), 1012--1027.
[23]
Bernd Petzold, Michael F Zaeh, Berthold Faerber, Barbara Deml, Hans Egermeier, Johannes Schilp, and Stella Clarke. 2004. A study on visual, auditory, and haptic feedback for assembly tasks. Presence: Teleoperators & Virtual Environments, Vol. 13, 1 (2004), 16--21.
[24]
Henning Pohl and Kasper Hornbæk. 2018. ElectricItch: Skin Irritation as a Feedback Modality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST '18). Association for Computing Machinery, New York, NY, USA, 765--778. https://doi.org/10.1145/3242587.3242647
[25]
Gabriel Reyes, Dingtian Zhang, Sarthak Ghosh, Pratik Shah, Jason Wu, Aman Parnami, Bailey Bercik, Thad Starner, Gregory D. Abowd, and W. Keith Edwards. 2016. Whoosh: non-voice acoustics for low-cost, hands-free, and rapid input on smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (Heidelberg, Germany) (ISWC '16). Association for Computing Machinery, New York, NY, USA, 120--127. https://doi.org/10.1145/2971763.2971765
[26]
Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). Association for Computing Machinery, New York, NY, USA, 483--492. https://doi.org/10.1145/2207676.2207743
[27]
Valkyrie Savage, Ryan Schmidt, Tovi Grossman, George Fitzmaurice, and Björn Hartmann. 2014. A series of tubes: adding interactivity to 3D prints using internal pipes. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST '14). Association for Computing Machinery, New York, NY, USA, 3--12. https://doi.org/10.1145/2642918.2647374
[28]
Martin Schmitz, Mohammadreza Khalilbeigi, Matthias Balwierz, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2015. Capricate: A Fabrication Pipeline to Design and 3D Print Capacitive Touch Sensors for Interactive Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST '15). Association for Computing Machinery, New York, NY, USA, 253--258. https://doi.org/10.1145/2807442.2807503
[29]
Kristen Shinohara and Jacob O. Wobbrock. 2011. In the shadow of misperception: assistive technology use and social interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). Association for Computing Machinery, New York, NY, USA, 705--714. https://doi.org/10.1145/1978942.1979044
[30]
Peter B Shull and Dana D Damian. 2015. Haptic wearables as sensory replacement, sensory augmentation and trainer--a review. Journal of neuroengineering and rehabilitation, Vol. 12 (2015), 1--13.
[31]
Paul Strohmeier, Seref Güngör, Luis Herres, Dennis Gudea, Bruno Fruchard, and Jürgen Steimle. 2020. bARefoot: Generating Virtual Materials using Motion Coupled Vibration in Shoes. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST '20). Association for Computing Machinery, New York, NY, USA, 579--593. https://doi.org/10.1145/3379337.3415828
[32]
Taiki Takami, Taiga Saito, Takayuki Kameoka, and Hiroyuki Kajimoto. 2023. ExtEdge: Haptic Augmentation of Visual Experiences of a Smartphone by Electro-Tactile Sensation Through the Edges. In Proceedings of the 2023 ACM Symposium on Spatial User Interaction (Sydney, NSW, Australia) (SUI '23). Association for Computing Machinery, New York, NY, USA, Article 7, 8 pages. https://doi.org/10.1145/3607822.3614543
[33]
Seiya Takei, Ryo Watanabe, Ryuta Okazaki, Taku Hachisu, and Hiroyuki Kajimoto. 2015. Presentation of softness using film-type electro-tactile display and pressure distribution measurement. Haptic Interaction: Perception, Devices and Applications (2015), 91--96.
[34]
Mayuko Tezuka, Norihide Kitamura, and Norihisa Miki. 2015. Micro-needle electro-tactile display. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 5781--5784. https://doi.org/10.1109/EMBC.2015.7319706
[35]
Keigo Ushiyama and Pedro Lopes. 2023. FeetThrough: Electrotactile Foot Interface that Preserves Real-World Sensations. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (San Francisco, CA, USA) (UIST '23). Association for Computing Machinery, New York, NY, USA, Article 10, 11 pages. https://doi.org/10.1145/3586183.3606808
[36]
Myla van Wegen, Just L Herder, Rolf Adelsberger, Manuela Pastore-Wapp, Erwin EH Van Wegen, Stephan Bohlhalter, Tobias Nef, Paul Krack, and Tim Vanbellingen. 2023. An overview of wearable haptic technologies and their performance in virtual object exploration. Sensors, Vol. 23, 3 (2023), 1563.
[37]
Martin Weigel and Jürgen Steimle. 2017. Deformwear: Deformation input on tiny wearable devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 1, 2 (2017), 1--23.
[38]
Anusha Withana. 2023. Co-Designing Personalized Assistive Devices Using Personal Fabrication. Commun. ACM, Vol. 66, 7 (jun 2023), 89--90. https://doi.org/10.1145/3589150
[39]
Anusha Withana, Daniel Groeger, and Jürgen Steimle. 2018. Tacttoo: A Thin and Feel-Through Tattoo for On-Skin Tactile Output. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST '18). Association for Computing Machinery, New York, NY, USA, 365--378. https://doi.org/10.1145/3242587.3242645
[40]
Chien-Min Wu, Chih-Wen Hsu, Tzu-Kuei Lee, and Shana Smith. 2017. A virtual reality keyboard with realistic haptic feedback in a fully immersive virtual environment. Virtual Reality, Vol. 21 (2017), 19--29.
[41]
Sang Ho Yoon, Siyuan Ma, Woo Suk Lee, Shantanu Thakurdesai, Di Sun, Flávio P. Ribeiro, and James D. Holbery. 2019. HapSense: A Soft Haptic I/O Device with Uninterrupted Dual Functionalities of Force Sensing and Vibrotactile Actuation. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 949--961. https://doi.org/10.1145/3332165.3347888
[42]
Jiakun Yu, Praneeth Bimsara Perera, Rahal Viddusha Perera, Mohammad Mirkhalaf Valashani, and Anusha Withana. 2024. Fabricating Customizable 3-D Printed Pressure Sensors by Tuning Infill Characteristics. IEEE Sensors Journal, Vol. 24, 6 (2024), 7604--7613. https://doi.org/10.1109/JSEN.2024.3358330
Index Terms
- Integrating Force Sensing with Electro-Tactile Feedback in 3D Printed Haptic Interfaces
Recommendations
Full-hand Electro-Tactile Feedback without Obstructing Palmar Side of Hand
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsWe present a technique to render tactile feedback to the palmar side of the hand while keeping it unobstructed and, thus, preserving manual dexterity during interactions with physical objects. We implement this by applying electro-tactile stimulation ...
Adaptation to Force in the Haptic Rendering of Virtual Environments
EuroHaptics '08: Proceedings of the 6th international conference on Haptics: Perception, Devices and ScenariosRealistic haptic rendering is one of the most challenging issues in the field of virtual reality. The intent is for the user to experience the same kinesthetic sensations in the virtual realm as they would in the real world. Therefore, we need to know ...
Integrating tactile and force feedback for highly dynamic tasks: Technological, experimental and epistemological aspects
For hand-object interaction in real situations the interplay between the local tactile interaction and force interaction seems to be very important. In current haptic interfaces, however, two different trends are present: force feedback devices which ...
Comments
Information & Contributors
Information
Published In
October 2024
164 pages
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 05 October 2024
Check for updates
Author Tags
Qualifiers
- Short-paper
Funding Sources
- Australian Research Council Discovery Early Career Award (DECRA)
- Neurodisability Assist Trust and Cerebral Palsy Alliance, Australia
Conference
UbiComp '24
Sponsor:
UbiComp '24: The 2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing
October 5 - 9, 2024
Melbourne VIC, Australia
Acceptance Rates
Overall Acceptance Rate 38 of 196 submissions, 19%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 327Total Downloads
- Downloads (Last 12 months)327
- Downloads (Last 6 weeks)80
Reflects downloads up to 28 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in