research-article

proCover: Sensory Augmentation of Prosthetic Limbs Using Smart Textile Covers

Authors:

Patrick Parzer,

Florian Perteneder,

Christian Rendl,

Michael HallerAuthors Info & Claims

UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and Technology

Pages 335 - 346

https://doi.org/10.1145/2984511.2984572

Published: 16 October 2016 Publication History

Abstract

Today's commercially available prosthetic limbs lack tactile sensation and feedback. Recent research in this domain focuses on sensor technologies designed to be directly embedded into future prostheses. We present a novel concept and prototype of a prosthetic-sensing wearable that offers a non-invasive, self-applicable and customizable approach for the sensory augmentation of present-day and future low to mid-range priced lower-limb prosthetics. From consultation with eight lower-limb amputees, we investigated the design space for prosthetic sensing wearables and developed novel interaction methods for dynamic, user-driven creation and mapping of sensing regions on the foot to wearable haptic feedback actuators. Based on a pilot-study with amputees, we assessed the utility of our design in scenarios brought up by the amputees and we summarize our findings to establish future directions for research into using smart textiles for the sensory enhancement of prosthetic limbs.

Supplementary Material

suppl.mov (uist4226-file3.mp4)

Supplemental video

Download
60.86 MB

MP4 File (p335-leong.mp4)

Download
185.69 MB

MP4 File (uist-0411.mp4)

Download
329.27 MB

References

[1]

Büscher, G.H., Kõiva, R., Schürmann, C., Haschke, R., and Ritter, H.J. Flexible and stretchable fabric-based tactile sensor. Robotics and Autonomous Systems 63, (2015), 244--252.

Digital Library

[2]

Crea, S., Cipriani, C., Donati, M., Carrozza, M.C., and Vitiello, N. Providing time-discrete gait information by wearable feedback apparatus for lower-limb amputees: usability and functional validation. IEEE Transactions on Neural Systems and Rehabilitation Engineering 23, 2 (2015), 250--7.

[3]

Danilovic, A. SmartCast - Novel Textile Sensors for Embedded Pressure Sensing of Orthopedic Casts. 2013. http://escholarship.org/uc/item/3wg3p08j.

[4]

Fan, R.E., Culjat, M.O., King, C.-H., et al. A haptic feedback system for lower-limb prostheses. IEEE Transactions on Neural Systems and Rehabilitation Engineering 16, 3 (2008), 270--277.

[5]

Geldard, F.A. and Sherrick, C.E. The Cutaneous "Rabbit": A Perceptual Illusion. Science 178, 4057 (1972), 178--179.

[6]

Hammock, M.L., Chortos, A., Tee, B.C.-K., Tok, J.B.-H., and Bao, Z. 25th Anniversary Article: The Evolution of Electronic Skin (E-Skin): A Brief History, Design Considerations, and Recent Progress. Advanced Materials 25, 42 (2013), 5997--6038.

[7]

Hofmann, M., Harris, J., Hudson, S., and Mankoff, J. Helping Hands: Requirements for a Prototyping Methodology for Upper-limb Prosthetics Users. Proceedings of the 34th Annual ACM Conference on Human Factors in Computing Systems - CHI '16, ACM (2016), 525--534.

Digital Library

[8]

Hurst, A. and Tobias, J. Empowering individuals with do-it-yourself assistive technology. The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility - ASSETS '11, ACM Press (2011), 11.

Digital Library

[9]

Israr, A. and Poupyrev, I. Tactile brush. Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems - CHI '11, ACM Press (2011), 2019--2028.

Digital Library

[10]

Kaczmarek, K.A., Webster, J.G., Bach-y-Rita, P., and Tompkins, W.J. Electrotactile and vibrotactile displays for sensory substitution systems. IEEE Transactions on Biomedical Engineering 38, 1 (1991), 1--16.

[11]

Kaltenbrunner, M., Sekitani, T., Reeder, J., et al. An ultra-lightweight design for imperceptible plastic electronics. Nature 499, 7459 (2013), 458--63.

[12]

Lieberman, J. and Breazeal, C. TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning. IEEE Transactions on Robotics 23, 5 (2007), 919--926.

Digital Library

[13]

Oddo, C.M., Raspopovic, S., Artoni, F., et al. Intraneural stimulation elicits discrimination of textural features by artificial fingertip in intact and amputee humans. eLife 5, (2016), e09148.

[14]

Parzer, P., Probst, K., Babic, T., et al. FlexTiles: A Flexible, Stretchable, Formable, Pressure Sensitive, Tactile Input Sensor. Proceedings of the 34th Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, ACM (2016).

Digital Library

[15]

Perner-Wilson, H. rSkin - Open Source Robot Skin. http://www.instructables.com/id/rSkin-Open-SourceRobot-Skin/.

[16]

Perrier, A., Vuillerme, N., Luboz, V., et al. Smart Diabetic Socks: Embedded device for diabetic foot prevention. Innovation and Research in BioMedical engineering 35, 2 (2014), 72--76.

[17]

Raspopovic, S., Capogrosso, M., Petrini, F.M., et al. Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses. Science Translational Medicine 6, 222 (2014), 222ra19.

[18]

Sabolich, J.A. and Ortega, G.M. Sense of Feel for Lower-Limb Amputees: A Phase-One Study. JPO Journal of Prosthetics and Orthotics 6, 2 (1994), 36--41.

[19]

Schönauer, C., Fukushi, K., Olwal, A., Kaufmann, H., and Raskar, R. Multimodal motion guidance. Proceedings of the 14th ACM International Conference on Multimodal Interaction, ACM Press (2012), 133.

Digital Library

[20]

Shull, P.B. and Damian, D.D. Haptic wearables as sensory replacement, sensory augmentation and trainer -- a review. Journal of NeuroEngineering and Rehabilitation 12, 1 (2015), 59.

[21]

Starr, M. Lego-compatible prosthetic arm lets kids build their own hand. http://www.cnet.com/news/lego-compatibleprosthetic-arm-lets-kids-build-their-own-hand/.

[22]

Tan, D.W., Schiefer, M.A., Keith, M.W., Anderson, J.R., Tyler, J., and Tyler, D.J. A neural interface provides long-term stable natural touch perception. Science Translational Medicine 6, 257 (2014), 257ra138.

[23]

Tee, B.C.-K., Chortos, A., Berndt, A., et al. A skin-inspired organic digital mechanoreceptor. Science 350, 6258 (2015), 313--316.

[24]

Tiwana, M.I., Redmond, S.J., and Lovell, N.H. A review of tactile sensing technologies with applications in biomedical engineering. Sensors and Actuators A: Physical 179, (2012), 17--31.

[25]

Walsh, F. Artificial leg allows patient to feel. 2015. http://www.bbc.com/news/health-33052091.

[26]

Weigel, M., Lu, T., Bailly, G., Oulasvirta, A., Majidi, C., and Steimle, J. iSkin. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, ACM Press (2015), 2991--3000.

Digital Library

[27]

Weinstein, S. Intensive and extensive aspects of tactile sensitivity as a function of body part, sex and laterality. The First International Symposium on the Skin Senses, (1968).

[28]

The Cost of a New Limb Can Add up Over a Lifetime. https://www.hss.edu/newsroom_prosthetic-leg-costover-lifetime.asp.

[29]

Sensoria Fitness. http://www.sensoriafitness.com/.

[30]

Products - Smart Sock. http://www.alphafit.de/en/products/smartsock.html.

[31]

Product development Alphamat + Smart Sock. http://www.nova-nex.com/de/projekte/alphamatsmart-sock.

[32]

Outcome Measures in Lower Limb Prosthetics | KLevels. http://www.oandp.org/olc/course_extended_content. asp'frmCourseId=ACA066EC-443A-4822--822C89BC1CBD684E&frmTermId=k-levels.

[33]

Pressure sensor. 2010. https://www.google.com/patents/US7770473.

[34]

Peripheral sensory and supersensory replacement system. 2012. http://www.google.com/patents/CA2813656A1'cl=en.

Cited By

Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454
Aigner RHaberfellner MHaller M(2024)Loopsense: low-scale, unobtrusive, and minimally invasive knitted force sensors for multi-modal input, enabled by selective loop-meshingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642528(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642528
Lazaro Vasquez EAlistar MDevendorf LRivera M(2024)Desktop Biofibers Spinning: An Open-Source Machine for Exploring Biobased Fibers and Their Application Towards Sustainable Smart Textile DesignProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642387(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642387
Show More Cited By

Index Terms

proCover: Sensory Augmentation of Prosthetic Limbs Using Smart Textile Covers
1. Social and professional topics

Recommendations

Using wearable inertial sensors to detect different strategies for the sit-to-stand transition in multiple sclerosis
ECCE '21: Proceedings of the 32nd European Conference on Cognitive Ergonomics

INTRODUCTION: The sit-to-stand (Si-St) transition is an essential activity of daily living (ADL) which is fundamental to maintaining functional independence. It can often be compromised in patients with neurological disorders such as multiple sclerosis (...
Zishi: A Smart Garment for Posture Monitoring
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Zishi is a garment designed to support posture monitoring for the purposes of rehabilitation training. It has been designed with attention to presenting accurate and informative feedback to patients regarding their thoracic and shoulder posture as well ...
Ankle-foot passive motion prototype for stroke patients
i-CREATe '12: Proceedings of the 6th International Conference on Rehabilitation Engineering & Assistive Technology

Many stroke patients become disabled and cannot return to work. Some of the reasons are from complications such as ankle joint stiffness and muscle contracture which is caused by immobilization. In order to prevent and reduce the possibility of ankle ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and Technology

October 2016

908 pages

ISBN:9781450341899

DOI:10.1145/2984511

General Chairs:
Jun Rekimoto
The University of Tokyo
,
Takeo Igarashi
The University of Tokyo
,
Program Chairs:
Jacob O. Wobbrock
University of Washington
,
Daniel Avrahami
FXPAL

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

FNR in the framework of the ERA-NET CHIST-ERA II (eGlasses)
European Union, 7th Framework Programme FP7/2007-2013
FWF
NCBiR
SNSF
ANR

Conference

UIST '16

Sponsor:

UIST '16: The 29th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2016

Tokyo, Japan

Acceptance Rates

UIST '16 Paper Acceptance Rate 79 of 384 submissions, 21%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

58
Total Citations
View Citations
1,539
Total Downloads

Downloads (Last 12 months)128
Downloads (Last 6 weeks)15

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454
Aigner RHaberfellner MHaller M(2024)Loopsense: low-scale, unobtrusive, and minimally invasive knitted force sensors for multi-modal input, enabled by selective loop-meshingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642528(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642528
Lazaro Vasquez EAlistar MDevendorf LRivera M(2024)Desktop Biofibers Spinning: An Open-Source Machine for Exploring Biobased Fibers and Their Application Towards Sustainable Smart Textile DesignProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642387(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642387
De Boeck MVaes K(2024)Human augmentation and its new design perspectivesInternational Journal of Design Creativity and Innovation10.1080/21650349.2023.228812512:1(61-80)Online publication date: 24-Jan-2024
https://doi.org/10.1080/21650349.2023.2288125
Ying EXiong TZhu GQiu MQin YGuo S(2024)WristSketcher: Creating 2D Dynamic Sketches in AR With a Sensing WristbandInternational Journal of Human–Computer Interaction10.1080/10447318.2024.230185741:1(557-573)Online publication date: 22-Jan-2024
https://doi.org/10.1080/10447318.2024.2301857
Matos DFreitas AMiranda DCarvalho VMartins N(2024)Design and Embodiment of Wearable ProsthesesAdvances in Design, Music and Arts III10.1007/978-3-031-74975-9_12(151-162)Online publication date: 18-Nov-2024
https://doi.org/10.1007/978-3-031-74975-9_12
Ramasamy PCalderon-Sastre ERenganathan GDas SKurita Y(2023)Soft actuators-based skill training wearables: a review on the interaction modes, feedback types, VR scenarios, sensors utilization and applicationsROBOMECH Journal10.1186/s40648-023-00239-x10:1Online publication date: 16-Jan-2023
https://doi.org/10.1186/s40648-023-00239-x
Cochrane KNguyen CCao YRoestel NJones LGirouard A(2023)Adaptive Soft Switches: Co-Designing Fabric Adaptive Switches with Occupational Therapists for Children and Adolescents with Acquired Brain InjuryProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572734(1-14)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3572734
Luo YBarhudarian ESeyed T(2023)Project Mihr: Enabling Gestural Interactions on a Keyboard using a Graphene-based FabricExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585873(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585873
Liang ZZhang DXu GXie FCai HGuo HCheng J(2023)Smart Garment: A Long-Term Feasible, Whole-Body Textile Pressure-Sensing SystemIEEE Sensors Journal10.1109/JSEN.2023.330285723:19(23294-23302)Online publication date: 1-Oct-2023
https://doi.org/10.1109/JSEN.2023.3302857
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten