abstract

Public Access

A stretch-sensing soft glove for interactive hand pose estimation

Authors:

Olga Sorkine-HornungAuthors Info & Claims

SIGGRAPH '19: ACM SIGGRAPH 2019 Emerging Technologies

Article No.: 4, Pages 1 - 2

https://doi.org/10.1145/3305367.3327975

Published: 28 July 2019 Publication History

PDF eReader

Abstract

We present a stretch-sensing soft glove to interactively capture full hand poses with high accuracy and without requiring an external optical setup. Our device can be fabricated with simple tools available in most fabrication labs. The pose is reconstructed from a capacitive sensor array embedded in the glove. We propose a data representation that allows deep neural networks to exploit the spatial layout of the sensor itself. The network is trained only once, using an inexpensive off-the-shelf hand pose reconstruction system to gather the training data. The per-user calibration is then performed on-the-fly using only the glove.

Supplementary Material

MP4 File (a4-glauser.mp4)

Download
59.15 MB

References

[1]

2019. CyberGlove. http://www.cyberglovesystems.com/.

Google Scholar

[2]

2019. ManusVR glove. https://manus-vr.odoo.com/hardware.

Google Scholar

[3]

Jean-Baptiste Chossat, Yiwei Tao, Vincent Duchaine, and Yong-Lae Park. 2015. Wearable soft artificial skin for hand motion detection with embedded microfluidic strain sensing. In Proc. ICRA. IEEE, 2568--2573.

Crossref

Google Scholar

[4]

Oliver Glauser, Daniele Panozzo, Otmar Hilliges, and Olga Sorkine-Hornung. 2019. Deformation Capture via Self-Sensing Capacitive Arrays. ACM Trans. Graph. 38, 2 (2019).

Digital Library

Google Scholar

[5]

Anastasia Tkach, Andrea Tagliasacchi, Edoardo Remelli, Mark Pauly, and Andrew Fitzgibbon. 2017. Online Generative Model Personalization for Hand Tracking. ACM Trans. Graph. 36, 6 (2017).

Digital Library

Google Scholar

Cited By

View all

Chaffangeon Caillet AGoguey ANigay L(2025)Microgesture ＋ GraspInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103398195:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103398
Chen JWang CChen JYin B(2023)Manipulator Control System Based on Flexible Sensor TechnologyMicromachines10.3390/mi1409169714:9(1697)Online publication date: 30-Aug-2023
https://doi.org/10.3390/mi14091697
Tiboni MAmici C(2022)Soft Gloves: A Review on Recent Developments in Actuation, Sensing, Control and ApplicationsActuators10.3390/act1108023211:8(232)Online publication date: 10-Aug-2022
https://doi.org/10.3390/act11080232
Show More Cited By

Recommendations

Interactive hand pose estimation using a stretch-sensing soft glove

We propose a stretch-sensing soft glove to interactively capture hand poses with high accuracy and without requiring an external optical setup. We demonstrate how our device can be fabricated and calibrated at low cost, using simple tools available in ...
Evaluation of hand grasping by instrumented glove

In this paper the evaluation of effectivenes of instrumented glove in measurement of hand opening and preshaping during reach-to-grasp movement is described. In the experiment presented in this work the reach-to-grasp movement of one healthy subject was ...
A novel finger and hand pose estimation technique for real-time hand gesture recognition

This paper presents a high-level hand feature extraction method for real-time gesture recognition. Firstly, the fingers are modelled as cylindrical objects due to their parallel edge feature. Then a novel algorithm is proposed to directly extract ...

Comments

Information & Contributors

Information

Published In

SIGGRAPH '19: ACM SIGGRAPH 2019 Emerging Technologies

July 2019

54 pages

ISBN:9781450363082

DOI:10.1145/3305367

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 July 2019

Check for updates

Qualifiers

Abstract

Funding Sources

Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung
National Science Foundation

Conference

SIGGRAPH '19

Sponsor:

SIGGRAPH

SIGGRAPH '19: Special Interest Group on Computer Graphics and Interactive Techniques Conference

July 28, 2019

California, Los Angeles

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
837
Total Downloads

Downloads (Last 12 months)117
Downloads (Last 6 weeks)30

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chaffangeon Caillet AGoguey ANigay L(2025)Microgesture ＋ GraspInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103398195:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103398
Chen JWang CChen JYin B(2023)Manipulator Control System Based on Flexible Sensor TechnologyMicromachines10.3390/mi1409169714:9(1697)Online publication date: 30-Aug-2023
https://doi.org/10.3390/mi14091697
Tiboni MAmici C(2022)Soft Gloves: A Review on Recent Developments in Actuation, Sensing, Control and ApplicationsActuators10.3390/act1108023211:8(232)Online publication date: 10-Aug-2022
https://doi.org/10.3390/act11080232
Civelek TFuhrmann A(2022)Virtual Reality Learning Environment with Haptic GlovesProceedings of the 2022 3rd International Conference on Education Development and Studies10.1145/3528137.3528142(32-36)Online publication date: 9-Mar-2022
https://dl.acm.org/doi/10.1145/3528137.3528142
Ma HYamaoka J(2022)SenSequins: Smart Textile Using 3D Printed Conductive SequinsProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545688(1-13)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545688
Ma HYamaoka J(2022)Smart Textile Using 3D Printed Conductive SequinsProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3505577(1-7)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3505577
Spielberg AAmini AChin LMatusik WRus D(2021)Co-Learning of Task and Sensor Placement for Soft RoboticsIEEE Robotics and Automation Letters10.1109/LRA.2021.30563696:2(1208-1215)Online publication date: Apr-2021
https://doi.org/10.1109/LRA.2021.3056369
Hu FHe PXu SLi YZhang C(2020)FingerTrakProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33973064:2(1-24)Online publication date: 15-Jun-2020
https://dl.acm.org/doi/10.1145/3397306
Wilhelm MLechler JKrakowczyk DAlbayrak SPaternò FOliver NConati CSpano LTintarev N(2020)Ring-based finger tracking using capacitive sensors and long short-term memoryProceedings of the 25th International Conference on Intelligent User Interfaces10.1145/3377325.3377535(551-555)Online publication date: 17-Mar-2020
https://dl.acm.org/doi/10.1145/3377325.3377535

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Interactive hand pose estimation using a stretch-sensing soft glove

Evaluation of hand grasping by instrumented glove

A novel finger and hand pose estimation technique for real-time hand gesture recognition

Comments

Published In

Sponsors

Publisher

Publication History

Check for updates

Qualifiers

Funding Sources

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Cited By

PDF

eReader

Login options

Full Access

Abstract

Supplementary Material

References

Cited By

Recommendations

Interactive hand pose estimation using a stretch-sensing soft glove

Evaluation of hand grasping by instrumented glove

A novel finger and hand pose estimation technique for real-time hand gesture recognition

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Login options

Full Access

Share

Share this Publication link

Share on social media

Affiliations