skip to main content
10.1145/2984751.2985721acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
demonstration

Hand Gesture and On-body Touch Recognition by Active Acoustic Sensing throughout the Human Body

Published: 16 October 2016 Publication History

Abstract

In this paper, we present a novel acoustic sensing technique that recognizes two convenient input actions: hand gestures and on-body touch. We achieved them by observing the frequency spectrum of the wave propagated in the body, around the periphery of the wrist. Our approach can recognize hand gestures and on-body touch concurrently in real-time and is expected to obtain rich input variations by combining them. We conducted a user study that showed classification accuracy of 97%, 96%, and 97% for hand gestures, touches on the forearm, and touches on the back of the hand.

Supplementary Material

suppl.mov (uistde0148-file3.mp4)
Supplemental video

References

[1]
Adiyan Mujibiya, Xiang Cao, Desney S. Tan, Dan Morris, Shwetak N. Patel, and Jun Rekimoto. The Sound of Touch: On-body Touch and Gesture Sensing Based on Transdermal Ultrasound Propagation. In Proc. ITS '13, 189--198, 2013.
[2]
Chih-Chung Chang, and Chih-Jen Lin. LIBSVM: A Library for Support Vector Machines. Available online at: https://www.csie.ntu.edu.tw/~cjlin/libsvm/. Accessed at July 4th, 2016.
[3]
Non-Ionizing Radiation Section Bureau of Radiation and Medical Devices Department of National Health and Welfare. Guidelines for the Safe Use of Ultrasound: Part II - Industrial and Commercial Applications. Available online at: http://www.hc-sc.gc.ca/ewhsemt/pubs/radiation/safety-code_24-securite/indexeng.php. Accessed at July 4th, 2016.
[4]
Yuya Okawa, and Kentaro Takemura. Haptic-enabled Active Bone-Conducted Sound Sensing. In Proc. UIST'15, 87--88, 2015.

Cited By

View all
  • (2024)Active Acoustic Sensing Based Authentication System Using a Door HandleProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701587(324-330)Online publication date: 1-Dec-2024
  • (2024)ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Wave Around the BodyProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997528:4(1-32)Online publication date: 21-Nov-2024
  • (2023)Listening Human Behavior: 3D Human Pose Estimation with Acoustic Signals2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01280(13323-13332)Online publication date: Jun-2023
  • Show More Cited By

Index Terms

  1. Hand Gesture and On-body Touch Recognition by Active Acoustic Sensing throughout the Human Body

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '16 Adjunct: Adjunct Proceedings of the 29th Annual ACM Symposium on User Interface Software and Technology
    October 2016
    244 pages
    ISBN:9781450345316
    DOI:10.1145/2984751
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 16 October 2016

    Check for updates

    Author Tags

    1. acoustic sensing
    2. combined input
    3. hand gestures
    4. machine learning
    5. on-body touch

    Qualifiers

    • Demonstration

    Funding Sources

    • Waseda University

    Conference

    UIST '16

    Acceptance Rates

    UIST '16 Adjunct Paper Acceptance Rate 79 of 384 submissions, 21%;
    Overall Acceptance Rate 355 of 1,733 submissions, 20%

    Upcoming Conference

    UIST '25
    The 38th Annual ACM Symposium on User Interface Software and Technology
    September 28 - October 1, 2025
    Busan , Republic of Korea

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)18
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Active Acoustic Sensing Based Authentication System Using a Door HandleProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701587(324-330)Online publication date: 1-Dec-2024
    • (2024)ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Wave Around the BodyProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997528:4(1-32)Online publication date: 21-Nov-2024
    • (2023)Listening Human Behavior: 3D Human Pose Estimation with Acoustic Signals2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01280(13323-13332)Online publication date: Jun-2023
    • (2022)Method for Recognizing Pressing Position and Shear Force Using Active Acoustic Sensing on Gel PlatesSensors10.3390/s2224995122:24(9951)Online publication date: 16-Dec-2022
    • (2020)PeriSense: Ring-Based Multi-Finger Gesture Interaction Utilizing Capacitive Proximity SensingSensors10.3390/s2014399020:14(3990)Online publication date: 17-Jul-2020
    • (2019)AudioTouchProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3340147(1-13)Online publication date: 1-Oct-2019
    • (2019)Estimation of Hand Position and Biaxial Joint Angle by Vibration Emission2019 IEEE/SICE International Symposium on System Integration (SII)10.1109/SII.2019.8700384(512-517)Online publication date: Jan-2019
    • (2018)Head Pose Classification by using Body-Conducted SoundAdjunct Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3266037.3266094(39-41)Online publication date: 11-Oct-2018
    • (2017)Estimating three-axis contact force for fingertip by emitting vibration actively2017 IEEE International Conference on Robotics and Biomimetics (ROBIO)10.1109/ROBIO.2017.8324451(406-411)Online publication date: Dec-2017

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media