skip to main content
10.1145/3175684.3175697acmotherconferencesArticle/Chapter ViewAbstractPublication PagesbdiotConference Proceedingsconference-collections
research-article

Smart Hand Device Gesture Recognition with Dynamic Time-Warping Method

Published: 20 December 2017 Publication History

Abstract

In this paper, we present a smart wearable hand-gesture recognition system based on the movement of the hand and fingers. The proposed smart wearable system is built using the fewest sensors necessary for gesture recognition. Thus, motion sensors are placed on the thumb and index finger to detect finger motions. Another sensor is placed on the back of the hand to measure hand movement. A total of six gestures are analyzed via hand and finger movement using a dynamic time-warping method. Gestures include "swipe right," "swipe left," "zoom in," "zoom out," "rotate left," and "rotate right." An Android-based mobile device application simulator measures gesture recognition effectiveness. Gestures are analyzed using a trained recognition model. Once a gesture is detected, it is transmitted to the mobile application via Bluetooth low energy communication. Received gestures then trigger corresponding commands, as specified in the mobile application. The proposed smart wearable system can detect gestures at mean accuracy of 93.19 %.

References

[1]
Wu, Y., and Huang, T. S. 1999. Vision-based gesture recognition: a review. In Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction (March 17-19, 1999). Springer-Verlag London, UK, 103--115.
[2]
Wamg, Q., Chen, X., Chen, R., Chen, Y., and Zhang, X. 2013. Electromyography-based locomotion pattern recognition and personal positioning toward improved context-awareness applications. IEEE Trans. Syst. Man. Cybern. (Jun. 2013), 1216--1227.
[3]
Englehart, K., and Hudgins, B. 2003. A robust real-time control scheme for multifunction myoelectric control. IEEE Trans. Biomed. Eng. (Jul. 2003), 848--854.
[4]
Momen, K., Krishnan, S., and Chau, T. 2007. Real-time classification of forearm electromyographic signals corresponding to user-selected intentional movements for multifunction prosthesis control. IEEE Trans. Neural Syst. And Rehabil. Eng. (Dec. 2007), 535--542.
[5]
Uchida, N., Hiraiwa, A., Sonehara, N., and Shimohara, K. 1992. Emg pattern recognition by neural networks for multi fingers control. In 14th Annual Int. Conf. Eng. Med. Biol. Soc. (Paris, France, October 29-November 1, 1992).
[6]
Matiwade, S. V., Dixit, M. R. 2016. Electronic support system for deaf and dumb to interpret sign language of communication. Int. J. Eng. R. Technol. (Apr. 2013), 382--387.
[7]
Chowdary, P. R. V., Babu, M. N., Subbareddy, T. V., Reddy, B. M. and Elamaran, V. 2015. Image processing algorithms for gesture recognition using matlab. In Int. Conf. Adv. Comm. Control Comput. Technol. (India, January 2015).
[8]
Khan, T., and Pathan, A. H. 2015. Hand gesture recognition based on digital image processing using matlab. Int. J. Sci. Eng. R. (Sep. 2015), 338--346.
[9]
Lamberti, L., and Camastra, F. 2011. Real-time hand gesture recognition using a color glove. In Int. Conf. Image Analy. Process. (Ravenna, Italy, Sep. 2011).
[10]
Iwai, Y., Watanabe, K., Yagi, Y., and Yachida, M. 1996. Gesture recognition using colored gloves. In Proceedings of 13th International Conference Pattern Recognition. (Vienna, Austria, August 25-29).
[11]
Dawane, S. P., and Sayyed H. G. A. 2017. Hand gesture recognition for deaf and dumb people using gsm module. Int. J. Sci. R. (May 2017), 2226--2230.
[12]
Patil, K., Pendharkar, G., and Gaikwad, G. N. 2014. American sign language detection. Int. J. Sci. R. Pub. (Nov. 2014), 1--6.
[13]
Kim, J., Thang, N. D., and Kim, T. 2009. 3-D hand motion tracking and gesture recognition using a data glove. In IEEE Int. Symp. Industrial Elec. (Seoul, South Korea, July 5-8).
[14]
Lu, D., Yu, Y. and Liu, H. 2016. Gesture recognition using data glove: an extreme learning machine method. In Proceedings of 2016 IEEE International Conference on Robotics and Biometics. (Qingdao, China, December, 3-7).
[15]
Adafruit BNO055 absolute orientation sensor. https://learn.adafruit.com/adafruit-bno055-absolute-orientation-sensor/overview.
[16]
Arduino Pro Mini 328 -- 5V/16 MHz. http://www.devicemart.co.kr/1287163
[17]
Bluetooth 4.0 HM-10. http://mechasolution.com/shop/goods/goods_view.php?goodsno=330423&category=132024
[18]
Lithium ion polymer battery -- 3.7v 500 mAh. https://www.adafruit.com/product/1578
[19]
Keogh, E., and Ratanamahatana, C. A. 2002. Exact indexing of dynamic time warping. Knowledge and Information Systems (Hong Kong, China, Aug. 2002).

Cited By

View all
  • (2022)Emerging Wearable Interfaces and Algorithms for Hand Gesture Recognition: A SurveyIEEE Reviews in Biomedical Engineering10.1109/RBME.2021.307819015(85-102)Online publication date: 2022

Index Terms

  1. Smart Hand Device Gesture Recognition with Dynamic Time-Warping Method

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    BDIOT '17: Proceedings of the International Conference on Big Data and Internet of Thing
    December 2017
    251 pages
    ISBN:9781450354301
    DOI:10.1145/3175684
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 December 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Wearable system
    2. dynamic time warping
    3. gesture recognition
    4. mobile application
    5. motion sensors

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    BDIOT2017

    Acceptance Rates

    Overall Acceptance Rate 75 of 136 submissions, 55%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)5
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Emerging Wearable Interfaces and Algorithms for Hand Gesture Recognition: A SurveyIEEE Reviews in Biomedical Engineering10.1109/RBME.2021.307819015(85-102)Online publication date: 2022

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media