skip to main content
10.1145/2903220.2903241acmotherconferencesArticle/Chapter ViewAbstractPublication PagessetnConference Proceedingsconference-collections
short-paper

A Real-Time Approach for Gesture Recognition using the Kinect Sensor

Published: 18 May 2016 Publication History

Abstract

In this paper we present an approach for real-time gesture recognition using the Kinect sensor and a set of machine learning techniques. We propose a novel approach for feature extraction using measurements on skeletal joints. We select a set of simple gestures and construct a data set. We train classifiers under the assumptions that they shall be evaluated to both known and unknown users. Experimental results prove the effectiveness and the potential of our approach.

References

[1]
Microsoft Developer Network, Natural User Interface -- Skeletal Tracking. https://msdn.microsoft.com/en-us/library/hh973073.aspx. {Online; accessed 14-December-2015}.
[2]
F. Bevilacqua, B. Zamborlin, A. Sypniewski, N. Schnell, F. Guédy, and N. Rasamimanana. Continuous realtime gesture following and recognition. In Gesture in embodied communication and human-computer interaction, pages 73--84. Springer, 2010.
[3]
S. Bhattacharya, B. Czejdo, and N. Perez. Gesture classification with machine learning using kinect sensor data. In Emerging Applications of Information Technology (EAIT), 2012 Third International Conference on, pages 348--351. IEEE, 2012.
[4]
H. Koppula and A. Saxena. Learning spatio-temporal structure from rgb-d videos for human activity detection and anticipation. In Proceedings of the 30th International Conference on Machine Learning (ICML-13), pages 792--800, 2013.
[5]
K. Lai, J. Konrad, and P. Ishwar. A gesture-driven computer interface using kinect. In Image Analysis and Interpretation (SSIAI), 2012 IEEE Southwest Symposium on, pages 185--188. IEEE, 2012.
[6]
N. Neverova, C. Wolf, G. Paci, G. Sommavilla, G. W. Taylor, and F. Nebout. A multi-scale approach to gesture detection and recognition. In Computer Vision Workshops (ICCVW), 2013 IEEE International Conference on, pages 484--491. IEEE, 2013.
[7]
F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12:2825--2830, 2011.
[8]
G. Pierris, D. Kothris, E. Spyrou, and C. Spyropoulos. Synaisthisi: an enabling platform for the current internet of things ecosystem. In Proceedings of the 19th Panhellenic Conference on Informatics, pages 438--444. ACM, 2015.
[9]
D. Rubine. Specifying gestures by example. ACM, 25(4).
[10]
J. Sheng. A study of adaboost in 3d gesture recognition. Department of Computer Science, University of Toronto, 2003.
[11]
J. Shotton, T. Sharp, A. Kipman, A. Fitzgibbon, M. Finocchio, A. Blake, M. Cook, and R. Moore. Real-time human pose recognition in parts from single depth images. Communications of the ACM, 56(1):116--124, 2013.
[12]
Y. Song, D. Demirdjian, and R. Davis. Continuous body and hand gesture recognition for natural human-computer interaction. ACM Transactions on Interactive Intelligent Systems (TiiS), 2(1):5, 2012.
[13]
L. Xia, C.-C. Chen, and J. Aggarwal. Human detection using depth information by kinect. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2011 IEEE Computer Society Conference on, pages 15--22. IEEE, 2011.
[14]
M. Zanfir, M. Leordeanu, and C. Sminchisescu. The moving pose: An efficient 3d kinematics descriptor for low-latency action recognition and detection. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 2752--2759. IEEE, 2013.

Cited By

View all
  • (2019)Detection of Proper Form on Upper Limb Strength Training Using Extremely Randomized Trees for Joint PositionsProceedings of the 2nd International Conference on Computing and Big Data10.1145/3366650.3366680(111-115)Online publication date: 18-Oct-2019
  • (2018)Arm Gesture Recognition using a Convolutional Neural Network2018 13th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP)10.1109/SMAP.2018.8501886(37-42)Online publication date: Sep-2018
  1. A Real-Time Approach for Gesture Recognition using the Kinect Sensor

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    SETN '16: Proceedings of the 9th Hellenic Conference on Artificial Intelligence
    May 2016
    249 pages
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    In-Cooperation

    • EETN: Hellenic Artificial Intelligence Society

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 May 2016

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Short-paper
    • Research
    • Refereed limited

    Conference

    SETN '16

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2019)Detection of Proper Form on Upper Limb Strength Training Using Extremely Randomized Trees for Joint PositionsProceedings of the 2nd International Conference on Computing and Big Data10.1145/3366650.3366680(111-115)Online publication date: 18-Oct-2019
    • (2018)Arm Gesture Recognition using a Convolutional Neural Network2018 13th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP)10.1109/SMAP.2018.8501886(37-42)Online publication date: Sep-2018

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media