Skip to main content
SpringerLink
Log in

Generalized Hand Gesture Recognition for Wearable Devices in IoT: Application and Implementation Challenges

  • Conference paper
  • First Online:
Machine Learning and Data Mining in Pattern Recognition (MLDM 2016)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9729))

Abstract

The proliferation of low power and low cost continuous sensing technology is enabling new and innovative applications in wearables and Internet of Things (IoT). At the same time, new applications are creating challenges to maintain real-time response in a resource-constrained device, while maintaining an acceptable performance. In this paper, we describe an IMU (Inertial Measurement Unit) sensor-based generalized hand gesture recognition system, its applications, and the challenges involved in implementing the algorithm in a resource-constrained device. We have implemented a simple algorithm for gesture spotting that substantially reduces the false positives. The gesture recognition model was built using the data collected from 52 unique subjects. The model was mapped onto Intel® QuarkTM SE Pattern Matching Engine, and field-tested using 8 additional subjects achieving 92% performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Akl, A., Feng, C., Valaee, S.: A Novel Accelerometer-Based Gesture Recognition System. IEEE Transcations on Signal Processing 59(12), December 2011

    Google Scholar 

  2. Bretzner, L., Lindeberg, T.: Use your hand as a 3-D mouse, or, relative orientation from extended sequences of sparse point and line correspondences using the affine trifocal tensor. In: Burkhardt, H.-J., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1406, pp. 141–157. Springer, Heidelberg (1998)

    Google Scholar 

  3. Freeman, W.T., Weissman, C.D.: TV control by hand gestures. In: IEEE Int. Workshop on Automatic Face and Gesture Recognition, Zurich, Switzerland (1995)

    Google Scholar 

  4. Je, H., Kim, J., Kim, D.: Hand gesture recognition to understand musical conducting action. In: IEEE Int. Conf. Robot & Human Interactive Communication, August 2007

    Google Scholar 

  5. Kratz, S., Rohs, M.: Protractor3D: a closed-form solution to rotation-invariant 3D gestures. In: Proc. IUI 2011, pp. 371–374. ACM (2011)

    Google Scholar 

  6. Kratz, S., Rohs, M., Essl, G.: Combining acceleration and gyroscope data for motion gesture recognition using classifiers with dimensionality constraints. In: IUI 2013, Santa Monica, CA, USA, pp. 173–178, March 19–22, 2013

    Google Scholar 

  7. Liu, J., Zhong, L., Wickramasuriya, J., Vasudevan, V.: uWave: Accelerometer-based personalized gesture recognition and its applications. Pervasive and Mobile Computing 5, 657–675 (2009)

    Article  Google Scholar 

  8. Liu, J., Pan, A., Li, X.: An Accelerometer-Based Gesture Recognition Algorithm and its Application for 3D Interaction. Computer Science and Information Systems 7(1) (2010)

    Google Scholar 

  9. Mace, D., Gao, W., Coskun, A.: Accelerometer-based hand gesture recognition using feature weighted naïve bayesian classifiers and dynamic time warping. In: IUI 2013 Companion, pp. 83–84 (2013)

    Google Scholar 

  10. Oh, J.K., Cho, S.J., Bang, W.C., et al.: Inertial sensor based recognition of 3-D character gestures with an ensemble of classifiers. In: 9th Int. Workshop on Frontiers in Handwriting Recognition (2004)

    Google Scholar 

  11. Pylvänäinen, T.: Accelerometer based gesture recognition using continuous HMMs. In: Marques, J.S., Pérez de la Blanca, N., Pina, P. (eds.) IbPRIA 2005. LNCS, vol. 3522, pp. 639–646. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  12. Ruiz, J., Li, Y.: DoubleFlip: a motion gesture delimiter for mobile interaction. In: Proc. CHI 2011, pp. 2717–2720. ACM (2011)

    Google Scholar 

  13. Speeter, T.H.: Transformation human hand motion for telemanipulation. Presence 1(1), 63–79 (1992)

    Article  Google Scholar 

  14. Xu, D.: A neural network approach for hand gesture recognition in virtual reality driving training system of SPG. In: 18th Int. Conf. Pattern Recognition (2006)

    Google Scholar 

  15. Xu, R., Zhou, S., Li, W.J.: MEMS accelerometer based nonspecific-user hand gesture recognition. Sensors Journal 12(5), 1166–1173 (2012)

    Article  Google Scholar 

  16. Zhou, S., Dong, Z., Li, W.J., Kwong, C.P.: Hand-written character recognition using MEMS motion sensing technology. In: Proc. IEEE/ASME Int. Conf. Advanced Intelligent Mechatronics, pp. 1418–1423 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Intel Corporations, Hillsboro, OR, USA

    Darshan Iyer, Fahim Mohammad, Yuan Guo, Ebrahim Al Safadi, Benjamin J. Smiley, Zhiqiang Liang & Nilesh K. Jain

Authors
  1. Darshan Iyer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fahim Mohammad
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuan Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ebrahim Al Safadi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Benjamin J. Smiley
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Zhiqiang Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Nilesh K. Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nilesh K. Jain .

Editor information

Editors and Affiliations

  1. IBaI, Inst of Comp Vision and applied Comp Sci, Leipzig, Sachsen, Germany

    Petra Perner

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Iyer, D. et al. (2016). Generalized Hand Gesture Recognition for Wearable Devices in IoT: Application and Implementation Challenges. In: Perner, P. (eds) Machine Learning and Data Mining in Pattern Recognition. MLDM 2016. Lecture Notes in Computer Science(), vol 9729. Springer, Cham. https://doi.org/10.1007/978-3-319-41920-6_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-41920-6_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-41919-0

  • Online ISBN: 978-3-319-41920-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation