Skip to main content

Real Time Continuous Tracking of Dynamic Hand Gestures on a Mobile GPU

  • Conference paper
  • First Online:
  • 2754 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10617))

Abstract

Hand gesture recognition is an expansive and evolving field. Previous work addresses methods for tracking hand gestures with specialty gaming/desktop environments in real time. The method proposed here focuses on enhancing performance for mobile GPU platforms with restricted resources by limiting memory use/transfers and by reducing the need for code branches. An encoding scheme has been designed to allow contour processing typically used for finding fingertips to occur efficiently on a GPU for non-touch, remote manipulation of on-screen images. Results show high resolution video frames can be processed in real time on a modern mobile consumer device, allowing for fine grained hand movements to be detected and tracked.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. OpenStreetMap contributors: Planet dump retrieved from (2017). https://planet.osm.org, https://www.openstreetmap.org

  2. Hasan, H., Kareem, S.: Human computer interaction for vision based hand gesture recognition: a survey. In: International Conference on Advanced Computer Science Applications and Technologies (ACSAT) (2012)

    Google Scholar 

  3. Mazumdar, D., Nayak, M.K., Talukdar, A.K.: Adaptive hand segmentation and tracking for application in continuous hand gesture recognition. In: Sarma, K.K., Sarma, M.P., Sarma, M. (eds.) Recent Trends in Intelligent and Emerging Systems. SCT, pp. 115–124. Springer, New Delhi (2015). https://doi.org/10.1007/978-81-322-2407-5_9

    Chapter  Google Scholar 

  4. Lai, Z., Yao, Z., Wang, C., Liang, H., Chen, H., Xia, W.: Fingertips detection and hand gesture recognition based on discrete curve evolution with a kinect sensor. In: Visual Communications and Image Processing (VCIP) (2016)

    Google Scholar 

  5. Barros, P., Maciel-Junior, N.T., Fernandes, B.J., Bezerra, B.L., Fernandes, S.M.: A dynamic gesture recognition and prediction system using the convexity approach. Comput. Vis. Image Underst. 155, 139–149 (2017)

    Article  Google Scholar 

  6. Pan, Z., Li, Y., Zhang, M., Sun, C., Guo, K., Tang, X., Zhou, S.Z.: A real-time multi-cue hand tracking algorithm based on computer vision. In: Virtual Reality Conference (VR). IEEE (2010)

    Google Scholar 

  7. Liao, C.J., Su, S.F., Chen, M.C.: Vision-based hand gesture recognition system for a dynamic and complicated environment. In: International Conference on Systems, Man, and Cybernetics (SMC) (2015)

    Google Scholar 

  8. Bhandari, A., Chopra, A., Rishi, S.: Gesture based control system. Int. J. Appl. Res. IJAR 2(4), 656–661 (2016)

    Google Scholar 

  9. Bhame, V., Sreemathy, R., Dhumal, H.: Vision based hand gesture recognition using eccentric approach for human computer interaction. In: International Conference on Advances in Computing, Communications and Informatics (ICACCI) (2014)

    Google Scholar 

  10. Wachs, J.P., Kölsch, M., Stern, H., Edan, Y.: Vision-based hand-gesture applications. Commun. ACM 54(2), 60–71 (2011)

    Article  Google Scholar 

  11. Wang, K., Xiao, B., Xia, J., Li, D.: A dynamic hand gesture recognition algorithm using codebook model and spatial moments. In: 7th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC) (2015)

    Google Scholar 

  12. Khronos Group: OpenGL ES (2017). https://www.khronos.org/opengles/

  13. Suzuki, S., et al.: Topological structural analysis of digitized binary images by border following. Comput. Vis. Graph. Image Process. 30(1), 32–46 (1985)

    Article  MATH  Google Scholar 

  14. Kwon, J.S., Gi, J.W., Kang, E.K.: An enhanced thinning algorithm using parallel processing. In: Proceedings of the International Conference Image Processing (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexandra Branzan Albu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Prior, R., Capson, D., Albu, A.B. (2017). Real Time Continuous Tracking of Dynamic Hand Gestures on a Mobile GPU. In: Blanc-Talon, J., Penne, R., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2017. Lecture Notes in Computer Science(), vol 10617. Springer, Cham. https://doi.org/10.1007/978-3-319-70353-4_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-70353-4_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-70352-7

  • Online ISBN: 978-3-319-70353-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics