Skip to main content

Advertisement

SpringerLink
Log in

On an algorithm for Vision-based hand gesture recognition

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

A vision-based static hand gesture recognition method which consists of preprocessing, feature extraction, feature selection and classification stages is presented in this work. The preprocessing stage involves image enhancement, segmentation, rotation and filtering. This work proposes an image rotation technique that makes segmented image rotation invariant and explores a combined feature set, using localized contour sequences and block-based features for better representation of static hand gesture. Genetic algorithm is used here to select optimized feature subset from the combined feature set. This work also proposes an improved version of radial basis function (RBF) neural network to classify hand gesture images using selected combined features. In the proposed RBF neural network, the centers are automatically selected using k-means algorithm and estimated weight matrix is recursively updated, utilizing least-mean-square algorithm for better recognition of hand gesture images. The comparative performances are tested on two indigenously developed databases of 24 American sign language hand alphabet.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Premaratne, P., Nguyen, Q.: Consumer electronics control system based on hand gesture moment invariants. IET Comput. Vis. 1(1), 35–41 (2007)

    Article  Google Scholar 

  2. Gupta, L., Ma, S.: Gesture-based interaction and communication: automated classification of hand gesture contours. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 31(1), 114–120 (2001)

    Article  Google Scholar 

  3. Wachs, J.P., Stern, H., Edan, Y.: Cluster labeling and parameter estimation for the automated setup of a hand-gesture recognition system. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 35(6), 932–944 (2005)

    Article  Google Scholar 

  4. Bourennane, S., Fossati, C.: Comparison of shape descriptors for hand posture recognition in video. Signal Image Video Process. 6(1), 147–157 (2012)

    Article  Google Scholar 

  5. Yang, C.-K., Chen, Y.-C.: A HCI interface based on hand gestures. Signal Image Video Process. 9(2), 451–462 (2015)

    Article  Google Scholar 

  6. Mitra, S., Acharya, T.: Gesture recognition: a survey. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 37(3), 311–324 (2007)

    Article  Google Scholar 

  7. Yang, R., Sarkar, S., Loeding, B.: Handling movement epenthesis and hand segmentation ambiguities in continuous sign language recognition using nested dynamic programming. IEEE Trans. Pattern Anal. Mach. Intell. 32(3), 462–477 (2010)

    Article  Google Scholar 

  8. Bhuyan, M.K., Bora, P.K., Ghosh, D.: An integrated approach to the recognition of a wide class of continuous hand gestures. Int. J. Pattern Recognit. Artif. Intell. 25(2), 227–252 (2011)

    Article  Google Scholar 

  9. Liu, W., Fan, Y., Li, Z., Zhang, Z.: RGBD video based human hand trajectory tracking and gesture recognition system. Math. Probl. Eng. 2015(863732), 1–15 (2015)

    Google Scholar 

  10. Sturman, D.J., Zeltzer, D.: A survey of glove-based input. IEEE Comput. Graph. Appl. 14(1), 30–39 (1994)

    Article  Google Scholar 

  11. Wang, C., Cannon, D.J.: A virtual end-effector pointing system in point-and-direct robotics for inspection of surface flaws using a neural network based skeleton transform. In: IEEE International Conference on Robotics and Automation, vol. 3, pp. 784–789 (1993)

  12. Genç, S., Baştan, M., Güdükbay, U., Atalay, V., Ulusoy, Ö.: HandVR: a hand-gesture-based interface to a video retrieval system. Signal Image Video Process. 1–10 (2014). doi:10.1007/s11760-014-0631-x

  13. Erden, F., Çetin, A.E.: Hand gesture based remote control system using infrared sensors and a camera. IEEE Trans. Consum. Electron. 60(4), 675–680 (2014)

    Article  Google Scholar 

  14. Shanableh, T., Assaleh, K.: User-independent recognition of Arabic sign language for facilitating communication with the deaf community. Digit. Signal Process. 21(4), 535–542 (2011)

    Article  Google Scholar 

  15. Haykin, S.: Neural Networks: A Comprehensive Foundation, 3rd edn. Prentice-Hall Inc, New Jersey (2007)

    MATH  Google Scholar 

  16. Ng, C.W., Ranganath, S.: Real-time gesture recognition system and application. Image Vis. Comput. 20(13–14), 993–1007 (2002)

    Article  Google Scholar 

  17. Dedeoğlu, Y., Töreyin, B.U., Güdükbay, U., Çetin, A.E.: Silhouette-based method for object classification and human action recognition in video. In: Huang, T.S., Sebe, N., Lew, M.S., Pavlović, V., Kölsch, M., Galata A., Kisačanin, B. (eds.) Computer Vision in Human–Computer Interaction, pp. 64–77. Springer, Berlin (2006)

  18. Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 2nd edn. Addison-Wesley Longman Publishing Co. Inc, Boston (2001)

    Google Scholar 

  19. Lam, E.: Combining gray world and retinex theory for automatic white balance in digital photography. In: Proceedings of 9th International Symposium on Consumer Electronics, 2005 (ISCE 2005), pp. 134–139 (2005)

  20. Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)

    Article  MathSciNet  Google Scholar 

  21. Chai, D., Bouzerdoum, A.: A bayesian approach to skin color classification in ycbcr color space. In: Proceedings of TENCON 2000, vol. 2, pp. 421-424 (2000)

  22. Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)

    Article  Google Scholar 

  23. Michalewicz, Z.: Genetic Algorithms + Data Structures = Evolution Programs, 3rd edn. Springer, London (1996)

    Book  MATH  Google Scholar 

  24. de Chazal, P., O’Dwyer, M., Reilly, R.B.: Automatic classification of heartbeats using ECG morphology and heartbeat interval features. IEEE Trans. Biomed. Eng. 51(7), 1196–1206 (2004)

    Article  Google Scholar 

  25. Fawcett, T.: An introduction to ROC analysis. Pattern Recogn. Lett. 27(8), 861–874 (2006)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electronics and Communication Engineering, National Institute of Technology, Rourkela, 769008, India

    Dipak Kumar Ghosh & Samit Ari

Authors
  1. Dipak Kumar Ghosh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Samit Ari
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dipak Kumar Ghosh.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ghosh, D.K., Ari, S. On an algorithm for Vision-based hand gesture recognition. SIViP 10, 655–662 (2016). https://doi.org/10.1007/s11760-015-0790-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-015-0790-4

Keywords

Search

Navigation