Skip to main content
SpringerLink
Log in

Rapid and efficient hand gestures recognizer based on classes discriminator wavelet networks

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The vision based on hand gesture recognition is one of the key challenges in behavior understanding and computer vision. It offers to machines the possibility of identifying, recognizing and interpreting hand gestures in the aim of controlling certain devices, to monitor certain human activities or interacting with certain human machine interfaces (HMI). This paper aims at proposing a rapid and efficient hand gestures recognizer based on classes discriminator wavelet networks. In this work two main contributions were proposed: firstly, by enhancing previous works using wavelet networks (WN) in the classification field, specifically at the learning process of the latest version of WN classifier (WNC) by creating separator WNs discriminating classes (n − 1 WNs to classify n classes) as alternative of constructing a WN corresponding to each training image. This contribution, by minimizing the comparison number between test images WNs and training ones, makes quicker the test phase. Secondly, a new WN architecture based on the cascade notion was proposed, in which the WN is decomposed of a set of stages. The novel architecture aims not only at making recognitions robust and quick but also at rejecting from early stages, as fast as possible, gestures that must not be taken into consideration by the system (spontaneous gestures). To test this work, both proprietary and public hand posture datasets were used. Comparisons with other works are detailed and discussed. Given results showed that the novel hand gesture recognizer performances are comparable to already established ones.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Ben Amar C, Zaied M, Alimi MA (2005) Beta wavelets. Synthesis and application to lossy image compression. J Adv Eng Soft Elsevier Edition 36, N7:459–474

    Article  MATH  Google Scholar 

  2. Bouchrika T, Zaied M, Jemai O, Ben Amar C (2012) Ordering computers by hand gesture recognition based on wavelet networks, Int. Conf. on Communications, Computing and Control Applications proceedings, Marseilles, France. doi:10.1109/CCCA.2012.6417911, pp. 1–6

  3. Bouchrika T, Zaied M, Jemai O, Ben Amar C (2013) Neural solutions to interact with computers by hand gesture recognition. MTAP: Multimedia Tools and Applications 10.1007/s11042-013-1557-y

  4. Bouchrika T, Jemai O, Zaied M, Ben Amar C (2014) Cascaded hybrid wavelet network for hand gesture recognition. In: IEEE international conference on systems, man, and cybernetics (SMC 2014) proceedings, San Diego, pp 1360–1365, 10.1109/SMC.2014.6974104

  5. Bouchrika T, Jemai O, Zaied M, Ben Amar C (2014) A new hand posture recognizer based on hybrid wavelet network including a fuzzy decision support system. In: The 15th international conference on intelligent data engineering and automated learning (IDEAL 2014) proceedings, Lecture Notes in Computer Science, vol. 8669. Salamanca, pp. 183–190

  6. Bouchrika T, Jemai O, Zaied M, Ben Amar C (2015) CSWN: a cascaded architecture of separator wavelet networks for image classification. In: Proceedings of the 27th international conference on tools with artificial intelligence (ICTAI 2015). Vietri sul Mare, Italy, 10.1109/ICTAI.2015.48, pp 258–264

  7. Bouchrika T, Jemai O, Zaied M, Ben Amar C (2015) Hand posture recognizer based on separator wavelet networks. In: Proceedings of SPIE9875, Eighth International Conference on Machine Vision (ICMV 2015) Barcelone, Spain, November 19-21, 2015, 98750F (December 8, 2015); 10.1117/12.2228425

  8. Cemil O, Leu Ming C (2011) American Sign Language word recognition with a sensory glove using artificial neural networks. Eng Appl Artif Intell 24:12041213

    Google Scholar 

  9. Chang-Yi K, Chin-Shyurng F (2011) A human-machine interaction technique: Hand gesture recognition based on hidden markov models with trajectory of hand motion. Control Eng Inf Sci 15 :3739–3743

    Google Scholar 

  10. Delp D, Scott D (1989) Understanding human movement with computer graphics. SOMA Engineering for the Human Body 3(3):17–25

    Google Scholar 

  11. Fels S, Glove T (1994) Mapping hand gestures to speech using neural networks an approach to building adaptive interfaces. Ph.D. dissertation, University of Toronto

  12. Freeman T, Craig D (1994) Television control by hand gestures, technical report, mitsubishi electronic research laboratories TR-94-24

  13. Han J, Awad G, Sutherland A (2009) Modelling and segmenting subunits for sign language recognition based on hand motion analysis. Pattern Recogn Lett 30:623–633

    Article  Google Scholar 

  14. Jemai O, Zaied M, Ben Amar C, Adel Alimi M (2010) FBWN: An architecture of Fast Beta Wavelet Networks for Image Classification, 2010 IEEE World Congress on Computational Intelligence (IEEE WCCI 2010), the 2010 International Joint Conference on Neural Networks (IJCNN 2010), CCIB, Barcelona, pp 1953–1960

  15. Jemai O, Zaied M, Ben Amar C, Alimi A (2011) Fast learning algorithm of wavelet network based on Fast Wavelet Transform. Int J Pattern Recognit Artif Intell 25(8):1297–1319

    Article  MathSciNet  MATH  Google Scholar 

  16. Kumar P, Vadakkepat P, Poh L (2010) Hand posture and face recognition using a fuzzy-rough approach. Int J Humanoid Robot 7(3):331–356

    Article  Google Scholar 

  17. Lee C, Yangsheng X (1996) Online interactive learning of gestures for Human/Robot interfaces. In: 1996 IEEE international conference on robotics and automation, vol. 4, pp. 2982–2987

  18. Lv Z, Halawani A, Feng S, Li H, Rhman SU (2014) Multimodal hand and foot gesture interaction for handheld devices. ACM Trans Multimed Comput Commun Appl (TOMM) 11 (1s):10

    Google Scholar 

  19. Lv Z, Halawani A, Feng S, Rhman SU, Li H (2015) Touch-less interactive augmented reality game on vision-based wearable device. Pers Ubiquit Comput 19 (3–4):551–567

    Article  Google Scholar 

  20. Mitra S, Acharya T (2007) Gesture recognition: a survey. IEEE Trans Syst Man Cybern Part C Appl Rev 37(3):311–324

    Article  Google Scholar 

  21. Sheng C, Chih-Ming F, Chung-Lin H (2003) Hand gesture recognition using a real-time tracking method and hidden Markov models. Image Vis Comput 21:745–758

    Article  Google Scholar 

  22. Stephan J, Khudayer S (2010) Gesture recognition for Human-Computer interaction (HCI). International Journal of Advancements in Computing Technology 02 (4):30–35

    Article  Google Scholar 

  23. Stergiopoulou E, Papamarkos N (2009) Hand gesture recognition using a neural network shape fitting technique. Eng Appl Artif Intell 22:1141–1158

    Article  Google Scholar 

  24. Sushmita M, Tinku A (2007) Gesture recognition: a survey. EEE Trans Syst Man Cybern Part C Appl Rev 37(3)

  25. Triesch J, Malsburg C, Marcel S Hand posture and gesture datasets: Jochen Triesch static hand posture database, Available at http://www.idiap.ch/resources/gestures/

  26. Viola P, Jones J (2004) Michael robust real-time face detection. Int J Comput Vis 57(2):137–154

    Article  Google Scholar 

  27. Zaied M, Jemai O, Ben Amar C (2008) Training of the Beta wavelet networks by the frames theory: application to face recognition, the International Workshops on Image Processing Theory, Tools and Application. Tunisia, pp 165–170

  28. Zhou M, Wei H, Maybank S (2006) Gabor wavelets and AdaBoost in feature selection for face verification, applications of computer vision 2006 workshop in conjuction with ECCV 2006, Graz, pp 101–109

Download references

Acknowledgments

The authors would like to acknowledge the financial support of this work by grants from General Direction of Scientific Research (DGRST), Tunisia, under the ARUB program.

Author information

Authors and Affiliations

  1. Faculty of Science of Gabes, University of Gabes, Gabes, Tunisia

    Tahani Bouchrika

  2. National Engineering School of Gabes (ENIG), University of Gabes, Gabes, Tunisia

    Olfa Jemai & Mourad Zaied

  3. National Engineering School of Sfax (ENIS), University of Sfax, Gabes, Tunisia

    Chokri Ben Amar

Authors
  1. Tahani Bouchrika
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Olfa Jemai
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mourad Zaied
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chokri Ben Amar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tahani Bouchrika.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bouchrika, T., Jemai, O., Zaied, M. et al. Rapid and efficient hand gestures recognizer based on classes discriminator wavelet networks. Multimed Tools Appl 77, 5995–6016 (2018). https://doi.org/10.1007/s11042-017-4510-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4510-7

Keywords

Search

Navigation