Skip to main content
Springer Nature Link
Log in

A vision based system for communicating in virtual reality environments by recognizing human hand gestures

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Nowadays, with the emerging of the new applications like virtual reality using image processing and machine vision algorithms, it is necessary to have more modern interfaces for interaction with robots and computers. To cope with this problem, vision based gesture recognition systems play a significant role. This paper implements a vision based system for human hand gesture recognition. We propose three different methods for human hand gesture recognition, including, 1-a new method based on spatio-temporal volumes, 2-hand gesture recognition based on Motion History Image (MHI) and 3-method based on eigen space features. In these algorithms, after applying necessary pre-processing on video frames, some features are extracted for each gesture. These features are then analyzed and finally, a classification algorithm is applied for the hand gesture recognition. We tested the proposed three algorithms with the collected dataset and the results showed that proposed method based on the spatio-temporal volumes results in the correct recognition rate of 99.58 % for noiseless and 97.92 % for noisy data. Comparing the results of the proposed method based on the spatio-temporal volumes with two other methods shows that the recognition rate is improved up to 5.83 % and 8.75 % respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Allard J, Lesage J-D, Raffin B (2010) Modularity for large virtual reality applications. Presence Teleoperators Virtual Environ 19(2):142–161

    Article  Google Scholar 

  2. Basharat A, Zhai Y, Shah M (2008) Content based video matching using spatiotemporal volumes. Comput Vis Image Underst 110(3):360–377

    Article  Google Scholar 

  3. Basso V, Marello M, C B, M R (2012) Virtual reality applications as design & validation support for A&R exploration. In: International Symposium on Artificial Intelligence, Robotics and Automation in Space (i-SAIRAS)

  4. Bolduc MM, Deschênes F (2005) Collision and event detection using geometric features in spatio-temporal volumes. In: The 2nd Canadian Conference on Computer and Robot Vision. IEEE, pp 236–243

  5. Collins T (2004) Analysing Video Sequences using the Spatio-temporal. Volume. MSc Informatics Research Review

  6. Dionisio CRP, Cesar Jr RM (2000) A project for hand gesture recognition. In: XIII Brazilian Symposium on Computer Graphics and Image Processing. IEEE, p 345

  7. Freeman WT, Roth M (1995) Orientation histograms for hand gesture recognition. In: International Workshop on Automatic Face and Gesture Recognition. pp 296–301

  8. Gonçalves JG, Moltó-Caracena T, Sequeira V, Vendrell-Vidal E (2010) Virtual reality based system for nuclear safeguards applications. In: IAEA Symposium on International Safeguards

  9. Harding PR, Ellis T (2004) Recognizing hand gesture using Fourier descriptors. In: 17th International Conference on Pattern Recognition (ICPR 2004). IEEE, pp 286–289

  10. Kovalčík V, Chmelík J, Bezděka M, Sochor J (2012) Virtual reality system as a tool for education. In: 20th WSCG International Conference on Computer Graphics, Visualization and Computer Vision, June 25–28, 2012. pp 15–18

  11. Kumar S, Kumar DK, Sharma A, McLachlan N (2004) Classification of hand movements using motion templates and geometrical based moments. In: International Conference on Intelligent Sensing and Information Processing. IEEE, pp 299–304

  12. Lamar MV, Bhuiyan MS, Iwata A (1999) Hand gesture recognition using morphological principal component analysis and an improved CombNET-II. In: 1999 I.E. International Conference on Systems, Man, and Cybernetics (IEEE SMC ‘99). IEEE, pp 57–62

  13. Liu N, Lovell BC, Kootsookos PJ (2003) Evaluation of hmm training algorithms for letter hand gesture recognition. In: 3rd IEEE International Symposium on Signal Processing and Information Technology (ISSPIT 2003). IEEE, pp 648–651

  14. Moghaddam B (1999) Principal manifolds and Bayesian subspaces for visual recognition. In: Seventh IEEE International Conference on Computer Vision. IEEE, pp 1131–1136

  15. Moghaddam B, Pentland A (1997) Probabilistic visual learning for object representation. IEEE Trans Pattern Anal Mach Intell 19(7):696–710

    Article  Google Scholar 

  16. Nyamse V, Charissis V, Moore JD, Parker C, Khan S, Chan W (2013) The design considerations of a virtual reality application for heart anatomy and pathology education. In: Virtual, Augmented and Mixed Reality. Systems and Applications. Springer, pp 66–73

  17. Ohara Y, Sagawa R, Echigo T, Yagi Y (2004) Gait volume: Spatio-temporal analysis of walking. In: Proceedings of the 5th Workshop on Omni Directional Vision. pp 79–90

  18. Pedersoli F, Adami N, Benini S, Leonardi R (2012) XKin-: eXtendable hand pose and gesture recognition library for kinect. In: Proceedings of the 20th ACM international conference on Multimedia. ACM, pp 1465–1468

  19. Preston S, Matshoba L, Chang M-C (2005) A gesture driven 3D interface. Technical Report CS05-15-00, Department of Computer Science, University of Cape Town, South Africa

  20. Ristivojevic M, Konrad J (2004) Joint space-time image sequence segmentation: Object tunnels and occlusion volumes. In: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP ‘04). IEEE, pp iii-9-12 vol. 13

  21. Shalbaf R, Vafadoost M, Shalbaf A Lipreading (2007) Using image processing for helping handicap. In: 13th Iranian Conference on Biomedical Engineering (ICBME2007) Tehran, Iran

  22. Shan C, Wei Y, Qiu X, Tan T (2004) Gesture recognition using temporal template based trajectories. In: 17th International Conference on Pattern Recognition (ICPR 2004). IEEE, pp 954–957

  23. Swaminathan R, Kang SB, Szeliski R, Criminisi A, Nayar SK (2002) On the motion and appearance of specularities in image sequences. In: Computer Vision—ECCV 2002. Springer, pp 508–523

  24. Vafadar M, Behrad A (2007) Hand gesture recognition using video image processing for human-computer interaction. In: Int. Conf. on Information and knowledge Technology (IKT2007), Mashad, Iran

  25. Vafadar M, Behrad A (2008) Human hand gesture recognition using motion orientation histogram for interaction of handicapped persons with computer. In: Image and Signal Processing. Springer, pp 378–385

  26. Yoon H-S, Min B-W, Soh J, Bae Y-I, Yang HS (1999) Human computer interface for gesture-based editing system. In: International Conference on Image Analysis and Processing. IEEE, pp 969–974

  27. Zhang J, Zhang X (2013) Application of virtual reality techniques for simulation in nuclear power plant. In: Emerging Technologies for Information Systems, Computing, and Management. Springer, pp 971–976

Download references

Author information

Authors and Affiliations

  1. Electrical and Electronic Engineering Department, Faculty of Engineering, Shahed University, Tehran, Iran

    Maryam Vafadar & Alireza Behrad

Authors
  1. Maryam Vafadar
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Alireza Behrad
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Maryam Vafadar.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vafadar, M., Behrad, A. A vision based system for communicating in virtual reality environments by recognizing human hand gestures. Multimed Tools Appl 74, 7515–7535 (2015). https://doi.org/10.1007/s11042-014-1989-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-1989-z

Keywords