Skip to main content

Advertisement

SpringerLink
Log in

Real-time wrist localization in color images based on corner analysis

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Hand detection and gestures recognition have become very popular in recent human-computer interaction systems. Although several methods of hand detection have been proposed in the literature, they exist few methods that use the wrist as a factor of detection, others impose constraints on the length of the sleeves and on the orientation of the hand. In this work, we present a new two-stage algorithm of wrist localization designed for hand detection and gestures recognition systems. The first stage of the algorithm consists in separating the skin region containing the hand from the background, and in the second stage, the wrist is localized from the resulted skin mask. The main contribution of the proposed method is based on the analysis of corners along the contour of the skin masks to localize the wrist emplacement. Based on an evaluation on 437 color images with their ground-truth and three sets of skin masks, we compared our method with other efficient methods of literature and the results obtained were very satisfactory.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23

Similar content being viewed by others

Notes

  1. http://sun.aei.polsl.pl/~mkawulok/gestures

References

  1. Binh N, Ejima T (2014) Real-Time Hand Gesture Recognition Using Finger Segmentation. Handawi Publ Corp Sci World J 2014:820–824

    Google Scholar 

  2. Cerlinca TI, Pentiuc SG (2011) Robust 3D hand detection for gestures recognition. Stud Comput Intell 382:259–264. doi:10.1007/978-3-642-24013-3_27

    Google Scholar 

  3. Choi J, Seo B, Park J (2009) Robust Hand Detection for Augmented Reality Interface. In: Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry. ACM, Yokohama, Japan December 14–15, 2009, pp. 319–322

  4. Erol A, Bebis G, Nicolescu M, et al. (2007) Vision-based hand pose estimation: a review. Comput Vis Image Underst 108:52–73. doi:10.1016/j.cviu.2006.10.012

    Article  Google Scholar 

  5. Grzejszczak T, Nalepa J, Kawulok M (2013) Real-Time WristLocalization in Hand Silhouettes. In: Proceedings of the 8th International Conference on Computer Recognition Systems CORES 2013. Vol 226, pp. 439–449

  6. Grzejszczak T, Kawulok M, Galuszka A (2015) Hand landmarks detection and localization in color images. Multimed Tools Appl. doi:10.1007/s11042–015–2934-5

  7. Jones MJ, Rehg JM (2002) Statistical color models with application to skin detection. Int J Comput Vis 46:81–96. doi:10.1023/A:1013200319198

    Article  MATH  Google Scholar 

  8. Jun C, Wenjun H, Qing S (2011) Binocular Vision-Based Position and Pose of Hand Detection and Tracking in Space. International Conference, ICICIS 2011, Chongqing, China, January 8–9. Vol 134, pp. 668–675

  9. Kakumanu P, Makrogiannis S, Bourbakis N (2007) A survey of skin-color modeling and detection methods. Pattern Recogn 40:1106–1122. doi:10.1016/j.patcog.2006.06.010

    Article  MATH  Google Scholar 

  10. Kawulok M (2013) Fast propagation-based skin regions segmentation in color images. 2013 10th IEEE Int Conf Work Autom Face Gesture Recognition, FG 2013. doi:10.1109/FG.2013.6553733

  11. Kawulok M, Kawulok J, Nalepa J, Smolka B (2014) Self-adaptive algorithm for segmenting skin regions. EURASIP J Adv Signal Process:1–22. doi:10.1186/1687-6180-2014-170

  12. Kerdvibulvech C (2014) A methodology for hand and finger motion analysis using adaptive probabilistic models. EURASIP J Embed Syst 2014:18. doi:10.1186/s13639–014–0018-7

    Article  Google Scholar 

  13. Keskin C, Aran O, Akarun L (2005) Real Time Gestural Interface for Generic Applications. In: Signal Processing Conference IEEE, 13th European, Antalya, pp 1–4

  14. Licsar A, Sziranyi T (2004) Hand gesture recognition in camera-projector system. Lect Notes Comput Sci:83–93. doi:10.1007/b97917

  15. Luo Z (2013) Survey of Corner Detection Techniques in Image Processing. Int J Recent Technol Eng 2:184–185

    Google Scholar 

  16. Mao G-Z, Wu Y-L, Hor M-K, Tang C-Y (2009) Real-Time Hand Detection and Tracking against Complex Background. 2009 Fifth Int Conf Intell Inf Hiding Multimed Signal Process 905–908. doi:10.1109/IIH-MSP.2009.133

  17. Mittal A, Zisserman A, Torr P (2011) Hand detection using multiple proposals. Procedings of the British Machine Vision Conference 2011 75.1–75.11. doi:10.5244/C.25.75 BMVA Press, Scotland, UK

  18. Nagarajan S, Subashini T, Ramalingam V (2012) Vision Based Real Time Finger Counter for Hand Gesture Recognition. CpmrOrg.in 2:1–5.

  19. Nelpa J, Grzejszczak T, Kawulok M (2014) Wrist Localization in Color Images For Hand Gesture Recognition. Man-Machine Interact 3(242):123–130. doi:10.1007/978–3–319-02309-0

    Google Scholar 

  20. Noreen U, Jamil M, Ahmad N (2016) Hand Detection Using HSV Model. Int J Sci Technol Res 5:195–197

    Google Scholar 

  21. Patel TP, Panchal SR (2014) Corner Detection Techniques : An Introductory Survey. Int J Eng Dev Res 2:3680–3686

    Google Scholar 

  22. Paulson B, Cummings D, Hammond T (2011) Object interaction detection using hand posture cues in an office setting. Int J Hum Comput Stud 69:19–29. doi:10.1016/j.ijhcs.2010.09.003

    Article  Google Scholar 

  23. Qiu-yu Z, Jun-chi L, Mo-yi Z, et al. (2015) Hand gesture segmentation method based on YCbCr color space and K-means clustering. Int J signal process image process Pattern Recogn 8:105–116

    Google Scholar 

  24. Medjram S, Babahenini MC, Mohamed Benali Y, Abdelmalik T-A (2016) Improving the Method of Wrist Localization Local Minimum-Besed for Hand Detection. In: Modelling and Implementation of Complex Systems. Springer, Constantine, Algeria, pp. 153–163

  25. Song Z, Yang H, Zhao Y, Zheng F (2010) Hand detection and gesture recognition exploit motion times image in complicate scenarios. Advances in Visual Computing 6th International Symposium, ISVC 2010, Las Vegas, NV, USA. Vol 6454, pp. 628–636

  26. Stergiopoulou E, Papamarkos NÃ (2009) Engineering applications of artificial intelligence hand gesture recognition using a neural network shape fitting technique. Eng Appl Artif Intell 22:1141–1158. doi:10.1016/j.engappai.2009.03.008

    Article  Google Scholar 

  27. Suksil T, Chalidabhongse TH (2013) Hand detection and feature extraction for static Thai Sign Language recognition. Proc 7th Int Conf Ubiquitous Inf Manag Commun - ICUIMC ‘13 1–6. doi:10.1145/2448556.2448579

  28. Thuy Thi N, Dang Nguyen B, Bischof H (2008) An active boosting-based learning framework for real-time hand detection. 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition, Amsterdam, 1–6. doi:10.1109/AFGR.2008.4813315

  29. Toni B, Darko J, (2012) A robust hand detection and tracking algorithm with application to natural user interface. MIPRO, 2012 Proceedings of the 35th International Convention 1768–1774, IEEE, Opatija, Croatia.

  30. Trigueiros P, Ribeiro F, Reis LP (2014) Vision-Based Portuguese Sign Language Recognition System. doi:10.1007/978–3–319-05951-8

  31. Vidya K, Deryl R, Dinesh K, et al. (2014) Enhancing hand interaction patterns for virtual objects in mobile augmented reality using marker-less tracking. In: International Conference on Computing for Sustainable Global Development, INDIACom 2014, IEEE, New Delhi India, pp 705–709

  32. Wang RY, Popović J (2009) Real-time hand-tracking with a color glove. ACM Trans Graph 28:1. doi:10.1145/1531326.1531369

    Google Scholar 

  33. Wang YR, Lin WH, Yang L (2015) An improved hand detection by employing corner detector. Proc - Int Conf Mach Learn Cybern 1:414–419. doi:10.1109/ICMLC.2014.7009151

    Google Scholar 

  34. Xiao B, Xu XM, QP M (2010) Real-time hand detection and tracking using LBP features. 6th International Conference, ADMA 2010, Chongqing, China, November 19-21. Vol 6441, pp. 282–289

  35. Xie S, Pan J (2011) Hand Detection Using Robust Color Correction and Gaussian Mixture Model. In: 2011 Sixth International Conference on Image and Graphics IEEE, Hefei, Anhui, pp 553–557

  36. Yeo HS, Lee BG, Lim H (2013) Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware. Multimed Tools Appl:1–29. doi:10.1007/s11042-013-1501-1

  37. Yogarajah P, Condell J, Curran K, et al. (2010) A dynamic threshold approach for skin segmentation in color images. Proc - Int Conf Image Process ICIP:2225–2228. doi:10.1109/ICIP.2010.5652798

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, LRI, University of Badji Mokhtar, B.P 12, 23000, Annaba, Algeria

    Sofiane Medjram & Yamina Mohamed Ben Ali

  2. Computer Science Department, LESIA, University of Mohamed Khider, B.P 145, 07000, Biskra, Algeria

    Mohamed Chaouki Babahenini

  3. LAMIH UMR CNRS 8201 University of Valenciennes and Hainaut-Cambresis, Valenciennes, France

    Abdelmalik Taleb-Ahmed

Authors
  1. Sofiane Medjram
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohamed Chaouki Babahenini
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abdelmalik Taleb-Ahmed
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yamina Mohamed Ben Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sofiane Medjram.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Medjram, S., Babahenini, M.C., Taleb-Ahmed, A. et al. Real-time wrist localization in color images based on corner analysis. Multimed Tools Appl 76, 15297–15324 (2017). https://doi.org/10.1007/s11042-016-3820-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3820-5

Keywords

Search

Navigation