Skip to main content
SpringerLink
Log in

Image specific discriminative feature extraction for skin segmentation

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In recent times, the majority of colour-based skin detection methods used skin modelling in different colour spaces, and they are capable of skin classification at a pixel level. However, the accuracy of these methods is significantly affected by different issues, such as the presence of skin-like colours in scene background, variations in skin pigmentation, scene illumination, etc. Recent developments show that the discriminating power of a colour-based skin classifier can be increased by employing texture and spatial features. However, we observed that discriminability between skin and non-skin regions does not follow any statistics, and the discrimination is extremely image specific. In this paper, a novel adaptive discriminative analysis (ADA) is proposed to extract most discriminant features between skin and non-skin regions from an image itself in an unsupervised manner. Experimental results for standard databases show that the proposed method can efficiently segment out skin pixels in the presence of skin-like background colours.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Adams R, Bischof L (1994) Seeded region growing. IEEE Trans Pattern Anal Mach Intell 16(6):641–647

    Google Scholar 

  2. Chai D, Ngan K (1999) Face segmentation using skin-color map in videophone applications. IEEE Trans Circuits Syst Video Technol 9(4):551–564

    Google Scholar 

  3. Chakraborty BK, Bhuyan M, Kumar S (2017) Combining image and global pixel distribution model for skin colour segmentation. Pattern Recogn Lett 88:33–40

    Google Scholar 

  4. Chakraborty BK, Bhuyan MK (2015) Skin segmentation using possibilistic fuzzy c-means clustering in presence of skin-colored background. In: Proc. IEEE Recent Adv. Intel. Comp. Systs (RAICS), pp 246–250

    Google Scholar 

  5. Chakraborty BK, Bhuyan MK, Kumar S (2016) Adaptive propagation-based skin segmentation method for color images. In: Proc. National Conf. Comm., pp 94–99

    Google Scholar 

  6. Chakraborty BK, Bhuyan MK, Kumar S (2016) Fusion-based skin detection using image distribution model. In: Proc. Tenth Indian Conf. Comp. Vis. Graphics and Image Process., pp 67:1–67:8

    Google Scholar 

  7. Chakraborty BK, Bhuyan MK, Kumar S (2016) A weighted skin probability map for skin color segmentation. In: Proc. Int. Conf. Wireless Commun., Signal Process. and Network. (WiSPNET), pp 2133–2136

    Google Scholar 

  8. Chen L, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2018) Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848

    Google Scholar 

  9. Chen L, Zhou J, Liu Z, Chen W, Xiong G (2002) A skin detector based on neural network. In: Proc. IEEE Int. Conf. Commun., Circuits and Syst. and West Sino Expositions, pp 615–619

    Google Scholar 

  10. Chen W, Wang K, Jiang H, Li M (2016) Skin color modeling for face detection and segmentation: a review and a new approach. Multimed Tools Appl 75 (2):839–862

    Google Scholar 

  11. Dumitrescu C, Dumitrache I (2013) Human skin detection using texture information and vector processing techniques by neural networks. In: Dumitrache L (ed) Adv. in Intell. Control Syst. and Comp. Sc., Adv.. Intell. Syst. and Comp., vol 187. Springer, Berlin, pp 59–75

  12. Fouad RM, Omer OA, Aly MH (2019) Optimizing remote photoplethysmography using adaptive skin segmentation for real-time heart rate monitoring. IEEE Access 7:76513–76528

    Google Scholar 

  13. Han J, Award G, Sutherland A, Wu H (2006) Automatic skin segmentation for gesture recognition combining region and support vector machine active learning. In: Proc. 7th Int. Conf. Autom. Face and Gesture Recogn., pp 237–242

    Google Scholar 

  14. Hettiarachchi R, Peters J (2016) Multi-manifold-based skin classifier on feature space voronoï regions for skin segmentation. J Vis Commun Image R 41:123–139

    Google Scholar 

  15. Hsu RL, Abdel-Mottaleb M, Jain A (2002) Face detection in color images. IEEE Trans Pattern Anal Mach Intell 24(5):696–706

    Google Scholar 

  16. Ikonen L, Toivanen P (2007) Distance and nearest neighbor transforms on gray-level surfaces. Pattern Recogn Lett 28(5):604–612

    Google Scholar 

  17. Jiang Z, Yao M, Jiang W (2007) Skin detection using color, texture and space information. In: Proc. Fourth Int. Conf. Fuzzy Syst. and Knowledge Discovery, vol 3, pp 366–370

  18. Jones MJ, Rehg J (2002) Statistical color models with application to skin detection. Int J Comput Vis 46(1):81–96

    MATH  Google Scholar 

  19. Kakumanu P, Makrogiannis S, Bourbakis N (2007) A survey of skin-color modeling and detection methods. Pattern Recogn 40(3):1106–1122

    MATH  Google Scholar 

  20. Kawulok M (2013) Fast propagation-based skin regions segmentation in color images. In: Proc. 10th IEEE Int. Conf. and Workshops Autom. Face and Gesture Recogn. (FG), pp 1–7

    Google Scholar 

  21. Kawulok M, Kawulok J, Nalepa J (2014) Spatial-based skin detection using discriminative skin-presence features. Pattern Recogn Lett 41(0):3–13

    Google Scholar 

  22. Kawulok M, Kawulok J, Nalepa J, Papiez M (2013) Skin detection using spatial analysis with adaptive seed. In: Proc. IEEE Int. Conf. Image Process. (ICIP), pp 3720–3724

    Google Scholar 

  23. Kawulok M, Kawulok J, Nalepa J, Smolka B (2014) Self-adaptive algorithm for segmenting skin regions. EURASIP J Adv Signal Process 2014:170

    Google Scholar 

  24. Khan R, Hanbury A, Stoettinger J (2010) Skin detection: A random forest approach. In: Proc. 17th IEEE Int. Conf. Image Process. (ICIP), pp 4613–4616

    Google Scholar 

  25. Khan SS, Ahmad A (2004) Cluster center initialization algorithm for k-means clustering. Pattern Recogn Lett 25(11):1293–1302

    Google Scholar 

  26. Ladicky L, Russell C, Kohli P, Torr PH (2009) Associative hierarchical crfs for object class image segmentation. In: Proc. IEEE ICCV

    Google Scholar 

  27. Lei Y, Yuan W, Wang H, Wenhu Y, Bo W (2017) A skin segmentation algorithm based on stacked autoencoders. IEEE Trans Multimedia 19(4):740–749

    Google Scholar 

  28. Li B, Xue X, Fan J (2007) A robust incremental learning framework for accurate skin region segmentation in color images. Pattern Recogn 40(12):3621–3632

    MATH  Google Scholar 

  29. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proc. CVPR, pp 3431–3440

    Google Scholar 

  30. Luo Y, Guan Y (2017) Adaptive skin detection using face location and facial structure estimation. IET Computer Vis 11(7):550–559

    Google Scholar 

  31. Ma C, Shih H (2018) Human skin segmentation using fully convolutional neural networks. In: IEEE Global Conf. Consumer Elect. (GCCE), pp 168–170

    Google Scholar 

  32. Mottaghi R, Chen X, Liu X, Cho NG, Lee SW, Fidler S, Urtasun R, Yuille A (2014) The role of context for object detection and semantic segmentation in the wild. In: Proc. CVPR, pp 891–898

    Google Scholar 

  33. Naji S, Jalab HA, Kareem SA (2019) A survey on skin detection in colored images. Artif Intell Rev 52(2):1041–1087

    Google Scholar 

  34. Nalepa J, Grzejszczak T, Kawulok M (2014) Wrist localization in color images for hand gesture recognition. In: Gruca DA, Czachórski T, Kozielski S (eds) Man-Machine Interactions 3, Adv. Intell. Syst. and Comp, vol 242. Springer International Publishing, pp 79–86

  35. Ng P, Pun CM (2011) Skin color segmentation by texture feature extraction and k-mean clustering. In: Proc. 3rd Int. Conf. Comput. Intell., Commun. Syst. and Netw. (CICSyN), pp 213–218

    Google Scholar 

  36. Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man and Cybernetics 9(1):62–66

    Google Scholar 

  37. Pal N, Pal K, Keller J, Bezdek J (2005) A possibilistic fuzzy c-means clustering algorithm. IEEE Trans Fuzzy Syst 13(4):517–530

    Google Scholar 

  38. Phung S, Bouzerdoum A, Chai D Sr (2005) Skin segmentation using color pixel classification: analysis and comparison. IEEE Trans Pattern Anal Mach Intell 27 (1):148–154

    Google Scholar 

  39. Rautaray S, Agrawal A (2012) Vision based hand gesture recognition for human computer interaction: a survey. Artificial Intell Review: 1–54

  40. Sandbach G, Zafeiriou S, Pantic M, Yin L (2012) Static and dynamic 3d facial expression recognition: A comprehensive survey. Image Vis Comput 30(10):683–697

    Google Scholar 

  41. Sawicki DJ, Miziolek W (2015) Human colour skin detection in cmyk colour space. IET Image Process 9(9):751–757

    Google Scholar 

  42. Shih H, Chen J (2019) Multiskin color segmentation through morphological model refinement. IEEE Trans Emerging Topics in Comput Intell 1:1–11

    Google Scholar 

  43. Sobottka K, Pitas I (1998) A novel method for automatic face segmentation, facial feature extraction and tracking. Signal Process.: Image Commun 12(3):263–281

    Google Scholar 

  44. Tan WR, Chan CS, Yogarajah P, Condell J (2012) A fusion approach for efficient human skin detection. IEEE Trans Ind Inform 8(1):138–147

    Google Scholar 

  45. Trindade P, Lobo J, Barreto J (2012) Hand gesture recognition using color and depth images enhanced with hand angular pose data. In: Proc. IEEE Conf. Multisensor Fusion and Integration for Intell Syst (MFI), pp 71–76

    Google Scholar 

  46. Tu Z, Bai X (2010) Auto-context and its application to high-level vision tasks and 3d brain image segmentation. IEEE Trans Pattern Anal Mach Intell 32(10):1744–1757

    Google Scholar 

  47. Wang X, Chen R, Yan F, Zeng Z, Hong C (2019) Fast adaptive k-means subspace clustering for high-dimensional data. IEEE Access 7:42639–42651

    Google Scholar 

  48. Xu D, Chen YL, Wu X, Ou Y, Xu Y (2011) Integrated approach of skin-color detection and depth information for hand and face localization. In: Proc. IEEE Int. Conf. Robotics and Biomimetics (ROBIO), pp 952–956

    Google Scholar 

  49. Xu T, Wang Y, Zhang Z (2013) Pixel-wise skin colour detection based on flexible neural tree. IET Image Process 7(8):751–761

    Google Scholar 

  50. Yang J, Lu W, Waibel A (1997) Skin-color modeling and adaptation. In: Chin R, Pong TC (eds) Computer Vision — ACCV’98, Lecture Notes in Computer Science, vol 1352. Springer, Berlin, pp 687–694

  51. Zheng S, Jayasumana S, Romera-Paredes B, Vineet V, Su Z, Du D, Huang C, Torr PHS (2015) Conditional random fields as recurrent neural networks. In: Proc. ICCV, pp 1529–1537

    Google Scholar 

  52. Zhu X, Yang J, Waibel A (2000) Segmenting hands of arbitrary color. In: Proc. Fourth IEEE Int. Conf. Autom. Face and Gesture Recogn, pp 446–453

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Sankhyasutra Labs Pvt. Ltd, Bangalore, India

    Biplab Ketan Chakraborty

  2. Department of Electronics and Electrical Engineering, IIT Guwahati, Guwahati, 781039, India

    M. K. Bhuyan

Authors
  1. Biplab Ketan Chakraborty
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. K. Bhuyan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Biplab Ketan Chakraborty.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chakraborty, B., Bhuyan, M. Image specific discriminative feature extraction for skin segmentation. Multimed Tools Appl 79, 18981–19004 (2020). https://doi.org/10.1007/s11042-020-08762-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-08762-4

Keywords

Search

Navigation