Skip to main content
SpringerLink
Log in

Multiple color space channel fusion for skin detection

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Skin detection is used in applications ranging from face detection, tracking body parts and hand gesture analysis, to retrieval and blocking of objectionable content. We investigate color based skin detection. We linearly merge different color space channels representing it as a fusion process. The aim of fusing different color space channels is to achieve invariance against varying imaging and illumination conditions. The non-perfect correlation between the color spaces is exploited by learning weights based on an optimization for a particular color space channel using the mathematical financial model of Markowitz. The weight learning process develops a color weighted model using positive training data only. Experiments on a database of 8991 images with annotated pixel-level ground truth show that the fusion of color space channels approach is well suited to stable and robust skin detection. In terms of precision and recall, the fusion approach provides a competitive performance to other state-of-the-art approaches which require negative and positive training data with the exception of the decision tree based classifier (J48). As a real-time application, we show that the weight based color channel fusion approach can be used for learning of weights for skin detection based on detected faces in image sequences.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Notes

  1. http://disi.unitn.it/~stottinger/Data-sets.html

References

  1. Argyros AA, Lourakis MI (2004) Real-time tracking of multiple skin-colored objects with a possibly moving camera. In: ECCV, pp 368–379

  2. Brown D, Craw I, Lewthwaite J (2001) A SOM based approach to skin detection with application in real time systems. In: BMVC’01, pp 491–500

  3. Cai J, Goshtasby A (1999) Detecting human faces in color images. Image Vis Comput 18:63–75

    Article  Google Scholar 

  4. Chai D, Ngan K (1998) Locating facial region of a head-and-shoulders color image. In: Int. conf. automatic face and gesture recognition, pp 124–129

  5. Fleck MM, Forsyth DA, Bregler C (1996) Finding naked people. In: ECCV, pp 593–602

  6. Fu Z, Yang J, Hu W, Tan T (2004) Mixture clustering using multidimensional histograms for skin detection. In: ICPR. Washington, DC, USA, pp 549–552

  7. Garcia C, Tziritas G (1999) Face detection using quantized skin color regions merging and wavelet packet analysis. IEEE Trans Multimedia 1:264–277

    Article  Google Scholar 

  8. Hanbury A (2003) A 3d-polar coordinate colour representation well adapted to image analysis. In: SCIA, pp 804–811

  9. Hsu R, Abdel-Mottaleb M, Jain A (2002) Face detection in color images. PAMI 24:696–706

    Article  Google Scholar 

  10. Jones MJ, Rehg JM (2002) Statistical color models with application to skin detection. IJCV 46:81–96

    Article  MATH  Google Scholar 

  11. Kakumanu P, Makrogiannis S, Bourbakis N (2007) A survey of skin-color modeling and detection methods. PR 40:1106–1122

    Article  MATH  Google Scholar 

  12. Khan R, Hanbury A, Sablatnig R, Stöttinger J, Khan F, Khan F (2012) Systematic skin segmentation: merging spatial and non-spatial data. Multimed Tools Appl 1–25

  13. Khan R, Hanbury A, Stöttinger J (2010) Skin detection: a random forest approach. In: ICIP, pp 4613–4616

  14. Khan R, Hanbury A, Stöttinger J (2010) Universal seed skin segmentation. In International symposium on visual computing, pp 75–84

  15. Khan R, Hanbury A, Stöttinger J, Bais A (2012) Color based skin classiffcation. Pattern Recogn Lett 33(2):157–163

    Article  Google Scholar 

  16. Khan R, Stöttinger J, Kampel M (2008) An adaptive multiple model approach for fast content-based skin detection in on-line videos. In: ACM MM, AREA workshop, pp 89–96

  17. Lee JS, Kuo YM, Chung PC, Chen EL (2007) Naked image detection based on adaptive and extensible skin color model. PR 40:2261–2270

    Article  MATH  Google Scholar 

  18. Markowitz H (1952) Portfolio selection. Journal of Finance 7:77–91

    Google Scholar 

  19. Peer P, Kovac J, Solina F (2003) Human skin colour clustering for face detection. In: EUROCON, vol 2, pp 144–148,

  20. Phung SL, Bouzerdoum A, Chai D (2005) Skin segmentation using color pixel classiffcation: analysis and comparison. PAMI 27:148–154

    Article  Google Scholar 

  21. Sigal L, Sclaroff S, Athitsos V (2004) Skin color-based video segmentation under time-varying illumination. PAMI 26:862–877

    Article  Google Scholar 

  22. Stokman H, Gevers T (2005) Selection and fusion of color models for feature detection. In: Proceedings of the CVPR. IEEE Computer Society, Washington, DC, USA, pp 560–565

    Google Scholar 

  23. Stokman H, Gevers T (2007) Selection and fusion of color models for image feature detection. IEEE Trans Pattern Anal Mach Intell 29:371–381

    Article  Google Scholar 

  24. Störring M, Andersen H, Granum E (2000) Estimation of the illuminant colour from human skin colour. In: IEEE International conference on automatic face and gesture recognition, pp 64–69

  25. Stöttinger J, Hanbury A, Liensberger C, Khan R (2009) Skin paths for contextual agging adult videos. In: International symposium on visual computing, pp 303–314

  26. Vezhnevets V, Sazonov V, Andreev A (2003) A survey on pixel-based skin color detection techniques. In: GraphiCon, pp 85–92

  27. Wong K, Lam K, Siu W (2003) A robust scheme for live detection of human faces in color images. Signal Process Image Commun 18:103–114

    Article  Google Scholar 

  28. Yang J, Lu W, Waibel A (1997) Skin-color modeling and adaptation. In: ACCV, pp 687–694

  29. Yang M, Ahuja N (1999) Gaussian mixture model for human skin color and its application in image and video databases. In: SPIE, pp 458–466

Download references

Author information

Authors and Affiliations

  1. Sarhad University of Science and IT, Peshawar, Pakistan

    Rehanullah Khan & Amjad Ali

  2. Institute for Software Technology & Interactive Systems, TU-Wien, Vienna, Austria

    Allan Hanbury

  3. Department of Information Engineering and Computer Science, University of Trento, Trento, Italy

    Julian Stöttinger

  4. COMSATS Institute of Information Technology, Attock Campus, Attock, Pakistan

    Farman Ali Khan

  5. UET, Peshawar, Pakistan

    Amjad Ullah Khattak

Authors
  1. Rehanullah Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Allan Hanbury
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Julian Stöttinger
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Farman Ali Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Amjad Ullah Khattak
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Amjad Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rehanullah Khan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Khan, R., Hanbury, A., Stöttinger, J. et al. Multiple color space channel fusion for skin detection. Multimed Tools Appl 72, 1709–1730 (2014). https://doi.org/10.1007/s11042-013-1443-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1443-7

Keywords

Search

Navigation