Skip to main content
SpringerLink
Log in

Real-time adaptive skin detection using skin color model updating unit in videos

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Skin color plays an important role in color image processing and human–computer interaction. However, factors such as rapidly changing illumination, various color styles, and camera characteristics also make skin detection a challenging task. In particular, the real-time requirement of practical applications is a challenging task in skin detection. In this paper, face detection and alignment are applied to select facial reference points for modeling the skin color distribution. Moreover, we propose the conception and detection approach of skin color model updating unit (SCMUU) according to the fact of skin color distribution remains consistent in a range of frames. The redundant operation of frame by frame updating is avoided using one model in frames of SCMUU. When no reliable faces are detected, two strategies are introduced to remedy and reduce the computational cost. It uses the corresponding model parameters if a similar previous SCMUU is found. Otherwise, we use fixed thresholds instead and increase the interval between two consecutive face detection. Besides, the time-consuming steps are accelerated using a graphic processing unit (GPU) with CUDA in this paper. Experimental results show that, compared with other existing methods, the proposed method has good real time and accuracy for skin detection of various resolution videos under different illumination conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Wang, L., Hu, W., Tan, T.: Recent developments in human motion analysis. Pattern Recogn. 36(3), 585–601 (2003)

    Article  Google Scholar 

  2. Shifa, A., Imtiaz, M.B., Asghar, M.N., Fleury, M.: Skin detection and lightweight encryption for privacy protection in real-time surveillance applications. Image Vision Comput. 94, 103859 (2020)

    Article  Google Scholar 

  3. Francke, H., Ruiz-Del-Solar, J., Verschae, R.: Real-time hand gesture detection and recognition using boosted classifiers and active learning. In: Pacific-rim symposium on image and video technology, pp. 533–547. Springer (2007)

    Google Scholar 

  4. Jones, M.J., Rehg, J.M.: Statistical color models with application to skin detection. Int. J. Comput. Vision 46(1), 81–96 (2002)

    Article  Google Scholar 

  5. Zafarifar B., Bellers EB.: With PHNd. Application and evaluation of texture-adaptive skin detection in TV image enhancement. In: 2013 IEEE International Conference on Consumer Electronics (ICCE). pp. 88–91 (2013)

  6. Chen, H.-S., Wang, T.-M., Chen, S.-H., Liu, J.-S.: Skin-color correction method based on hue template mapping for wide color gamut liquid crystal display devices. Color. Res. Appl. 36(5), 335–348 (2011)

    Article  Google Scholar 

  7. Brancati, N., De Pietro, G., Frucci, M., Gallo, L.: Human skin detection through correlation rules between the YCb and YCr subspaces based on dynamic color clustering. Comput. Vis. Image Underst. 155, 33–42 (2017)

    Article  Google Scholar 

  8. Abbas, A.R., Farooq, A.O.: Human skin colour detection using bayesian rough decision tree. In: International Conference on New Trends in Information and Communications Technology Applications, Cham. Springer, pp. 240–254 (2018)

  9. Han, J., Awad, G., Sutherland, A.: Automatic skin segmentation and tracking in sign language recognition. IET Comput. Vision 3, 24–35 (2009)

    Article  Google Scholar 

  10. Lumini, A., Nanni, L.: Fair comparison of skin detection approaches on publicly available datasets. Expert Syst. Appl. 160, 113677 (2020)

    Article  Google Scholar 

  11. Naji, S., Jalab, H.A., Kareem, S.A.: A survey on skin detection in colored images. Artif. Intell. Rev. 52(2), 1041–1087 (2019)

    Article  Google Scholar 

  12. Chai, D., Ngan, K.N.: Face segmentation using skin-color map in videophone applications. IEEE Trans. Circuits Syst. Video Technol. 9(4), 551–564 (1999)

    Article  Google Scholar 

  13. Garcia, C., Tziritas, G.: Face detection using quantized skin color regions merging and wavelet packet analysis. IEEE Trans. Multimedia 1(3), 264–277 (1999)

    Article  Google Scholar 

  14. Sobottka, K., Pitas, I.: A novel method for automatic face segmentation, facial feature extraction and tracking. Signal Process. Image Commun. 12(3), 263–281 (1998)

    Article  Google Scholar 

  15. Gupta, A., Chaudhary, A.: Robust skin segmentation using color space switching. Pattern Recognit. Image Anal. 26(1), 61–68 (2016)

    Article  Google Scholar 

  16. Lee, J.Y., Yoo, S.I.: An elliptical boundary model for skin color detection. Proc of the 2002 International Conference on Imaging Science, Systems, and Technology.579–584 (2002)

  17. Hsu, R.L., Abdel-Mottaleb, M., Jain, A.K.: Face detection in color images. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 696–706 (2002)

    Article  Google Scholar 

  18. Yang, M.H., Kriegman, D.J., Ahuja, N.: Detecting faces in images: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 24(1), 34–58 (2002)

    Article  Google Scholar 

  19. Chai, D., Phung, S.L., Bouzerdoum, A.: A Bayesian skin/non-skin color classifier using non-parametric density estimation. In: Proceedings - IEEE International Symposium on Circuits and Systems. pp. II464-II467 (2003)

  20. Phung, S.L., Chai, D., Bouzerdoum, A.: A universal and robust human skin color model using neural networks. In: Proceedings of the International Joint Conference on Neural Networks. pp. 2844–2849 (2001)

  21. Sun, H.M.: Skin detection for single images using dynamic skin color modeling. Pattern Recogn. 43(4), 1413–1420 (2010)

    Article  Google Scholar 

  22. Tan, W.R., Chan, C.S., Yogarajah, P., Condell, J.: A fusion approach for efficient human skin detection. IEEE Trans. Industr. Inf. 8(1), 138–147 (2012)

    Article  Google Scholar 

  23. Luo, Y., Guan, Y.P.: Adaptive skin detection using face location and facial structure estimation. IET Comput. Vision 11(7), 550–559 (2017)

    Article  Google Scholar 

  24. Yogarajah, P., Condell, J., Curran, K., McKevitt, P., Cheddad, A.: A dynamic threshold approach for skin tone detection in colour images. Int. J. Biometrics. 4(1), 38–55 (2012)

    Article  Google Scholar 

  25. Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vision 57, 137–154 (2004)

    Article  Google Scholar 

  26. Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition. pp. 1867–1874 (2014)

  27. Prabavathy, A.K., Shree, J.D.: Gradual transition detection in shot boundary using gradual curve point. J. Natl. Sci. Found. 46(3), 393–398 (2018)

    Google Scholar 

  28. Prabavathy, A.K., Shree, J.D.: Histogram difference with Fuzzy rule base modeling for gradual shot boundary detection in video cloud applications. Clust. Comput. 22, 1211–1218 (2019)

    Google Scholar 

  29. Li, Z., Liu, X., Zhang, S.: shot boundary detection based on multilevel difference of colour histograms. In: 2016 First International Conference on Multimedia and Image Processing (ICMIP). pp. 15–22 (1–3 June 2016 2016)

  30. Zauner, C.: Implementation and benchmarking of perceptual image hash functions. (2010)

  31. Shi, X., Shan, S., Kan, M., Wu, S., Chen, X.: Real-time rotation-invariant face detection with progressive calibration networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 2295–2303 (2018)

  32. Bilal, S., Akmeliawati, R., Salami, M.J.E., Shafie, A.A.: Dynamic approach for real-time skin detection. J. Real-Time Image Proc. 10(2), 371–385 (2015)

    Article  Google Scholar 

  33. Chen, Y.H., Hu, K.T., Ruan, S.J.: Statistical skin color detection method without color transformation for real-time surveillance systems. Eng. Appl. Artif. Intell. 25(7), 1331–1337 (2012)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by Hisense visual technology Co., Ltd. Before our source codes are uploaded to a public repository such as github, on request the authors are ready to carry out simulations with our method.

Author information

Authors and Affiliations

  1. School of Microelectronics, Tianjin University, Nankai District, Tianjin, 300072, China

    Kun Zhang, Wenyuan Li, Changlu Li & Zhichun Lei

  2. Display R&D Department, Hisense Visual Technology Co., Ltd, Qingdao, 266071, China

    Yedong Wang

Authors
  1. Kun Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yedong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wenyuan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Changlu Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zhichun Lei
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhichun Lei.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, K., Wang, Y., Li, W. et al. Real-time adaptive skin detection using skin color model updating unit in videos. J Real-Time Image Proc 19, 303–315 (2022). https://doi.org/10.1007/s11554-021-01186-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-021-01186-9

Keywords

Search

Navigation