Skip to main content
SpringerLink
Log in

Fast and robust head detection with arbitrary pose and occlusion

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Head detection in images and videos plays an important role in a wide range of computer vision and surveillance applications. Aiming to detect heads with arbitrarily occluded faces and head pose, in this paper, we propose a novel Gaussian energy function based algorithm for elliptical head contour detection. Starting with the localization of head and shoulder by an improved Gaussian Mixture Model (GMM) approach, the precise head contour is obtained by making use of the Omega shape formed from the head and shoulder. Experimental results on several benchmark datasets demonstrate the superiority of the proposed idea over the state-of-the-art in both detection accuracy and processing speed, even though there are various types of severe occlusions in faces.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Alexander B, Rainer H (2005) Robust head detection and tracking in cluttered workshop environments using GMM. Lect Notes Comput Sci 3663:442–450

    Article  Google Scholar 

  2. Ba SO, Odobez JM (2004) A probabilistic framework for joint head tracking and pose estimation. In: IEEE international conference on pattern recognition (ICPR)

  3. Birchfield S (1998) Elliptical head tracking using intensity gradients and color histograms. In: Proceedings of CVPR, pp 232–237

  4. Blanz V, Grother P, Phillips PJ, Vetter T (2005) Face recognition based on frontal views generated from non-frontal images. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 454–461

  5. Chen ML, Kee S (2005) Head tracking with shape modeling and detection. In: Proceedings of the second Canadian conference on computer and robot vision, IEEE, Canada, pp 483–488

  6. Dong L, Tao L, Xu G (2010) Head pose estimation using covariance of oriented gradients. In: IEEE international conference on acoustics, speech, and signal processing (ICASSP), pp 1470–1473

  7. EC Funded CAVIAR project/IST 2001 37540, found at URL: http://homepages.inf.ed.ac.uk/rbf/CAVIAR/

  8. Gong L, Wang T, Liu F (2009) Shape of Gaussians as feature descriptors. In: IEEE computer vision and pattern recognition (CVPR), pp 2366–2371

  9. Gourier N, Maisonnasse J, Hall D, Crowley JL (2006) Head pose estimation on low resolution images. In: CLEAR workshop, in conjunction with face and gesture

  10. Hsu RL, Abdel-Mottaleb M, Jain AK (2002) Face detection in color images. IEEE Trans PAMI 24(5):696–706

    Article  Google Scholar 

  11. Hu C, Gong L, Wang T, Feng Q (2013) Effective head pose estimation using lie algebrized Gaussians. In: IEEE international conference on multimedia and expo (ICME)

  12. Hu CL, Gong LY, Wang TJ, Liu F, Feng Q (2013) An effective head pose estimation approach using Lie Algebrized Gaussians based face representation. Multimedia Tools Appl. doi:10.1007/s11042-013-1676-5

    Google Scholar 

  13. Ishii Y, Hongo H, Yamamoto K, Niwa Y (2004) Face and head detection for a real-time surveillance system. Proc Int Conf Pattern Recognit 3:298–301

    Google Scholar 

  14. Kim G, Suhr JK, Jung HG, Kim J (2010) Face occlusion detection by using b-spline active contour and skin color information. In: Proceedings of international conference on control, automation, robotics and vision, pp 627–632

  15. Li H, Achim A, Bull DR (2009) GMM-based efficient foreground detection with adaptive region update. In Proceedings of IEEE international conference on image processing, pp 3181–3184

  16. Lim J, Kim W (2012) Detecting and tracking of multiple pedestrians using motion, color information and the AdaBoost algorithm. Multimedia Tools and Appl. doi:10.1007/s11042-012-1156-3

    Google Scholar 

  17. Liu XW, Tian SS, Jiang JF, Shen J (2012) Moving human head detection for automatic passenger counting system. Recent Adv Comput Sci Inf Eng 125:147–152

    Article  Google Scholar 

  18. Maggio E, Piccardo E, Regazzoni C, Cavallaro A (2007) Particle PHD filter for multi-target visual tracking. In: Proceedings of IEEE international conference on acoustics, speech and signal processing, pp 15–20

  19. Marciniak T, Chmielewska A, Weychan R, Parzych M, Dabrowski A (2013) Influence of low resolution of images on reliability of face detection and recognition. Multimedia Tools Appl. doi:10.1007/s11042-013-1568-8

    Google Scholar 

  20. Nanda H, Fujimura K (2004) A robust elliptical head tracker. Proceeding of sixth IEEE international conference of face and gesture recognition, vol 5, pp 469–474

  21. Sun SW, Cheng WH, Lin YC, Lin WC, Chang YT, Peng CW (2013) What-a-mole: a head detection scheme by estimating the 3D envelope from depth image. The 2013 I.E. international conference on multimedia and expo (ICME 2013), pp 1–4

  22. Wu J, Trivedi M (2008) A two-stage head pose estimation framework and evaluation. Pattern Recogn 41(3):1138–1158

    Article  MATH  Google Scholar 

  23. Xu L, Oja E, Kultanena P (1990) A new curve detection method: Randomized Hough Transform (RHT). Pattern Recogn Lett 11:331–338

    Article  MATH  Google Scholar 

  24. Yang MH, Kriegman D, Ahuja N (2002) Detecting faces in images: a survey. IEEE Trans Pattern Anal Mach Intell 24(1):34–58

    Article  Google Scholar 

  25. Yang T, Pan Q, Li J, Cheng YM (2004) Real-time head tracking system with an active camera. Proceedings of the 5th world congress on intelligent control and automation, pp 1910–1914

  26. Yang JF, Yang WL, Li MG (2012) An efficient moving object detection algorithm based on improved GMM and cropped frame technique. In: Proceedings of 2012 I.E. international conference on mechatronics and automation, pp 658–663

  27. Yao ZR, Li HB (2006) Tracking a detected face with dynamic programming. Image Vis Comput 24(6):573–580

    Article  MathSciNet  Google Scholar 

  28. Yoon H, Kim D, Chi S, Cho YJ (2006) A robust human head detection method for human tracking. In: Proceeding of: intelligent robots and systems, pp 4558–4563

  29. Zhan J, Chen CH (2007) Moving object detection and segmentation in dynamic video backgrounds. In: Proceedings of IEEE conference on computer vision, May, pp 64–69

  30. Zhang Z, Gunes H, Piccardi M (2008) An accurate algorithm for head detection based on XYZ and HSV hair and skin color models. 15th IEEE international conference on image processing, pp 1644–1647

  31. Zhang SC, Liu ZQ (2005) A robust, real-time ellipse detector. Pattern Recogn 38(2):273–287

    Article  MATH  Google Scholar 

  32. Zou W, Li Y, Yuan K, Xu D (2009) Real-time elliptical head contour detection under arbitrary pose and wide distance range. J Vis Commun Image R 20:217–228

    Article  Google Scholar 

Download references

Acknowledgments

This research is partly supported by NSFC, China (No: 61273258, 61105001).

Author information

Authors and Affiliations

  1. Shanghai Jiao Tong University, Institute of Image Processing and Pattern Recognition, 800 Dongchuan Road, Shanghai, China, 200000

    Tao Zhang, Zhijie Yang & Jie Yang

  2. Faculty of Engineering and Information Technology, University of Technology, Sydney, PO Box 123, Broadway, NSW, 2007, Australia

    Wenjing Jia, Qiang Wu & Xiangjian He

Authors
  1. Tao Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhijie Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wenjing Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Qiang Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jie Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xiangjian He
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tao Zhang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, T., Yang, Z., Jia, W. et al. Fast and robust head detection with arbitrary pose and occlusion. Multimed Tools Appl 74, 9365–9385 (2015). https://doi.org/10.1007/s11042-014-2110-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-2110-3

Keywords

Search

Navigation