Abstract
Face detection is important for computer vision. Until now, the Viola and Jones algorithm is still the most popular face detector embedded in digital cameras. Although it has good performance in frontal face detection, it may not perform well in detecting rotated, head-up, and head-down faces. In this paper, we propose a more robust face detector based on prominent feature extraction. We find that, in addition to using eyes and mouth, which have been adopted by other algorithms, noses and ears are also important clues for face detection. Particularly, for a profile face, only a single eye can be detected. For head-up or head-down faces, eyes and mouth may not be well detected. However, in these cases, noses and ears can still be detected well and we can apply these features to improve the accuracy of rotated, head-up, and head-down face detection. To well detect these prominent features, in addition to the Viola–Jones detector, we also apply edge and color information and use the refocus algorithm based on the convolutional neural network. Simulations conducted on several popular multi-view face databases show that the proposed face detector can attain higher detection rates and is robust to rotated, head-up, and head-down cases.
Similar content being viewed by others
References
Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)
Viola, P., Jones, M.J.: Rapid object detection using a boosted cascade of simple features. In: IEEE Conference Computer Vision and Pattern Recognition, pp. 511–518 (2001)
Yong, Y., Ding, X.: Real-time multi-view face detection and pose estimation based on cost-sensitive Adaboost. Tsing Hua Science and Technology 10(2), 152–157 (2005)
Huang, C., Ai, H., Wu, B., Lao, S.: Boosting nested cascade detector for multi-view face detection. In: International Conference Pattern Recognition, pp. 415–418 (2004)
Kang, S., Choi, B., Jo, D.: Faces detection method based on skin color modeling. J. Syst. Architect. 64, 100–109 (2016)
Ghimire, D., Lee, J.: A robust face detection method based on skin color and edges. J. Inf. Process. Syst. 9(1), 141–156 (2013)
Hsu, R.L., Abdel-Mottaleb, M., Jain, A.K.: Face detection in color images. IEEE Trans. Patt. Anal. Mach. Intell. 24(5), 696–706 (2002)
Kaddouhi, S.E., Saaidi, A., Abarkan, M.: A new robust face detection method based on corner points, In. J. Softw. Eng. Appl. 8(11), 25–40 (2014)
Zhu, X., Ramanan, D.: Face detection, pose estimation, and landmark localization in the wild. In: IEEE Conference Computer Vision and Pattern Recognition, pp. 2879–2886 (2012)
Cevikalp, H., Triggs, B.: Efficient object detection using cascades of nearest convex model classifiers. In: IEEE Conference Computer Vision and Pattern Recognition, pp. 3138–3145 (2012)
Ghiasi G., Fowlkes, C.: Occlusion coherence: Localizing occluded faces with a hierarchical deformable part model. In: IEEE Conference Computer Vision and Pattern Recognition, pp. 2385–2392 (2014)
Tsai, Y.H., Lee, Y.C., Ding, J.J., Chang, R.Y., Hsu, M.C.: Robust in-plane and out-of-plane face detection algorithm using frontal face detector and symmetry extension. Image Vis. Comput. 78, 26–41 (2018)
Li, H., Lin, Z., Shen, X., Brandt, J., Hua, G.: A convolutional neural network cascade for face detection. In: International Conference Computer Vision, pp. 5325–5334 (2015)
Farfade, S.S., Saberian, M., Li, L.J.: Multi-view face detection using deep convolutional neural networks. In: ACM International Conference Multimedia Retrieval, pp. 643–650 (2015)
Zhang, C., Zhang, Z.: Improving multiview face detection with multi-task deep convolutional neural networks. In: IEEE Winter Conference Applications of Computer Vision, pp. 1036–1041 (2014)
Jourabloo, A., Liu, X.: Large-pose face alignment via CNN-based dense 3D model fitting. In: IEEE Conference Computer Vision and Pattern Recognition, pp. 4188–4196 (2016)
Alotaibi, A., Mahmood, A.: Deep face liveness detection based on nonlinear diffusion using convolution neural network. SIViP 11(4), 713–720 (2017)
Zhang, Z., Luo, P., Loy, C.C., Tang, X.: Facial landmark detection by deep multi-task learning. In: European Conference Computer Vision, pp. 94–108 (2014)
Yang, B., Yan, J., Lei, Z., Li, S.Z.: Aggregate channel features for multi-view face detection. In: IEEE International Joint Conference Biometrics, pp. 1–8 (2014)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2017)
Xu, L., Ren, J., Yan, Q., Liao, R., Jia, J.: Deep edge-aware filters. In: International Conference Machine Learning, pp. 1669–1678 (2015)
Chang, C.C., Lin, C.J.: LIBSVM: A library for support vector machines. ACM Trans. Intel. Syst. Tech. 2(3), 27 (2011)
Hu, J.L., Deng, J.B., Zou, S.S.: A novel algorithm for color space conversion model from CMYK to LAB. J. Multimedia 5(2), 159–166 (2010)
Cheng, H.D., Shi, X.J.: A simple and effective histogram equalization approach to image enhancement. Dig. Signal Proc. 14(2), 158–170 (2004)
The FEI database will be available at http://fei.edu.br/~cet/facedatabase.html. Accessed Mar 2006
Liu, J.Z., Li, W.Q., Tian, Y.P.: Automatic thresholding of gray-level pictures using two-dimension Otsu method. In: IEEE International Conference Circuits and Systems. pp. 325–327 (1991)
Chen, C.Y., Ding, J.J., Huang, C.W., Advanced ear detection algorithm using faster R-CNN, refocus filters, and the gradient map. In: IEEE International Conference Digital Signal Processing, pp. 1–5 (2018)
Chen, C.Y., Ding, J.J., Hsu, H.W., Lee, Y.C., Advanced orientation robust face detection algorithm using prominent features and hybrid learning techniques. In: IEEE Conference Visual Communications and Image Processing, pp. 1–4 (2018)
Xu, L., Lu, C., Xu, Y., Jia, J.: Image smoothing via L0 gradient minimization. ACM Trans. Graph. 30(6), 174 (2011)
The Pointing’04. http://www-prima.inrialpes.fr/FGnet/data/13-MoeslundHead/Pointing04/. Accessed Aug 2004
The USTB. http://www1.ustb.edu.cn/resb/en/visit/visit.htm. Accessed Aug 2002
The CVL. http://www.lrv.fri.uni-lj.si/facedb.html. Accessed 1999
The GTAV. https://gtav.upc.edu/en/research-areas/face-database. Accessed 2011
The Color Feret. https://www.nist.gov/itl/iad/image-group/color-feret-database. Accessed Jan 2011
Liao, S., Jain, A.K., Li, S.Z.: A fast and accurate unconstrained face detector. IEEE Trans. Pattern Anal. Mach. Intell. 38(2), 211–223 (2016)
Orozco, J., Martinez, B., Pantic, M.: Empirical analysis of cascade deformable models for multi-view face detection. Image Vis. Comput. 42, 47–61 (2015)
Chen, J., Deng, Y., Bai, G., Su, G.: Face image quality assessment based on learning to rank. IEEE Signal Process. Lett. 22(1), 90–94 (2014)
Najibi, M., Samangouei, P., Chellappa, R., Davis, L.: SSH: Single stage headless dace detector. In: International Conference Computer Vision, pp. 4875–4884 (2017)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Chen, CY., Ding, JJ. & Hsu, HW. Prominent facial feature and hybrid learning method-based advanced face detector robust to head-up, head-down, and arbitrary rotation cases. SIViP 15, 147–154 (2021). https://doi.org/10.1007/s11760-020-01729-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-020-01729-w