Skip to main content
SpringerLink
Log in

Branch-structured detector for fast face detection using asymmetric LBP features

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Face detection has been widely used to solve many important problems. In this paper, we present a fast face detector that is more suitable to be used by a low-cost embedded system. It can obtain high performance but use less CPU and memory resources. We first present a kind of pixel-level image feature named asymmetric LBP feature (ALBP). Furthermore, we find four kinds of four-bit ALBP features that are suitable to be used to construct cascade classifiers, since the four-bit ALBP features are discriminative features and large feature pools can be generated even if a small image patch is given. Second, we propose a branch-structured face detector that is composed of three ALBP-based cascade classifiers, i.e., one deep ALBP cascade and two shallow ALBP cascades. The detection speed and performance on FDDB dataset of the branch-structured face detector have both been evaluated. Experimental results show that it runs much faster than existing face detectors run on similar platforms, and its performance is close to that of well-known non-CNN face detectors which can achieve high performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Zafeiriou, S., Zhang, C., Zhang, Z.: A survey on face detection in the wild: past, present and future. Comput. Vis. Image Underst. 138(C), 1–24 (2015)

    Article  Google Scholar 

  2. Markuš, N., Frljaky, M., Panděić, I.S., Ahlbergz, J., Forchheimer, R.: Object detection with pixel intensity comparisons organized in decision trees (2014). arXiv:1305.4537

  3. Li, H., Lin, Z., Shen, X., Brandtz, J., Hua, G.: A convolutional neural network cascade for face detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 5325–5334 (2015)

  4. Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23(10), 1499–1503 (2016)

    Article  Google Scholar 

  5. Zhang, L., Chu, R., Xiang, S., Liao, S., Li, S.Z.: Face detection based on multi-block LBP representation. In: International Conference on Advances in Biometrics, pp. 11–18 (2007)

  6. Liao, S., Jain, A.K., Li, S.Z.: A fast and accurate unconstrained face detector. IEEE Trans. Pattern Anal. Mach. Intell. 38(2), 211–223 (2016)

    Article  Google Scholar 

  7. Viola, P., Jones M.: Rapid object detection using a boosted cascade of simple features. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 511–518 (2001)

  8. Lienhart, R., Maydt, J.: An extended set of Haar-like features for rapid object detection. In: IEEE International Conference on Image Processing, vol. 1, pp. 900–903 (2002)

  9. Li, S.Z., Zhu, L., Zhang, Z.Q., Blake, A., Zhang, H., Shum, H.: Statistical learning of multi-view face detection. In: European Conference on Computer Vision, vol. 4, pp. 67–81 (2002)

  10. Roy, A., Marcel, S.: Haar local binary pattern feature for fast illumination invariant face detection. In: British Machine Vision Conference, pp. 19.1–19.12 (2009)

  11. Pham, M., Gao, Y., Hoang, V. D., Cham, T.: Fast polygonal integration and its application in extending Haar-like features to improve object detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 942–949 (2010)

  12. Rezaei, M., Nafchi, H. Z., Morales, S.: Global Haar-like features: a new extension of classic Haar features for efficient face detection in noisy images. In: Pacific-Rim Symposium on Image and Video Technology, pp. 302–313 (2013)

  13. Yang, B., Yan, J., Lei, Z., Li, S.Z.: Aggregate channel features for multi-view face detection. In: IEEE International Joint Conference on Biometrics, pp. 1–8 (2014)

  14. Shen, J., Sun, C., Yang, W., Wang, Z., Sun, Z.: A novel distribution-based feature for rapid object detection. Neurocomputing 74(17), 2767–2779 (2011)

    Article  Google Scholar 

  15. Li, J., Wang, T., Zhang, Y.: Face detection using SURF cascade. In: IEEE International Conference on Computer Vision Workshops, pp. 2183–2190 (2011)

  16. Scherbaum, K., Petterson, J., Feris, R.S., Blanz, V., Seidel, H.: Fast face detector training using tailored views. In: IEEE International Conference on Computer Vision, pp. 2848–2855 (2013)

  17. Du, S., Zheng, N., You, Q., Wu, Y., Yuan, M., Wu, J.: Rotated Haar-like features for face detection with in-plane rotation. In: International Conference on Virtual Systems and Multimedia, pp. 128–137 (2006)

  18. Wang, P., Ji, Q.: Multi-view face and eye detection using discriminant features. Comput. Vis. Image Underst. 105(2), 99–111 (2007)

    Article  Google Scholar 

  19. Wu, S., Kan, M., He, Z., Shan, S., Chen, X.: Funnel-structured cascade for multi-view face detection with alignment-awareness. Neurocomputing 221(C), 138–145 (2017)

    Article  Google Scholar 

  20. Mahmoud, A., Marwa, N., Mostafa, K., Katherine, R., Aly, A.M.: Can we boost the power of the Viola–Jones face detector using preprocessing? An empirical study. J. Electron. Imaging 27(4), 043020 (2018)

    Google Scholar 

  21. Zhu, X., Ramanan, D.: Face detection, pose estimation, and landmark localization in the wild. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2879–2886 (2012)

  22. Ghiasi, G., Fowlkes, C.C.: Occlusion coherence: detecting and localizing occluded faces. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1899–1906 (2014)

  23. Shen, X., Lin, Z., Brandt, J., Wu, Y.: Detecting and aligning faces by image retrieval. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3460–3467 (2013)

  24. Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)

  25. Zhu, C., Zheng, Y., Luu, K., Savvides, M.: CMS-RCNN: contextual multi-scale region-based CNN for unconstrained face detection (2016). arXiv:1606.05413

  26. Chen, D., Hua, G., Wen, F., Sun, J.: Supervised transformer network for efficient face detection. In: European Conference on Computer Vision, pp. 122–138 (2016)

  27. Yang, S., Luo, P., Loy, C.C., Tang, X.: WIDER FACE: a face detection benchmark. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 5525–5533 (2016)

  28. Wang, H., Zhang, D., Miao, Z.: Face recognition with single sample per person using HOG–LDB and SVDL. SIViP 13, 985–992 (2019)

    Article  Google Scholar 

  29. Toygar, Ö., Alqaralleh, E., Afaneh, A.: Symmetric ear and profile face fusion for identical twins and non-twins recognition. SIViP 12, 1157–1164 (2018)

    Article  Google Scholar 

  30. Gao, W., Cao, B., Shan, S., Chen, X., Zhou, D., Zhang, X., Zhao, D.: The CAS-PEAL large-scale chinese face database and baseline evaluations. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 38(1), 149–161 (2008)

    Article  Google Scholar 

  31. Jain, V., Learned-Miller, E.: FDDB: a benchmark for face detection in unconstrained settings. Technical Report UM-CS-2010-009, Department of Computer Science, University of Massachusetts, Amherst (2010)

  32. Li, H., Lin, Z., Brandt, J., Shen, X., Hua, G.: Efficient boosted exemplar-based face detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1843–1850 (2014)

  33. Chen, D., Ren, S., Wei, Y., Cao, X., Sun, J.: Joint cascade face detection and alignment. In: European Conference on Computer Vision, pp. 109–122 (2014)

  34. Kefi-Fatteh, T., Ksantini, R., Kaâniche, M., Bouhoula, A.: Human face detection improvement using incremental learning based on low variance directions. SIViP 13(8), 1503–1510 (2019)

    Article  Google Scholar 

  35. Mahmoud, A., Abdelrahman, A.: AFIF4: deep gender classification based on an AdaBoost-based fusion of isolated facial features and foggy faces. J. Vis. Commun. Image Represent. 62, 77–86 (2019)

    Article  Google Scholar 

  36. Specs on Faces (SoF) Dataset: https://sites.google.com/view/sof-dataset. Accessed 14 Mar. 2020

Download references

Acknowledgements

The research in this paper uses the CAS-PEAL-R1 face database collected under the sponsor of the Chinese National Hi-Tech Program and ISVISION Tech. Co. Ltd.

Author information

Authors and Affiliations

  1. College of Automation Engineering, Northeast Electric Power University, Jilin, 132012, China

    Jie-chun Chen, Jun Wang & Jin He

  2. College of Science, Northeast Electric Power University, Jilin, 132012, China

    Li-ping Zhao

Authors
  1. Jie-chun Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Li-ping Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jin He
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jie-chun Chen.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, Jc., Wang, J., Zhao, Lp. et al. Branch-structured detector for fast face detection using asymmetric LBP features. SIViP 14, 1699–1706 (2020). https://doi.org/10.1007/s11760-020-01710-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-020-01710-7

Keywords

Search

Navigation