Skip to main content

Nose Tip Detection and Face Localization from Face Range Image Based on Multi-angle Energy

  • Conference paper
  • First Online:
E-Learning and Games (Edutainment 2016)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9654))

  • 1599 Accesses

Abstract

In this paper, we propose a novel method to detect nose tip and localize face from face range image. The nose tip detection procedure of the method is based on the idea of Multi-angle Energy (ME) and works in scale-space. The face localization procedure of the method is based on the position of the nose tip and a modified version of Multi-angle Energy. The scale-space is established by robust smoothing the input face range image. In the nose tip detection procedure, for each scale of the scale-space, we compute the Multi-angle Energy for each point of the face range image. For the points whose values of ME are not equal to zero, hierarchical clustering method is used to cluster them into several clusters. In the obtained first h largest clusters, we can find a nose tip candidate by using a cascading scheme. For all scales of the scale-space, we get a series of nose tip candidates. We apply hierarchical clustering again for them. Nose tip can be found in the largest cluster. In the face localization procedure, we present a modified version of ME. With the modified ME, we use a similar cascading scheme to detect one endocanthion for the input face range image. Based on the distance between nose tip and endocanthion, face localization is achieved by using a sphere which is centered on the nose tip to crop the face region. We evaluate our method on two well-known 3D face databases, namely FRGC v2.0 and BOSPHORUS, and compare our method with other state-of-the-art methods. The experimental results show that the nose tip detection rates of our method are higher than those of the state-of-the-art methods. The face localization results are fine and can adapt to the face scale variance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Chang, K.I., Bowyer, W., Flynn, P.J.: Multiple nose region matching for 3D face recognition under varying facial expression. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1695–1700 (2006)

    Article  Google Scholar 

  2. Colbry, D., Stockman, G., Jain, A.: Detection of anchor points for 3D face verification. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, CVPR Workshops, p. 118. IEEE (2005)

    Google Scholar 

  3. Colombo, A., Cusano, C., Schettini, R.: 3D face detection using curvature analysis. Pattern Recogn. 39(3), 444–455 (2006)

    Article  MATH  Google Scholar 

  4. Faltemier, T.C., Bowyer, K.W., Flynn, P.J.: A region ensemble for 3-D face recognition. IEEE Trans. Inf. Forensics Secur. 3(1), 62–73 (2008)

    Article  Google Scholar 

  5. Garcia, D.: Robust smoothing of gridded data in one and higher dimensions with missing values. Comput. Stat. Data Anal. 54(4), 1167–1178 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  6. Guo, J., Mei, X., Tang, K.: Automatic landmark annotation and dense correspondence registration for 3D human facial images. BMC Bioinform. 14(1), 232 (2013)

    Article  Google Scholar 

  7. Jordan, K., Mordohai, P.: A quantitative evaluation of surface normal estimation in point clouds. In: 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), pp. 4220–4226. IEEE (2014)

    Google Scholar 

  8. Ju, Q.: Robust binary neural networks based 3D face detection and accurate face registration. Int. J. Comput. Intell. Syst. 6(4), 669–683 (2013)

    Article  Google Scholar 

  9. Li, D., Pedrycz, W.: A central profile-based 3D face pose estimation. Pattern Recogn. 47(2), 525–534 (2014)

    Article  Google Scholar 

  10. Li, Y., Wang, Y., Wang, B., Sui, L.: Nose tip detection on three-dimensional faces using pose-invariant differential surface features. IET Comput. Vis. 9(1), 75–84 (2014)

    Article  Google Scholar 

  11. Liu, J., Zhang, Q., Zhang, C., Tang, C.: Robust nose tip detection for face range images based on local features in scale-space. In: 2015 International Conference on 3D Imaging (IC3D), pp. 1–8. IEEE (2015)

    Google Scholar 

  12. Liu, P., Wang, Y., Zhang, Z.: Representing 3D face from point cloud to face-aligned spherical depth map. Int. J. Pattern Recogn. Artif. Intell. 26(01), 1255003 (2012)

    Article  MathSciNet  Google Scholar 

  13. Mian, A., Bennamoun, M., Owens, R.: Automatic 3D face detection, normalization and recognition. In: Third International Symposium on v3D Data Processing, Visualization, and Transmission, pp. 735–742. IEEE (2006)

    Google Scholar 

  14. Mian, A.S., Bennamoun, M., Owens, R.: An efficient multimodal 2D–3D hybrid approach to automatic face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 29(11), 1927–1943 (2007)

    Article  Google Scholar 

  15. Nair, P., Cavallaro, A.: 3-D face detection, landmark localization, and registration using a point distribution model. IEEE Trans. Multimedia 11(4), 611–623 (2009)

    Article  Google Scholar 

  16. Pears, N., Heseltine, T., Romero, M.: From 3D point clouds to pose-normalised depth maps. Int. J. Comput. Vis. 89(2–3), 152–176 (2010)

    Article  Google Scholar 

  17. Peng, X., Bennamoun, M., Mian, A.S.: A training-free nose tip detection method from face range images. Pattern Recogn. 44(3), 544–558 (2011)

    Article  MATH  Google Scholar 

  18. Perakis, P., Passalis, G., Theoharis, T., Kakadiaris, I.A.: 3D facial landmark detection under large yaw and expression variations. IEEE Trans. Pattern Anal. Mach. Intell. 35(7), 1552–1564 (2013)

    Article  Google Scholar 

  19. Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005. CVPR 2005, vol. 1, pp. 947–954. IEEE (2005)

    Google Scholar 

  20. Rokach, L., Maimon, O.: Clustering methods. In: Maimon, O., Rokach, L. (eds.) Data Mining and Knowledge Discovery Handbook, pp. 321–352. Springer, Berlin (2005)

    Chapter  Google Scholar 

  21. Savran, A., Alyüz, N., Dibeklioğlu, H., Çeliktutan, O., Gökberk, B., Sankur, B., Akarun, L.: Bosphorus database for 3D face analysis. In: Schouten, B., Juul, N.C., Drygajlo, A., Tistarelli, M. (eds.) BIOID 2008. LNCS, vol. 5372, pp. 47–56. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  22. Segundo, M.P., Silva, L., Bellon, O.R.P., Queirolo, C.: Automatic face segmentation and facial landmark detection in range images. IEEE Trans. Syst. Man Cybern. B Cybern. 40(5), 1319–1330 (2010)

    Article  Google Scholar 

  23. Werghi, N., Rahayem, M., Kjellander, J.: An ordered topological representation of 3D triangular mesh facial surface: concept and applications. EURASIP J. Adv. Sig. Process. 2012(1), 1–20 (2012)

    Article  Google Scholar 

  24. Xu, C., Tan, T., Wang, Y., Quan, L.: Combining local features for robust nose location in 3D facial data. Pattern Recogn. Lett. 27(13), 1487–1494 (2006)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jian Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Liu, J., Zhang, Q., Tang, C. (2016). Nose Tip Detection and Face Localization from Face Range Image Based on Multi-angle Energy. In: El Rhalibi, A., Tian, F., Pan, Z., Liu, B. (eds) E-Learning and Games. Edutainment 2016. Lecture Notes in Computer Science(), vol 9654. Springer, Cham. https://doi.org/10.1007/978-3-319-40259-8_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-40259-8_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-40258-1

  • Online ISBN: 978-3-319-40259-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics