Abstract
In this paper, we propose a novel method to detect nose tip and localize face from face range image. The nose tip detection procedure of the method is based on the idea of Multi-angle Energy (ME) and works in scale-space. The face localization procedure of the method is based on the position of the nose tip and a modified version of Multi-angle Energy. The scale-space is established by robust smoothing the input face range image. In the nose tip detection procedure, for each scale of the scale-space, we compute the Multi-angle Energy for each point of the face range image. For the points whose values of ME are not equal to zero, hierarchical clustering method is used to cluster them into several clusters. In the obtained first h largest clusters, we can find a nose tip candidate by using a cascading scheme. For all scales of the scale-space, we get a series of nose tip candidates. We apply hierarchical clustering again for them. Nose tip can be found in the largest cluster. In the face localization procedure, we present a modified version of ME. With the modified ME, we use a similar cascading scheme to detect one endocanthion for the input face range image. Based on the distance between nose tip and endocanthion, face localization is achieved by using a sphere which is centered on the nose tip to crop the face region. We evaluate our method on two well-known 3D face databases, namely FRGC v2.0 and BOSPHORUS, and compare our method with other state-of-the-art methods. The experimental results show that the nose tip detection rates of our method are higher than those of the state-of-the-art methods. The face localization results are fine and can adapt to the face scale variance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chang, K.I., Bowyer, W., Flynn, P.J.: Multiple nose region matching for 3D face recognition under varying facial expression. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1695–1700 (2006)
Colbry, D., Stockman, G., Jain, A.: Detection of anchor points for 3D face verification. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, CVPR Workshops, p. 118. IEEE (2005)
Colombo, A., Cusano, C., Schettini, R.: 3D face detection using curvature analysis. Pattern Recogn. 39(3), 444–455 (2006)
Faltemier, T.C., Bowyer, K.W., Flynn, P.J.: A region ensemble for 3-D face recognition. IEEE Trans. Inf. Forensics Secur. 3(1), 62–73 (2008)
Garcia, D.: Robust smoothing of gridded data in one and higher dimensions with missing values. Comput. Stat. Data Anal. 54(4), 1167–1178 (2010)
Guo, J., Mei, X., Tang, K.: Automatic landmark annotation and dense correspondence registration for 3D human facial images. BMC Bioinform. 14(1), 232 (2013)
Jordan, K., Mordohai, P.: A quantitative evaluation of surface normal estimation in point clouds. In: 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), pp. 4220–4226. IEEE (2014)
Ju, Q.: Robust binary neural networks based 3D face detection and accurate face registration. Int. J. Comput. Intell. Syst. 6(4), 669–683 (2013)
Li, D., Pedrycz, W.: A central profile-based 3D face pose estimation. Pattern Recogn. 47(2), 525–534 (2014)
Li, Y., Wang, Y., Wang, B., Sui, L.: Nose tip detection on three-dimensional faces using pose-invariant differential surface features. IET Comput. Vis. 9(1), 75–84 (2014)
Liu, J., Zhang, Q., Zhang, C., Tang, C.: Robust nose tip detection for face range images based on local features in scale-space. In: 2015 International Conference on 3D Imaging (IC3D), pp. 1–8. IEEE (2015)
Liu, P., Wang, Y., Zhang, Z.: Representing 3D face from point cloud to face-aligned spherical depth map. Int. J. Pattern Recogn. Artif. Intell. 26(01), 1255003 (2012)
Mian, A., Bennamoun, M., Owens, R.: Automatic 3D face detection, normalization and recognition. In: Third International Symposium on v3D Data Processing, Visualization, and Transmission, pp. 735–742. IEEE (2006)
Mian, A.S., Bennamoun, M., Owens, R.: An efficient multimodal 2D–3D hybrid approach to automatic face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 29(11), 1927–1943 (2007)
Nair, P., Cavallaro, A.: 3-D face detection, landmark localization, and registration using a point distribution model. IEEE Trans. Multimedia 11(4), 611–623 (2009)
Pears, N., Heseltine, T., Romero, M.: From 3D point clouds to pose-normalised depth maps. Int. J. Comput. Vis. 89(2–3), 152–176 (2010)
Peng, X., Bennamoun, M., Mian, A.S.: A training-free nose tip detection method from face range images. Pattern Recogn. 44(3), 544–558 (2011)
Perakis, P., Passalis, G., Theoharis, T., Kakadiaris, I.A.: 3D facial landmark detection under large yaw and expression variations. IEEE Trans. Pattern Anal. Mach. Intell. 35(7), 1552–1564 (2013)
Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005. CVPR 2005, vol. 1, pp. 947–954. IEEE (2005)
Rokach, L., Maimon, O.: Clustering methods. In: Maimon, O., Rokach, L. (eds.) Data Mining and Knowledge Discovery Handbook, pp. 321–352. Springer, Berlin (2005)
Savran, A., Alyüz, N., Dibeklioğlu, H., Çeliktutan, O., Gökberk, B., Sankur, B., Akarun, L.: Bosphorus database for 3D face analysis. In: Schouten, B., Juul, N.C., Drygajlo, A., Tistarelli, M. (eds.) BIOID 2008. LNCS, vol. 5372, pp. 47–56. Springer, Heidelberg (2008)
Segundo, M.P., Silva, L., Bellon, O.R.P., Queirolo, C.: Automatic face segmentation and facial landmark detection in range images. IEEE Trans. Syst. Man Cybern. B Cybern. 40(5), 1319–1330 (2010)
Werghi, N., Rahayem, M., Kjellander, J.: An ordered topological representation of 3D triangular mesh facial surface: concept and applications. EURASIP J. Adv. Sig. Process. 2012(1), 1–20 (2012)
Xu, C., Tan, T., Wang, Y., Quan, L.: Combining local features for robust nose location in 3D facial data. Pattern Recogn. Lett. 27(13), 1487–1494 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Liu, J., Zhang, Q., Tang, C. (2016). Nose Tip Detection and Face Localization from Face Range Image Based on Multi-angle Energy. In: El Rhalibi, A., Tian, F., Pan, Z., Liu, B. (eds) E-Learning and Games. Edutainment 2016. Lecture Notes in Computer Science(), vol 9654. Springer, Cham. https://doi.org/10.1007/978-3-319-40259-8_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-40259-8_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-40258-1
Online ISBN: 978-3-319-40259-8
eBook Packages: Computer ScienceComputer Science (R0)