Abstract
Attributes recognition of face in the wild is getting increasingly attention with the rapid development of computer vision. Most prior work tend to apply separate model for the single attribute or attributes in the same region, which easily lost the information of correlation between attributes. Correlation (e.g., one-way inferential correlation) between face attributes, which is neglected by many researches, contributes to the better performance of face attributes recognition. In this paper, we propose a face attributes recognition model based on one-way inferential correlation (OIR) between face attributes (e.g., the inferential correlation from goatee to gender). Toward that end, we propose a method to find such correlation based on data imbalance of each attribute, and design an OIR-related attributes classifier using such correlation. Furthermore, we cut face region into multiple region parts according to the category of attributes, and use a novel approach of face feature extraction for all regional parts via transfer learning focusing on multiple neural layers. Experimental evaluations on the benchmark with multiple face attributes show the effectiveness on recognition accuracy and computational cost of our proposed model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Song, F., Tan, X., Chen, S.: Exploiting relationship between attributes for improved face verification. Comput. Vis. Image Underst. 122(4), 143–154 (2014)
Kim, J., Pavlovic, V.: Attribute rating for classification of visual objects. In: Proceedings of the ICPR, pp. 1611–1614. IEEE, Tsukuba (2012)
Xia, S., Shao, M., Fu, Y.: Toward kinship verification using visual attributes. In: Proceedings ICPR, pp. 549–552. IEEE, Tsukuba (2012)
Qi, G., Aggarwal, C., Tian, Q., et al.: Exploring context and content links in social media: a latent space method. IEEE Trans. Pattern Anal. Mach. Intell. 34(5), 850–862 (2012)
Sun, Y., Wang, X., Tang, X.: Deep convolutional network cascade for facial point detection. In: Proceedings of the IEEE Conference on CVPR, pp. 3476–3483. IEEE, Portland (2013) https://doi.org/10.1109/CVPR.2013.446
Li, J., Zhang, Y.: Learning SURF cascade for fast and accurate object detection. In: Proceedings of the IEEE Conference on CVPR, pp. 3468–3475. IEEE, Portland (2013)
SeetaFace Engine. https://github.com/seetaface/SeetaFaceEngine
Liu, Z., Luo, P., Wang, X., et al.: Deep learning face attributes in the wild. In: Proceedings of the IEEE ICCV, pp. 3730–3738. IEEE, Santiago (2015) https://doi.org/10.1109/ICCV.2015.425
Srinivas, N., Atwal, H., Rose, D.C., et al.: Age, Ggender, and fine-grained ethnicity prediction Uusing convolutional neural networks for the east Asian face dataset. In: Proceeding of the IEEE Conference on FG, pp. 953–960. IEEE, Washington (2017)
Kumar, N., Berg, A.C., Belhumeur, P.N., et al.: Attribute and simile classifiers for face verification. In: Proceedings of the IEEE ICCV, pp. 365–372. IEEE, Kyoto (2009) https://doi.org/10.1109/ICCV.2009.5459250
Cottrell, G.W., Metcalfe, J.: EMPATH: face, emotion, and gender recognition using holons. In: Proceedings of the NIPS, pp. 564–571. DBLP, Denver (1990)
Zhong, Y., Sullivan, J., Li, H.: Face attribute prediction using off-the-shelf CNN features. In: Proceedings of the ICB, pp. 1–7. IEEE, Halmstad (2016)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. ArXiv e-prints, September 2014
Zeng, T., Ji, S.: Deep convolutional neural networks for multi-instance multi-task learning. In: Proceedings IEEE ICDM, pp. 579–588. IEEE, Atlantic City (2016)
Hand, E.M., Chellappa, R.: Attributes for improved attributes: a multi-task network for attribute classification. ArXiv e-prints, April 2016
Ehrlich, M., Shields, T.J., Almaev, T., et al.: Facial attributes classification using multi-task representation learning. In: Proceedings of the IEEE CVPRW, pp. 752–760. IEEE, Las Vegas (2016)
Dong, M., Pang, K., Wu, Y., et al.: Transferring CNNS to multi-instance multi-label classification on small datasets. In: Proceedings of the IEEE ICIP, pp. 1332–1336. IEEE, Beijing (2017)
Szegedy, C., Vanhoucke, V., Ioffe, S., et al.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE CVPR, pp. 2818–2826. IEEE, Las Vegas (2016) https://doi.org/10.1109/CVPR.2016.308
Kumar, N., Belhumeur, P., Nayar, S.: FaceTracer: a search engine for large collections of images with faces. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5305, pp. 340–353. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88693-8_25
Zhang, N., Paluri, M., Ranzato, M., et al.: PANDA: Pose aligned networks for deep attribute modeling. In: Proceedings of the IEEE CVPR, pp. 1637–1644. IEEE, Columbus (2014). https://doi.org/10.1109/CVPR.2014.212
Acknowledgment
This work was supported in part by the National Natura Science Foundation of China under Grant 61572252, Grant 61772268 and Grant 61720106006, and in part by the Natural Science Foundation of Jiangsu Province under Grant BK20190065.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Ge, H., Dong, J., Zhang, L. (2020). Face Attributes Recognition Based on One-Way Inferential Correlation Between Attributes. In: Ro, Y., et al. MultiMedia Modeling. MMM 2020. Lecture Notes in Computer Science(), vol 11961. Springer, Cham. https://doi.org/10.1007/978-3-030-37731-1_21
Download citation
DOI: https://doi.org/10.1007/978-3-030-37731-1_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-37730-4
Online ISBN: 978-3-030-37731-1
eBook Packages: Computer ScienceComputer Science (R0)