Abstract
Kinship recognition from facial images is an important task of social network analysis. However, previous studies mainly focus on kinship verification between two people. Very few attempts have been conducted on analyzing kinship relations of whole family. In this paper, we present a graph based method to recognize kinship relations of the whole family members from a single family photo. After pre-processing and feature extraction, we recognize kinship relations of all pairs of people in the family and then select a group of pair-wise kinship relations to construct connected subgraph of all family members. After that, we use kinship rules to infer and check all potential relationships on the graph and choose the best relationship graph as output. The key idea is to use connected subgraph model and kinship relation rules to select the best subset of the pairwise kinship, which can help us recover from the incorrect pairwise kinship classification results. Extensive experimental results demonstrate the effectiveness of the proposed method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: a unified embedding for face recognition and clustering, pp. 815–823 (2015)
Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)
Yang, X., Gao, B.B., Xing, C., Huo, Z.W.: Deep label distribution learning for apparent age estimation. In: IEEE International Conference on Computer Vision Workshop, pp. 344–350 (2015)
Robinson, J.P., Shao, M., Wu, Y., Fu, Y.: Families in the wild (FIW): large-scale kinship image database and benchmarks. In: ACM on Multimedia Conference, pp. 242–246 (2016)
Fang, R., Tang, K.D., Snavely, N., Chen, T.: Towards computational models of kinship verification. In: IEEE International Conference on Image Processing, pp. 1577–1580 (2010)
Xia, S., Shao, M., Fu, Y.: Kinship verification through transfer learning. In: International Joint Conference on Artificial Intelligence, pp. 2539–2544 (2011)
Hu, J., Lu, J., Tan, Y.P.: Discriminative deep metric learning for face verification in the wild. In: Computer Vision and Pattern Recognition, pp. 1875–1882 (2014)
Lu, J., Zhou, X., Tan, Y.P., Shang, Y., Zhou, J.: Neighborhood repulsed metric learning for kinship verification. IEEE Trans. Pattern Anal. Mach. Intell. 36(2), 331–45 (2014)
Zhang, K., Huang, Y., Song, C., Wu, H., Wang, L.: Kinship verification with deep convolutional neural networks. In: British Machine Vision Conference, pp. 148.1–148.12 (2015)
Zhao, H., Ding, Z., Fu, Y.: Block-wise constrained sparse graph for face image representation. In: IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, pp. 1–6 (2015)
Guo, Y., Dibeklioglu, H., Van Der Maaten, L.: Graph-based kinship recognition. In: International Conference on Pattern Recognition, pp. 4287–4292 (2014)
Zhang, J., Xia, S., Shao, M., Fu, Y.: Family photo recognition via multiple instance learning. In: ACM on International Conference on Multimedia Retrieval, pp. 424–428 (2017)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 886–893 (2005)
Parkhi, O.M., Vedaldi, A., Zisserman, A.: Deep face recognition. In: British Machine Vision Conference, pp. 41.1–41.12 (2015)
Fang, R., Gallagher, A.C., Chen, T., Loui, A.: Kinship classification by modeling facial feature heredity. In: IEEE International Conference on Image Processing, pp. 2983–2987 (2014)
Qin, X., Tan, X., Chen, S.: Tri-subjects kinship verification: understanding the core of a family. In: IAPR International Conference on Machine Vision Applications, pp. 580–583 (2015)
Gallagher, A.C., Chen, T.: Understanding images of groups of people. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 256–263 (2009)
Xia, S., Shao, M., Luo, J., Yun, F.: Understanding kin relationships in a photo. IEEE Trans. Multimedia 14(4), 1046–1056 (2012)
Acknowledgment
This work is supported by the National Natural Science Foundation of China under Grant 61671151 and 61728103.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Xia, C., Xia, S., Zhou, Y., Zhang, L., Shao, M. (2018). Graph Based Family Relationship Recognition from a Single Image. In: Geng, X., Kang, BH. (eds) PRICAI 2018: Trends in Artificial Intelligence. PRICAI 2018. Lecture Notes in Computer Science(), vol 11012. Springer, Cham. https://doi.org/10.1007/978-3-319-97304-3_24
Download citation
DOI: https://doi.org/10.1007/978-3-319-97304-3_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-97303-6
Online ISBN: 978-3-319-97304-3
eBook Packages: Computer ScienceComputer Science (R0)