Abstract
We propose a novel approach that addresses face aging as an unsupervised image-to-image translation problem. The proposed approach achieves age progression (i.e., future looks) and regression (i.e., previous looks) of face images that belong to a specific age class by translating them to other (subsequent or precedent) age classes. It learns pairwise translations between all age classes. Two variants are presented. The first one learns a global transformation, while the second one incorporates a pyramid encoding and decoding scheme to more effectively diffuse age class information. The proposed variants are thoroughly evaluated with respect to both qualitative and quantitative criteria. They yield appealing face age progression and regression results when compared to ground truth images and outperform state-of-the-art approaches for face aging based on quantitative evaluation metrics. Notably, the incorporation of pyramid encoding and decoding is proven to be beneficial to the quality of the generated images.
Similar content being viewed by others
References
Antipov, G., Baccouche, M., Berrani, S.A., Dugelay, J.L.: Apparent age estimation from face images combining general and children-specialized deep learning models. In: Proc. IEEE Int. Conf. Computer Vision Pattern Recognition Workshops, pp. 801–809 (2016)
Antipov, G., Baccouche, M., Dugelay, J.L.: Face aging with conditional generative adversarial networks. In: Proc. IEEE Int. Conf. Image Processing, pp. 2089–2093 (2017)
Anwaar, M., Loo, C.K., Seera, M.: Face image synthesis with weight and age progression using conditional adversarial autoencoder. Neural Computing and Applications pp. 1–13 (2019)
Chen, B.C., Chen, C.S., Hsu, W.H.: Cross-age reference coding for age-invariant face recognition and retrieval. In: Proc. European Conf. Computer Vision, pp. 768–783. Springer (2014)
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 770–778. IEEE (2016)
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., Hochreiter, S.: GANs trained by a two time-scale update rule converge to a local nash equilibrium. In: Advances in Neural Information Processing Systems, pp. 6626–6637 (2017)
Kingma, D.P., Welling, M.: Auto-encoding variational Bayes (2013). arXiv preprint arXiv:1312.6114
Koppen, P., Feng, Z., Kittler, J., Awais, M., Christmas, W., Wu, X., Yin, H.: Gaussian mixture 3D morphable face model. Pattern Recognition 74, 617–628 (2018)
Lanitis, A., Taylor, C.J., Cootes, T.F.: Toward automatic simulation of aging effects on face images. IEEE Trans. Pattern Anal. Mach. Intell. 24(4), 442–455 (2002)
Li, P., Hu, Y., Li, Q., He, R., Sun, Z.: Global and local consistent age generative adversarial networks. In: Proc. 24th Int. Conf. Pattern Recognition, pp. 1073–1078 (2018)
Li, Y., Li, Y.: Face aging effect simulation model based on multilayer representation and shearlet transform. Journal of Electronic Imaging 26(5), (2017)
Liu, M.Y., Breuel, T., Kautz, J.: Unsupervised image-to-image translation networks. In: Advances in Neural Information Processing Systems, pp. 700–708 (2017)
Liu, S., Sun, Y., Zhu, D., Bao, R., Wang, W., Shu, X., Yan, S.: Face aging with contextual generative adversarial nets. In: Proc. 25th ACM Int. Conf. Multimedia, pp. 82–90 (2017)
Liu, Y., Li, Q., Sun, Z.: Attribute enhanced face aging with wavelet-based generative adversarial networks (2018). arXiv preprint arXiv:1809.06647
Liu, Z., Luo, P., Wang, X., Tang, X.: Deep learning face attributes in the wild. In: Proc. IEEE Int. Conf. Computer Vision, pp. 3730–3738 (2015)
Martin, V., Séguier, R., Porcheron, A., Morizot, F.: Face aging simulation with a new wrinkle oriented active appearance model. Multimedia Tools and Applications 78(5), 6309–6327 (2019)
Moustafa, A.A., Elnakib, A., Areed, N.F.F.: Age-invariant face recognition based on deep features analysis. Signal Image Video Process. 1–8 (2020)
Niu, Z., Zhou, M., Wang, L., Gao, X., Hua, G.: Ordinal regression with multiple output cnn for age estimation. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, pp. 4920–4928 (2016)
Palsson, S., Agustsson, E., Timofte, R., Van Gool, L.: Generative adversarial style transfer networks for face aging. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition Workshops, pp. 2165–21658 (2018)
Pantraki, E., Kotropoulos, C., Lanitis, A.: Leveraging image-to-image translation generative adversarial networks for face aging. In: Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing, pp. 8370–8374 (2019)
Parkhi, O.M., Vedaldi, A., Zisserman, A.: Deep face recognition. In: Proc. British Machine Vision, vol. 1, p. 6 (2015)
Rezende, D.J., Mohamed, S., Wierstra, D.: Stochastic backpropagation and approximate inference in deep generative models. In: Proc. 31st Int. Conf. Machine Learning, vol. 32, pp. 1278–1286 (2014)
Riaz, S., Park, U., Choi, J., Natarajan, P.: Age progression by gender-specific 3d aging model. Machine Vision and Applications 30(1), 91–109 (2019)
Rothe, R., Timofte, R., Gool, L.V.: DEX: Deep expectation of apparent age from a single image. In: Proc. IEEE Int. Conf. Computer Vision Workshops, pp. 10–15 (2015)
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., Chen, X.: Improved techniques for training GANs. In: Advances in Neural Information Processing Systems, pp. 2234–2242 (2016)
Sawant, M.M., B., K.M.: Age invariant face recognition: a survey on facial aging databases, techniques and effect of aging. Artificial Intelligence Review 52(2), 981–1008 (2019)
Sethuram, A., Patterson, E., Ricanek, K., Rawls, A.: Improvements and performance evaluation concerning synthetic age progression and face recognition affected by adult aging. In: Int. Conf. Biometrics, pp. 62–71. Springer (2009)
Shu, X., Tang, J., Lai, H., Niu, Z., Yan, S.: Kinship-guided age progression. Pattern Recognition 59, 156–167 (2016)
Wang, W., Cui, Z., Yan, Y., Feng, J., Yan, S., Shu, X., Sebe, N.: Recurrent face aging. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, pp. 2378–2386 (2016)
Wang, Z., Tang, X., Luo, W., Gao, S.: Face aging with identity-preserved conditional generative adversarial networks. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, pp. 7939–7947 (2018)
Xu, C., Makihara, Y., Yagi, Y., Lu, J.: Gait-based age progression/regression: a baseline and performance evaluation by age group classification and cross-age gait identification. Machine Vision and Applications 30(4), 629–644 (2019)
Yang, H., Huang, D., Wang, Y., Jain, A.K.: Learning face age progression: A pyramid architecture of GANs. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, pp. 31–39 (2018)
Zhang, Z., Song, Y., Qi, H.: Age progression/regression by conditional adversarial autoencoder. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, pp. 4352–4360 (2017)
Zhao, J., Cheng, Y., Cheng, Y., Yang, Y., Lan, H., Zhao, F., Xiong, L., Xu, Y., Li, J., Pranata, S., Shen, S., Xing, J., Liu, H., Yan, S., J., F.: Look across elapse: Disentangled representation learning and photorealistic cross-age face synthesis for age-invariant face recognition. In: Proc. 33rd Conf. Artificial Intelligence (AAAI) (2019)
Zhou, S., Zhao, W., Feng, J., Lai, H., Pan, Y., Yin, J., Yan, S.: Personalized and occupational-aware age progression by generative adversarial networks (2017). CoRR arXiv:1711.09368
Zhu, H., Zhou, Q., Zhang, J., Wang, J.Z.: Facial aging and rejuvenation by conditional multi-adversarial autoencoder with ordinal regression (2018). arXiv preprint arXiv:1804.02740
Zhu, J., Shen, Y., Zhao, D., Zhou, B.: In-domain GAN inversion for real image editing. In: Proc. European Conf. on Computer Vision, pp. 592–608 (2020)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This research has been financially supported by the General Secretariat for Research and Technology (GSRT) and the Hellenic Foundation for Research and Innovation (HFRI) (Scholarship Code: 81)
Rights and permissions
About this article
Cite this article
Pantraki, E., Kotropoulos, C. Face aging using global and pyramid generative adversarial networks. Machine Vision and Applications 32, 82 (2021). https://doi.org/10.1007/s00138-021-01207-4
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00138-021-01207-4