skip to main content
10.1145/3587716.3587771acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicmlcConference Proceedingsconference-collections
research-article

Custom attribute image generation based on improved StyleGAN2

Published: 07 September 2023 Publication History

Abstract

The continuous development of generative adversarial networks [1] has made it easier and easier to generate forged face images. Using generative adversarial networks can easily generate a large number of face images. However, the face images generated by generative adversarial networks are not of high quality and the face attributes cannot be controlled. In order to solve these problems, In this paper, we first use a style-based generative adversarial network [2] as a face image generator to generate high-quality face images, and then we create a convolutional neural network [3] that can predict the age and gender attributes of the input face image to control the age and gender of the generated face image. We experimentally demonstrated the reliability of the idea and finally achieved face image generation with customized attributes.

References

[1]
I. Goodfellow, “Generative adversarial networks,” Commun. ACM, vol. 63, no. 11, pp. 139–144, November 2020.
[2]
T. Karras, S. Laine, and T. Aila, “A style-based generator architecture for generative adversarial networks,” in Proc. IEEE/CVF CVPR, Long Beach, CA, USA, 2019, pp. 4401–4410.
[3]
M. Rastegari, V. Ordonez, J. Redmon, and A. Farhadi, “XNOR-Net: imagenet classification using binary convolutional neural networks,” in European Conference on Computer Vision, vol. 9908, B. Leibe, J. Matas, N. Sebe, and M. Welling, Eds. Cham: Springer, 2016, pp. 525–542.
[4]
R. Saha, B. Duke, F. Shkurti, G. W. Taylor, and P. Aarabi, “Loho: Latent optimization of hairstyles via orthogonalization,” in Proc. IEEE/CVF CVPR, Kuala Lumpur, Kuala Lumpur, 2021, pp. 1984–1993.
[5]
R. Abdal, Y. Qin, and P. Wonka, “Image2stylegan: How to embed images into the stylegan latent space?,” in Proc. IEEE/CVF CVPR, Long Beach, CA, USA, 2019, pp. 4432–4441.
[6]
Y. Shen, J. Gu, X. Tang, and B. Zhou, “Interpreting the latent space of GANs for semantic face editing,” in Proc. IEEE/CVF CVPR, Seattle, WA, USA, 2020, pp. 9243–9252.
[7]
O. Arenz, G. Neumann, and M. Zhong, “Efficient gradient-free variational inference using policy search,” in Proc. 35th ICML, Stockholm, Sverige, 2018, pp. 234–243.
[8]
T. Karras, T. Aila, S. Laine, and J. Lehtinen, “Progressive growing of gans for improved quality, stability, and variation,” 2017, arXiv:1710.10196.
[9]
M. Mirza and S. Osindero, “Conditional generative adversarial nets,” 2014, arXiv: 1411.1784.
[10]
A. Radford, L. Metz, and S. Chintala, “Unsupervised representation learning with deep convolutional generative adversarial networks,” 2015, arXiv:1511.06434.
[11]
W. Liu, “Sphereface: Deep hypersphere embedding for face recognition,” in Proc. IEEE CVPR, Hawaii, HI, USA, 2017, pp. 212–220.
[12]
Q. Cao, L. Shen, W. Xie, O. M. Parkhi, and A. Zisserman, “Vggface2: A dataset for recognising faces across pose and age,” in Proc. GFR, Xi'an, China, 2018, pp. 67–74.
[13]
E. Eidinger, R. Enbar, and T. Hassner, “Age and gender estimation of unfiltered faces,” IEEE T. Inf. Foren. Sec., vol. 9, no. 12, pp. 2170–2179, Dec. 2014.
[14]
A. E. B. Alawi and A. Y. Saeed, “Facial age estimation using convolution neural networks,” in Proc. 2021 ICOTEN, Taiz, Yemen, 2021, pp. 1–4.
[15]
R. Rothe, R. Timofte, and L. Van Gool, “Dex: Deep expectation of apparent age from a single image,” in Proc. IEEE ICCV, Santiago, Chile, 2015, pp. 10–15.
[16]
E. Şafak And N. Barışçı, “Evrişimsel Sinir Ağlarını Kullanarak Yaş ve Cinsiyet Tahmini-Age and Gender Prediction Using Convolutional Neural Networks,” in Proc. ISMSIT, Ankara, Turkey, 2018.
[17]
C. H. Nga, K. T. Nguyen, N. C. Tran, and J. C. Wang, “Transfer learning for gender and age prediction,” in Proc. ICCE-Taiwan, Taoyuan, Taiwan, China, pp. 1–2.
[18]
K. Jhang, “Gender prediction based on voting of CNN models,” in Proc. ICHIT, Kuala Lumpur, Malaysia, pp. 89–92.
[19]
T. Xu, “AttnGAN: Fine-grained text to image generation with attentional generative adversarial networks,” in Proc. IEEE/CVF CCVPR, Salt Lake City, UT, USA, pp. 1316–1324.
[20]
Y. Choi, “Stargan: Unified generative adversarial networks for multi-domain image-to-image translation,” in Proc. IEEE CCVPR, Salt Lake City, UT, USA, 2018, pp. 8789–8797.

Cited By

View all
  • (2024)A Ship Detection Method in Infrared Remote Sensing Images Based on Image Generation and Causal InferenceElectronics10.3390/electronics1307129313:7(1293)Online publication date: 30-Mar-2024

Index Terms

  1. Custom attribute image generation based on improved StyleGAN2
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        ICMLC '23: Proceedings of the 2023 15th International Conference on Machine Learning and Computing
        February 2023
        619 pages
        ISBN:9781450398411
        DOI:10.1145/3587716
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 07 September 2023

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. face image generation
        2. gender and age classification network
        3. style-based generative adversarial networks

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Conference

        ICMLC 2023

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)13
        • Downloads (Last 6 weeks)1
        Reflects downloads up to 20 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)A Ship Detection Method in Infrared Remote Sensing Images Based on Image Generation and Causal InferenceElectronics10.3390/electronics1307129313:7(1293)Online publication date: 30-Mar-2024

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media