Skip to main content

Automatic Facial Expression Neutralisation Using Generative Adversarial Network

  • Conference paper
  • First Online:
Proceedings of the 22nd Engineering Applications of Neural Networks Conference (EANN 2021)

Abstract

Face recognition systems has reached a level of maturity which makes it applicable in many applications. However, despite these recent results, the precision of face recognition systems still needs to be improved, especially with regard to facial expression and pose variation. Unlike existing methods that mostly operate on existed databases for recognition and identification, we present a new technique of facial expression neutralisation based on synthesizing realistic neutral images using Generative Adversarial Networks (GANs). In this article, we want to propose a new optimization technique called Ranger to be applied in the GANnotation architecture. Promising results are obtained on the RaFD dataset leading to improvements in the facial recognition system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Prakash, N., Agarwal, S., et al.: Analysis of denoising techniques applied to facial images for emotion recognition. In: 2020 7th International Conference on Signal Processing and Integrated Networks (SPIN). IEEE (2020)

    Google Scholar 

  2. Zhang, X., Xiong, Q., Xu, X.: A multimodal biometric recognition algorithm based on second generation curvelet and 2D Gabor filter. In: 2019 4th International Conference on Control, Robotics and Cybernetics (CRC), pp. 114–117. IEEE (2019)

    Google Scholar 

  3. Chen, L., Ouyang, Y., Zeng, Y., et al.: Dynamic facial expression recognition model based on BiLSTM-Attention. In: 2020 15th International Conference on Computer Science & Education (ICCSE), pp. 828–832. IEEE (2020)

    Google Scholar 

  4. Heisele, B., Ho, P., Poggio, T.: Face recognition with support vector machines: global versus component-based approach. In: Proceedings of Eighth IEEE International Conference on Computer Vision, ICCV 2001, pp. 688–694. IEEE (2001)

    Google Scholar 

  5. Choi, Y., Choi, M., Kim, M., et al.: StarGAN: unified generative adversarial networks for multi-domain image-to-image translation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8789–8797 (2018)

    Google Scholar 

  6. Yang, H., Ciftci, U., Yin, L.: Facial expression recognition by de-expression residue learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2168–2177 (2018)

    Google Scholar 

  7. Barman, A., Dutta, P.: Facial expression recognition using distance and texture signature relevant features. Appl. Soft Comput. 77, 88–105 (2019)

    Article  Google Scholar 

  8. Karras, T., Aila, T., Laine, S., Lehtinen, J.: Progressive growing of GANs for improved quality, stability, and variation, October 2017

    Google Scholar 

  9. Sanchez, E., Valstar, M.: Triple consistency loss for pairing distributions in GAN-based face synthesis. arXiv preprint arXiv:1811.03492 (2018)

  10. Sajjadi, M.S.M., Scholkopf, B., Hirsch, M.: EnhanceNet: single image super-resolution through automated texture synthesis. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 4491–4500 (2017)

    Google Scholar 

  11. Isola, P., Zhu, J.-Y., Zhou, T., et al.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1125–1134 (2017)

    Google Scholar 

  12. Yu, Y., Gong, Z., Zhong, P., Shan, J.: Unsupervised representation learning with deep convolutional neural network for remote sensing images. In: Zhao, Y., Kong, X., Taubman, D. (eds.) International Conference on Image and Graphics, pp. 97–108. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-71589-6_9

  13. Nakamura, T., Sakuma, Y., Nishi, H.: Face image anonymization as an application of multidimensional data K-anonymizer. In: Seventh International Symposium on Computing and Networking Workshops (CANDARW), pp. 155–161. IEEE (2019)

    Google Scholar 

  14. Sun, Y., Tang, J., Sun, Z., et al.: Facial age and expression synthesis using ordinal ranking adversarial networks. IEEE Trans. Inf. Forensics Secur. 15, 2960–2972 (2020)

    Article  Google Scholar 

  15. Zhu, J.-Y., Park, T., Isola, P., et al.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2223–2232 (2017)

    Google Scholar 

  16. Yong, H., Huang, J., Hua, X., et al.: Gradient centralization: a new optimization technique for deep neural networks. arXiv preprint arXiv:2004.01461 (2020)

  17. Richardson, E., Alaluf, Y., Patashnik, O., et al.: Encoding in style: a StyleGAN encoder for image-to-image translation. arXiv preprint arXiv:2008.00951 (2020)

  18. Liu, J., Li, Q., Zhang, P., et al.: Unpaired domain transfer for data augment in face recognition. IEEE Access 8, 39349–39360 (2020)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wiem, G., Ali, D. (2021). Automatic Facial Expression Neutralisation Using Generative Adversarial Network. In: Iliadis, L., Macintyre, J., Jayne, C., Pimenidis, E. (eds) Proceedings of the 22nd Engineering Applications of Neural Networks Conference. EANN 2021. Proceedings of the International Neural Networks Society, vol 3. Springer, Cham. https://doi.org/10.1007/978-3-030-80568-5_1

Download citation

Publish with us

Policies and ethics