Skip to main content

Image-to-Image Local Feature Translation Using Double Adversarial Networks Based on CycleGAN

  • Conference paper
  • First Online:
Communications, Signal Processing, and Systems (CSPS 2018)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 516))

  • 2219 Accesses

Abstract

Image-to-image translation is a hot field in the machine learning with the emergency of the generative adversarial networks. Most of the latest models easily lead to changes in the overall image and overfitting when they are used to local feature translation. To address these limitations, this article adds a suppressor and proposes a double adversarial CycleGAN. The suppressor is added to suppress the change of images, and the suppressor and generator form a new adversarial relationship. We hope it will achieve Nash equilibrium that is the change of image focus on the local feature. Finally, a contrast experiment was conducted. In the case of image local feature transfer, the change of image is focused on the local features and the overfitting phenomenon can be well resolved.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Liu M-Y, Breuel T, Kautz J. Unsupervised image-to-image translation networks. CoRR, abs/1703.00848, 2017.

    Google Scholar 

  2. Hertzmann A, Jacobs CE, Oliver N, Curless B, Salesin DH. Image analogies. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques, SIGGRAPH ’01. ACM: New York, NY, USA, 2001. p. 327–40.

    Google Scholar 

  3. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y. Generative adversarial nets. In: Ghahramani Z, Welling M, Cortes C, Lawrence ND, Weinberger KQ, editors. Advances in neural information processing systems 27. New York: Curran Associates, Inc.; 2014. p. 2672–80.

    Google Scholar 

  4. Perarnau G, van de Weijer J, Raducanu B, Álvarez JM. Invertible conditional gans for image editing. CoRR, abs/1611.06355, 2016.

    Google Scholar 

  5. Zhu J-Y, Krähenbühl P, Shechtman E, Efros AA. Generative visual manipulation on the natural image manifold. In: Proceedings of European conference on computer vision (ECCV), 2016.

    Chapter  Google Scholar 

  6. Xia Y, He D, Qin T, Wang L, Yu N, Liu T-Y, Ma W-Y. Dual learning for machine translation. CoRR, abs/1611.00179, 2016.

    Google Scholar 

  7. Shen W, Liu R. Learning residual images for face attribute manipulation. CoRR, abs/1612.05363, 2016.

    Google Scholar 

  8. Kim T, Cha M, Kim H, Lee JK, Kim J. Learning to discover cross-domain relations with generative adversarial networks. CoRR, abs/1703.05192, 2017.

    Google Scholar 

  9. Yi Z, Zhang H, Tan P, Gong M. Dualgan: Unsupervised dual learning for image-to-image translation. CoRR, abs/1704.02510, 2017.

    Google Scholar 

  10. Zhu J-Y, Park T, Isola P, Efros AA. Unpaired image-to-image translation using cycle-consistent adversarial networks. CoRR, abs/1703.10593, 2017.

    Google Scholar 

  11. Isola P, Zhu J-Y, Zhou T, Efros AA. Image-to-image translation with conditional adversarial networks. CoRR, abs/1611.07004, 2016.

    Google Scholar 

  12. Choi Y, Choi M-J, Kim M, Ha J-W, Kim S, Choo J. Stargan: Unified generative adversarial networks for multi-domain image-to-image translation. CoRR, abs/1711.09020, 2017.

    Google Scholar 

  13. Zhou S, Xiao T, Yang Y, Feng D, He Q, He W. Genegan: Learning object transfiguration and attribute subspace from unpaired data. CoRR, abs/1705.04932, 2017.

    Google Scholar 

  14. Taigman Y, Polyak A, Wolf L. Unsupervised cross-domain image generation. CoRR, abs/1611.02200, 2016.

    Google Scholar 

  15. Radford A, Metz L, Chintala S. Unsupervised representation learning with deep convolutional generative adversarial networks. CoRR, abs/1511.06434, 2015.

    Google Scholar 

  16. Qi G-J. Loss-sensitive generative adversarial networks on lipschitz densities. CoRR, abs/1701.06264, 2017.

    Google Scholar 

  17. Gulrajani I, Ahmed F, Arjovsky M, Dumoulin V, Courville AC. Improved training of wasserstein gans. CoRR, abs/1704.00028, 2017.

    Google Scholar 

  18. Heusel M, Ramsauer H, Unterthiner T, Nessler B, Klambauer G, Hochreiter S. Gans trained by a two time-scale update rule converge to a nash equilibrium. CoRR, abs/1706.08500, 2017.

    Google Scholar 

Download references

Acknowledgments

This work was supported by National Natural Science Foundation of China (Grant No. 61501251, 61373137, 61071167) and the Science Foundation of Nanjing University of Posts and Telecommunications Grant (NY214191).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chen Wu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wu, C., Li, L., Yang, Z., Yan, P., Jiao, J. (2020). Image-to-Image Local Feature Translation Using Double Adversarial Networks Based on CycleGAN. In: Liang, Q., Liu, X., Na, Z., Wang, W., Mu, J., Zhang, B. (eds) Communications, Signal Processing, and Systems. CSPS 2018. Lecture Notes in Electrical Engineering, vol 516. Springer, Singapore. https://doi.org/10.1007/978-981-13-6504-1_109

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-6504-1_109

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-6503-4

  • Online ISBN: 978-981-13-6504-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics