skip to main content
10.1145/3633624.3633636acmotherconferencesArticle/Chapter ViewAbstractPublication PagesbdsicConference Proceedingsconference-collections
research-article

A Study on the Effectiveness of Deep Learning Architectures in Style Transfer: A Comparative Analysis of CNN, VGG16, and VGG19

Published: 29 January 2024 Publication History

Abstract

This study explores the performance differences among different deep learning models, including VGG19, VGG16, and a basic CNN, in the context of image style transfer. Style transfer is an image processing technique aimed at transferring the artistic style of one image onto the content of another. Our research motivation stems from the potential applications of style transfer across various domains and the opportunities for enhancing model performance. Through a series of experiments, we assess the performance of these models in terms of the visual quality of generated images, style preservation, feature extraction, and training efficiency. The results demonstrate significant variations in performance across diverse and complex conditions, especially in tasks involving advanced features. VGG19 and VGG16 exhibit exceptional performance, accurately capturing and conveying high-level features, resulting in the generation of synthesized images with artistic value. However, for tasks emphasizing speed and resource efficiency, the basic CNN also exhibits notable advantages. Lastly, we discuss the limitations of the study and provide suggestions for future work to further optimize model performance. In conclusion, the choice of an appropriate deep learning model should be determined by the nature and requirements of the task. This research provides valuable insights into the applications of different models in the field of image style transfer.

References

[1]
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016). Image Style Transfer Using Convolutional Neural Networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[2]
Johnson, J., Alahi, A., & Fei-Fei, L. (2016). Perceptual Losses for Real-Time Style Transfer and Super-Resolution. In Proceedings of the European Conference on Computer Vision (ECCV).
[3]
Huang, X., Belongie, S., & Learned-Miller, E. (2017). Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization. In Proceedings of the IEEE International Conference on Computer Vision (ICCV).
[4]
Chen, T., Li, M., Li, Y., Lin, M., Wang, N., Wang, M., ... & Lu, D. (2017). Fast Neural Style Transfer via Instance Normalization. In Proceedings of the International Conference on Learning Representations (ICLR).
[5]
Zhu, J. Y., Park, T., Isola, P., & Efros, A. A. (2017). Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. In Proceedings of the IEEE International Conference on Computer Vision (ICCV).
[6]
Sun, C., & Song, L. B. (2022). Image Style Transfer: from Artistic to Photorealistic. arXiv preprint arXiv:2203.06328.1
[7]
Q. Shang, L. Hu, Q. Li, W. Long and L. Jiang, "A Survey of Research on Image Style Transfer Based on Deep Learning," 2021 3rd International Conference on Artificial Intelligence and Advanced Manufacture (AIAM), Manchester, United Kingdom, 2021, pp. 386-391.
[8]
S. Ren and Y. Sheng, "Image Style Transfer Using Deep Learning Methods," 2022 IEEE International Conference on Electrical Engineering, Big Data and Algorithms (EEBDA), Changchun, China, 2022, pp. 1190-1195.
[9]
L. Liu, Z. Xi, R. Ji, and W. Ma, “Advanced deep learning techniques for image style transfer: A survey,” Signal Processing: Image Communication, vol. 78, pp. 465–470, Oct. 2019.
[10]
Q. Cai, M. Ma, C. Wang, and H. Li, “Image neural style transfer: A review,” Computers and Electrical Engineering, vol. 108, p. 108723, May 2023.

Index Terms

  1. A Study on the Effectiveness of Deep Learning Architectures in Style Transfer: A Comparative Analysis of CNN, VGG16, and VGG19

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    BDSIC '23: Proceedings of the 2023 5th International Conference on Big-data Service and Intelligent Computation
    October 2023
    101 pages
    ISBN:9798400708923
    DOI:10.1145/3633624
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 January 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Basic CNN
    2. Deep Learning Models
    3. Feature Extraction
    4. Image Processing
    5. Loss Function
    6. Model Performance
    7. Style Transfer
    8. VGG16
    9. VGG19

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    BDSIC 2023

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 41
      Total Downloads
    • Downloads (Last 12 months)37
    • Downloads (Last 6 weeks)10
    Reflects downloads up to 25 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media