Skip to main content

Style Transfer Based on Style Primitive Discovery

  • Conference paper
  • First Online:
Advances in Multimedia Information Processing – PCM 2017 (PCM 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10736))

Included in the following conference series:

  • 2467 Accesses

Abstract

Example-based stylization provides a direct way of making artistic effects for images. However existing methods are not suitable for artistic applications like Chinese embroidery. In this paper, we propose an example-based non-rigid image stylization method tailored for Chinese embroidery art. To this aim, a novel style transfer framework is presented, which works by using different aggregation patterns, i.e. regular primitive and stochastic primitive. We find that these two patterns are surprisingly effective in embroidery description. Specifically, we first extract these two style primitives from an example image according to the directionality and orientation. Then we employ a primitive selection algorithm to filter defected primitives. After that, we employ a sparse representation-based style transfer method, to synthesize the final result. In the experiments, the synthesis results show that our framework is superior to state-of-the-art methods and performs more efficient on large resolution images.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Kyprianidis, J.E., Collomosse, J., Wang, T., Isenberg, T.: State of the ‘Art’: a taxonomy of artistic stylization techniques for images and video. TVCG 19, 866–885 (2013)

    Google Scholar 

  2. Zeng, K., Zhao, M., Xiong, C., Zhu, S.-C.: From image parsing to painterly rendering. ACM Trans. Graph. 29, 1–11 (2009)

    Article  Google Scholar 

  3. Hertzmann, A., Jacobs, C.E., Oliver, N., Curless, B., Salesin, D.H.: Image analogies. In: SIGGRAPH 2001 (2001)

    Google Scholar 

  4. Kang, H., Lee, S., Chui, C.K.: Coherent line drawing. In: Proceedings of the NPAR, vol. 1, pp. 43–50 (2007)

    Google Scholar 

  5. Wang, B., Wang, W., Yang, H., Sun, J.: Efficient example-based painting and synthesis of 2D directional texture. TVCG 10, 266–277 (2004)

    Google Scholar 

  6. Lukáč, M., Fišer, J., Asente, P., Lu, J., Shechtman, E., Sýkora, D.: Brushables: example-based edge-aware directional texture painting. CGF 34, 257–267 (2015)

    Google Scholar 

  7. Kim, S.Y., Maciejewski, R., Isenberg, T., Andrews, W.M., Chen, W., Sousa, M.C., Ebert, D.S.: Stippling by example. In: NPAR 2009 (2009)

    Google Scholar 

  8. Zhang, W., Cao, C., Chen, S., Liu, J., Tang, X.: Style transfer via image component analysis. IEEE TMM 15, 1594–1601 (2013)

    Google Scholar 

  9. Frigo, O., Sabater, N., Delon, J., Hellier, P.: Split and Match: example-based adaptive patch sampling for unsupervised style transfer. In: CVPR 2016 (2016)

    Google Scholar 

  10. Efron, B., Hastie, T., Johnstone, I., Tibshirani, R.: Least angle regression. Ann. Stat. 32, 407–499 (2004)

    Article  MathSciNet  Google Scholar 

  11. Yang, S., Wang, M., Chen, Y., Sun, Y.: Single-image super-resolution reconstruction via learned geometric dictionaries and clustered sparse coding. TIP 21, 4016–4028 (2012)

    MathSciNet  MATH  Google Scholar 

  12. Koh, K., Kim, S.-J., Boyd, S.: An interior-point method for large-scale l1-regularized logistic regression. J. Mach. Learn. Res. 8, 1519–1555 (2007)

    MathSciNet  MATH  Google Scholar 

  13. Gatys, L.A., Ecker, A.S., Bethge, M.: Image style transfer using convolutional neural networks. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2414–2423 (2016)

    Google Scholar 

  14. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE TIP 13, 600–612 (2004)

    Google Scholar 

Download references

Acknowledgements

This work was supported by National High Technology Research and Development Program of China (No. 2007AA01Z334), National Natural Science Foundation of China (Nos. 61321491 and 61272219), Innovation Fund of State Key Laboratory for Novel Software Technology (Nos. ZZKT2013A12 and ZZKT2016A11), and Program for New Century Excellent Talents in University of China (NCET-04-04605).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhengxing Sun .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wu, H., Sun, Z., Wang, S., Yuan, W., Chen, HH. (2018). Style Transfer Based on Style Primitive Discovery. In: Zeng, B., Huang, Q., El Saddik, A., Li, H., Jiang, S., Fan, X. (eds) Advances in Multimedia Information Processing – PCM 2017. PCM 2017. Lecture Notes in Computer Science(), vol 10736. Springer, Cham. https://doi.org/10.1007/978-3-319-77383-4_83

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-77383-4_83

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-77382-7

  • Online ISBN: 978-3-319-77383-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics