Skip to main content

Stitch-Based Image Stylization for Thread Art Using Sparse Modeling

  • Conference paper
  • First Online:
MultiMedia Modeling (MMM 2018)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10704))

Included in the following conference series:

Abstract

Random-needle Embroidery (RNE) is a graceful Chinese Embroidery art enrolled in the World Intangible Heritage. In this paper, we propose a rendering method to translate a reference image into an art image with the style of random-needles. Since RNE artists create artwork by stitching thousands of intersecting threads with complex patterns into an embroidery cloth, the key of RNE rendering is to define its threads distributions in vector space (actual physical space) and generate its artistic styles in pixel space (coordinate system of the image). To this end, we first define “stitch” which is a collection of threads arranged in a certain pattern as the basic rendering primitive. A vector space stitch model is presented, which can automatically generate various thread distributions in stitches. Then, the rendering primitives are generated by rasterizing the stitches on 2D pixel arrays. During runtime, new stitches can be synthesized to portray the image content via sparse modeling based on the pre-defined stitches. In order to avoid mosaic effects, this result is further refined by incorporating local stitch vector constraints, in which we enforce the thread distribution of the local stitch to be similar to its adjacent stitches. Finally, rendering image is generated by placing stitches with different attributes on the canvas. Experiments show that our method can perform fine images with the style of random-needle.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Collomosse, J.P., Hall, P.M.: Painterly rendering using image salience. In: Proceedings of EGUK 2002, pp. 122–128 (2002)

    Google Scholar 

  2. Cui, D., Sheng, Y., Zhang, G.: Image-based embroidery modeling and rendering. J. Vis. Comput. Anim. 28(2) (2017)

    Google Scholar 

  3. Delong, A., Osokin, A., Isack, H.N., Boykov, Y.: Fast approximate energy minimization with label costs. In: Proceeding of CVPR, pp. 2173–2180 (2010)

    Google Scholar 

  4. Gatys, L.A., Ecker, A.S., Bethge, M.: A neural algorithm of artistic style. ArXiv e-prints (2015)

    Google Scholar 

  5. Kang, H., Lee, S., Chui, C.K.: Coherent line drawing. In: Proceedings of the 5th International Symposium on Non-photorealistic Animation and Rendering, pp. 43–50 (2007)

    Google Scholar 

  6. Kopf, J., Cohen-Or, D., Deussen, O., Lischinski, D.: Recursive Wang tiles for real-time blue noise. ACM Trans. Graph. (TOG) 25(3), 509–518 (2006)

    Article  Google Scholar 

  7. Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. (ToG) 22(3), 277–286 (2003)

    Article  Google Scholar 

  8. Mairal, J., Bach, F., Ponce, J., Sapiro, G.: Online learning for matrix factorization and sparse coding. J. Mach. Learn. Res. 11, 19–60 (2010)

    MathSciNet  MATH  Google Scholar 

  9. Praun, E., Hoppe, H., Webb, M., Finkelstein, A.: Real-time hatching. In: Proceedings of SIGGRAPH 2001, pp. 581–586 (2001)

    Google Scholar 

  10. Qu, Y., Pang, W.M., Wong, T.T., Heng, P.A.: Richness-preserving manga screening. ACM Trans. Graph. 27(5), 155:1–155:8 (2008)

    Google Scholar 

  11. Rosin, P., Collomosse, J.: Image and Video-Based Artistic Stylisation, vol. 42. Springer-Verlag, London (2013). https://doi.org/10.1007/978-1-4471-4519-6

    Book  Google Scholar 

  12. Tamura, H., Mori, S., Yamawaki, T.: Textural features corresponding to visual perception. IEEE Trans. Syst. Man Cybern. 8(6), 460–473 (1978)

    Article  Google Scholar 

  13. Yang, S., Wang, M., Chen, Y., Sun, Y.: Single-image super-resolution reconstruction via learned geometric dictionaries and clustered sparse coding. IEEE Trans. Image Process. 21(9), 4016–4028 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  14. Yang, K., Sun, Z.: Paint with stitches: a style definition and image-based rendering method for random-needle embroidery. Multimedia Tools Appl. 76(14), 1–34 (2017)

    Article  Google Scholar 

  15. Yang, K., Sun, Z., Ma, C., Yang, W.: Paint with stitches: a random-needle embroidery rendering method. In: Proceedings of the 33rd Computer Graphics International, pp. 9–12 (2016)

    Google Scholar 

  16. Zhou, J., Sun, Z., Yang, K.: A controllable stitch layout strategy for random needle embroidery. J. Zhejiang Univ. Sci. C 15(9), 729–743 (2014)

    Article  Google Scholar 

Download references

Acknowledgement

This work was supported by National High Technology Research and Development Program of China (No. 2007AA01Z334), National Natural Science Foundation of China (Nos. 61321491 and 61272219), Innovation Fund of State Key Laboratory for Novel Software Technology (Nos. ZZKT2013A12 and ZZKT2016A11), and Program for New Century Excellent Talents in University of China (NCET-04-04605).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhengxing Sun .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yang, K., Sun, Z., Wang, S., Li, B. (2018). Stitch-Based Image Stylization for Thread Art Using Sparse Modeling. In: Schoeffmann, K., et al. MultiMedia Modeling. MMM 2018. Lecture Notes in Computer Science(), vol 10704. Springer, Cham. https://doi.org/10.1007/978-3-319-73603-7_39

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-73603-7_39

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-73602-0

  • Online ISBN: 978-3-319-73603-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics