Skip to main content
SpringerLink
Log in

StoryWizard: a framework for fast stylized story illustration

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

A fast stylized framework used for creating illustration of a given story is represented. The framework automatically searches proper online images according to the keywords of story, provides users some tools to make the search result precise, and helps users create a picture in every scene without considering the consistency of each character. With the friendly user interface, it provides user abundant interactions, which helps users express their ideas flexibly. Experimental results indicate that this framework allows users, without any art background, to produce personalized picture series with specified story. The fast process, effective interaction and generated delicate pictures can make a story more impressive.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Allen, J.: Natural Language Understanding, 2nd edn. Benjamin, Elmsford (1995)

    MATH  Google Scholar 

  2. Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24 (2002)

  3. Bhat, P., Zitnick, C.L., Cohen, M., Curless, B.: Gradientshop: a gradient-domain optimization framework for image and video filtering. ACM Trans. Graph. 29 (2010)

  4. Chen, T., Cheng, M.M., Tan, P., Shamir, A., Hu, S.M.: Sketch2photo: internet image montage. ACM Trans. Graph. 28 (2009)

  5. Cheng, M.M., Zhang, G.X., Mitra, N.J., Huang, X., Hu, S.M.: Global contrast based salient region detection. In: IEEE CVPR (2011)

    Google Scholar 

  6. Coelho, F., Ribeiro, C.: Dpikt: automatic illustration system for media content. In: Proceedings of the 9th International Workshop on Content-based Multimedia Indexing (2011)

    Google Scholar 

  7. Collomosse, J.P., McNeill, G., Qian, Y.: Storyboard sketches for content based video retrieval. In: IEEE 12th International Conference on Computer Vision (2009)

    Google Scholar 

  8. Curtis, C.J., Anderson, S.E., Seims, J.E., Fleischer, K.W., Salesin, D.H.: Computer-generated watercolor. In: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (1997)

    Google Scholar 

  9. Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image retrieval: ideas, influences, and trends of the new age. ACM Comput. Surv. 39 (2006)

  10. Delgado, D., Magalhaes, J., Correia, N.: Automated illustration of news stories. In: Proceedings of the 2010 IEEE Fourth International Conference on Semantic Computing (2010)

    Google Scholar 

  11. Ding, M., Tong, R.F.: Content-aware copying and pasting in images. Vis. Comput. 26 (2010)

  12. Eitz, M., Hildebrand, K., Boubekeur, T., Alexa, M.: Photosketch: a sketch based image query and compositing system. In: SIGGRAPH 2009: Talks, SIGGRAPH ’09 (2009)

    Google Scholar 

  13. Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59 (2004)

  14. Georgescu, B., Shimshoni, I., Meer, P.: Mean shift based clustering in high dimensions: a texture classification example (2003)

  15. Hanser, E., Kevitt, P.M., Lunney, T., Condell, J.: Scenemaker: automatic visualisation of screenplays. In: Proceedings of the 32nd Annual German Conference on Advances in Artificial Intelligence (2009)

    Google Scholar 

  16. Hertzmann, A., Zorin, D.: Illustrating smooth surfaces. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (2000)

    Google Scholar 

  17. Jia, J., Sun, J., Tang, C.K., Shum, H.Y.: Drag-and-drop pasting. ACM Trans. Graph. (2006). SIGGRAPH

  18. Jin, W., Hujun, B., Weihua, Z., Qunsheng, P., Yingqing, X.: Automatic image-based pencil sketch rendering. J. Comput. Sci. Technol. 17 (2002)

  19. Johnson, M., Brostow, G.J., Shotton, J., Arandjelovic, O., Kwatra, V., Cipolla, R.: Semantic photo synthesis. Comput. Graph. Forum 25 (2006)

  20. Joshi, D., Wang, J.Z., Li, J.: The story picturing engine—a system for automatic text illustration. ACM Trans. Multimedia Comput. Commun. Appl. 2 (2006)

  21. Lalonde, J.F., Hoiem, D., Efros, A.A., Rother, C., Winn, J., Criminisi, A.: Photo clip art. ACM Trans. Graph. 26(3) (2007). SIGGRAPH 2007

  22. Levin, A., Lischinski, D., Weiss, Y.: A closed-form solution to natural image matting. IEEE Trans. Pattern Anal. Mach. Intell. 30 (2008)

  23. Liu, Z.Q., Leung, K.M.: Script visualization (scriptviz): a smart system that makes writing fun. Soft Comput. 10 (2006)

  24. Madden, M., Chung, P.W.H., Dawson, C.W.: The effect of a computer-based cartooning tool on children’s cartoons and written stories. Comput. Educ. 51 (2008)

  25. Manjunath, B., Ma, W.: Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Mach. Intell. 18 (1996)

  26. Oliva, A., Torralba, A.: Building the gist of a scene: the role of global image features in recognition. In: Progress in Brain Research, p. 2006 (2006)

    Google Scholar 

  27. Rother, C., Kolmogorov, V., Blake, A.: “grabcut”: interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23 (2004)

  28. Schwarz, K., Rojtberg, P., Caspar, J., Gurevych, I., Goesele, M., Lensch, H.P.A.: Text-to-video: story illustration from online photo collections. In: Proceedings of the 14th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems: Part IV (2010)

    Google Scholar 

  29. Sekine, S.: Corpus-based parsing and sublanguage studies. Ph.D. thesis, New York University (1998)

  30. Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell. 22 (2000)

  31. Wang, C., Li, Z., Zhang, L.: Mindfinder: image search by interactive sketching and tagging. In: Proceedings of the 19th International Conference on World Wide Web (2010)

    Google Scholar 

  32. Wang, J.Z., Li, J., Wiederhold, G.: Simplicity: Semantics-sensitive integrated matching for picture libraries. IEEE Trans. Pattern Anal. Mach. Intell. 23 (2001)

  33. Zhao, M., Zhu, S.C.: Customizing painterly rendering styles using stroke processes. In: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Tianjin University, Tianjin, China

    Jiawan Zhang, Yukun Hao, Liang Li, Di Sun & Li Yuan

Authors
  1. Jiawan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yukun Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Liang Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Di Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Li Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Liang Li.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, J., Hao, Y., Li, L. et al. StoryWizard: a framework for fast stylized story illustration. Vis Comput 28, 877–887 (2012). https://doi.org/10.1007/s00371-012-0702-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-012-0702-3

Keywords

Search

Navigation