skip to main content
10.1145/3009977.3009985acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicvgipConference Proceedingsconference-collections
research-article

Adaptive artistic stylization of images

Published:18 December 2016Publication History

ABSTRACT

In this work, we present a novel non-photorealistic rendering method which produces good quality stylization results for color images. The procedure is driven by saliency measure in the foreground and the background region. We start with generating saliency map and simple thresholding based segmentation to get rough estimation of the foreground-background mask. We improve this mask by using a scribble-based method where the scribbles for foreground-background regions are automatically generated from the previous rough estimation. Followed by the mask generation, we proceed with an iterative abstraction process which involves edge-preserving blurring and edge detection. The number of iterations of the abstraction process to be performed in the foreground and background regions are decided by tracking the changes in saliency measure in the foreground and the background regions. Performing unequal number of iterations helps to improve the average saliency measure in more salient region (foreground) while decreasing the average saliency measure in the non-salient region (background). Implementation results of our method shows the merits of this approach with other competing methods.

References

  1. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk. Frequency-tuned salient region detection. In Computer vision and pattern recognition, 2009. cvpr 2009. ieee conference on, pages 1597--1604. IEEE, 2009.Google ScholarGoogle Scholar
  2. Y. Boykov and V. Kolmogorov. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. In International workshop on energy minimization methods in computer vision and pattern recognition, pages 359--374. Springer, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. N. D. Bruce and J. K. Tsotsos. Saliency, attention, and visual search: An information theoretic approach. volume 9, pages 5--5. The Association for Research in Vision and Ophthalmology, 2009.Google ScholarGoogle Scholar
  4. J. Canny. A computational approach to edge detection. IEEE Transactions on pattern analysis and machine intelligence, (6):679--698, 1986. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. M.-M. Cheng, N. J. Mitra, X. Huang, P. H. Torr, and S.-M. Hu. Global contrast based salient region detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(3):569--582, 2015.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. DeamDreamGeneratorTeam. Deap dream generator, 2015. Available at http://deepdreamgenerator.com/.Google ScholarGoogle Scholar
  7. D. DeCarlo and A. Santella. Stylization and abstraction of photographs. In ACM transactions on graphics (TOG), volume 21, pages 769--776. ACM, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. P. Dollár and C. L. Zitnick. Structured forests for fast edge detection. In Proceedings of the IEEE International Conference on Computer Vision, pages 1841--1848, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. P. Dollár and C. L. Zitnick. Fast edge detection using structured forests. IEEE transactions on pattern analysis and machine intelligence, 37(8):1558--1570, 2015.Google ScholarGoogle Scholar
  10. F. Durand, V. Ostromoukhov, M. Miller, F. Duranleau, and J. Dorsey. Decoupling strokes and high-level attributes for interactive traditional drawing. In Rendering Techniques 2001, pages 71--82. Springer, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. T. Gerstner, D. DeCarlo, M. Alexa, A. Finkelstein, Y. Gingold, and A. Nealen. Pixelated image abstraction. In Proceedings of the Symposium on Non-Photorealistic Animation and Rendering, pages 29--36. Eurographics Association, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. B. Gooch, E. Reinhard, and A. Gooch. Human facial illustrations: Creation and psychophysical evaluation. ACM Transactions on Graphics (TOG), 23(1):27--44, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. J. Hays and I. Essa. Image and video based painterly animation. In Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, pages 113--120. ACM, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. K. He, J. Sun, and X. Tang. Guided image filtering. In European conference on computer vision, pages 1--14. Springer, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. A. Hertzmann. Painterly rendering with curved brush strokes of multiple sizes. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques, pages 453--460. ACM, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. J. F. Hughes, A. van Dam, M. McGuire, D. F. Sklar, J. D. Foley, S. K. Feiner, and K. Akeley. Computer graphics: principles and practice (3rd ed.). Addison-Wesley Professional, Boston, MA, USA, July 2013.Google ScholarGoogle Scholar
  17. H. Kang, S. Lee, and C. K. Chui. Flow-based image abstraction. IEEE transactions on visualization and computer graphics, 15(1):62--76, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. J. E. Kyprianidis and J. Döllner. Image abstraction by structure adaptive filtering. In TPCG, pages 51--58, 2008.Google ScholarGoogle Scholar
  19. P. Litwinowicz. Processing images and video for an impressionist effect. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques, pages 407--414. ACM Press/Addison-Wesley Publishing Co., 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. R. Margolin, A. Tal, and L. Zelnik-Manor. What makes a patch distinct? In CVPR, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. R. Nagar and S. Raman. Saliency guided adaptive image abstraction. In The 5th National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), pages 16--19, 2015.Google ScholarGoogle ScholarCross RefCross Ref
  22. B. M. Oh, M. Chen, J. Dorsey, and F. Durand. Image-based modeling and photo editing. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pages 433--442. ACM, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. A. Orzan, A. Bousseau, P. Barla, and J. Thollot. Structure-preserving manipulation of photographs. In Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, pages 103--110. ACM, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. P. Perona and J. Malik. Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on pattern analysis and machine intelligence, 12(7):629--639, 1990. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. PrismaInc. Prisma. Available at https://play.google.com/store/apps/details?id=com.neuralprisma&hl=en.Google ScholarGoogle Scholar
  26. P. Rosin and J. Collomosse. Image and Video-Based Artistic Stylisation, volume 42. Springer Science & Business Media, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. M. P. Salisbury, M. T. Wong, J. F. Hughes, and D. H. Salesin. Orientable textures for image-based pen-and-ink illustration. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques, pages 401--406. ACM Press/Addison-Wesley Publishing Co., 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. M. C. Sousa and J. W. Buchanan. Observational models of graphite pencil materials. In Computer Graphics Forum, volume 19, pages 27--49, 2000.Google ScholarGoogle ScholarCross RefCross Ref
  29. M. Tang, L. Gorelick, O. Veksler, and Y. Boykov. Grabcut in one cut. In Proceedings of the IEEE International Conference on Computer Vision, pages 1769--1776, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. C. Tomasi and R. Manduchi. Bilateral filtering for gray and color images. In Computer Vision, 1998. Sixth International Conference on, pages 839--846. IEEE, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. G. Winkenbach and D. H. Salesin. Computer-generated pen-and-ink illustration. In Proceedings of the 21st annual conference on Computer graphics and interactive techniques, pages 91--100. ACM, 1994. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. H. Winnemöller. Xdog: advanced image stylization with extended difference-of-gaussians. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering, pages 147--156. ACM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. H. Winnemöller, S. C. Olsen, and B. Gooch. Real-time video abstraction. In ACM Transactions On Graphics (TOG), volume 25, pages 1221--1226. ACM, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. J. Zhang, S. Sclaroff, Z. Lin, X. Shen, B. Price, and R. Mech. Minimum barrier salient object detection at 80 fps. In Proceedings of the IEEE International Conference on Computer Vision, pages 1404--1412, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. C. L. Zitnick and P. Dollár. Edge boxes: Locating object proposals from edges. In European Conference on Computer Vision, pages 391--405. Springer, 2014.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Adaptive artistic stylization of images

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          ICVGIP '16: Proceedings of the Tenth Indian Conference on Computer Vision, Graphics and Image Processing
          December 2016
          743 pages
          ISBN:9781450347532
          DOI:10.1145/3009977

          Copyright © 2016 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 18 December 2016

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          ICVGIP '16 Paper Acceptance Rate95of286submissions,33%Overall Acceptance Rate95of286submissions,33%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader