ABSTRACT
In this work, we present a novel non-photorealistic rendering method which produces good quality stylization results for color images. The procedure is driven by saliency measure in the foreground and the background region. We start with generating saliency map and simple thresholding based segmentation to get rough estimation of the foreground-background mask. We improve this mask by using a scribble-based method where the scribbles for foreground-background regions are automatically generated from the previous rough estimation. Followed by the mask generation, we proceed with an iterative abstraction process which involves edge-preserving blurring and edge detection. The number of iterations of the abstraction process to be performed in the foreground and background regions are decided by tracking the changes in saliency measure in the foreground and the background regions. Performing unequal number of iterations helps to improve the average saliency measure in more salient region (foreground) while decreasing the average saliency measure in the non-salient region (background). Implementation results of our method shows the merits of this approach with other competing methods.
- R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk. Frequency-tuned salient region detection. In Computer vision and pattern recognition, 2009. cvpr 2009. ieee conference on, pages 1597--1604. IEEE, 2009.Google Scholar
- Y. Boykov and V. Kolmogorov. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. In International workshop on energy minimization methods in computer vision and pattern recognition, pages 359--374. Springer, 2001. Google ScholarDigital Library
- N. D. Bruce and J. K. Tsotsos. Saliency, attention, and visual search: An information theoretic approach. volume 9, pages 5--5. The Association for Research in Vision and Ophthalmology, 2009.Google Scholar
- J. Canny. A computational approach to edge detection. IEEE Transactions on pattern analysis and machine intelligence, (6):679--698, 1986. Google ScholarDigital Library
- M.-M. Cheng, N. J. Mitra, X. Huang, P. H. Torr, and S.-M. Hu. Global contrast based salient region detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(3):569--582, 2015.Google ScholarDigital Library
- DeamDreamGeneratorTeam. Deap dream generator, 2015. Available at http://deepdreamgenerator.com/.Google Scholar
- D. DeCarlo and A. Santella. Stylization and abstraction of photographs. In ACM transactions on graphics (TOG), volume 21, pages 769--776. ACM, 2002. Google ScholarDigital Library
- P. Dollár and C. L. Zitnick. Structured forests for fast edge detection. In Proceedings of the IEEE International Conference on Computer Vision, pages 1841--1848, 2013. Google ScholarDigital Library
- P. Dollár and C. L. Zitnick. Fast edge detection using structured forests. IEEE transactions on pattern analysis and machine intelligence, 37(8):1558--1570, 2015.Google Scholar
- F. Durand, V. Ostromoukhov, M. Miller, F. Duranleau, and J. Dorsey. Decoupling strokes and high-level attributes for interactive traditional drawing. In Rendering Techniques 2001, pages 71--82. Springer, 2001. Google ScholarDigital Library
- T. Gerstner, D. DeCarlo, M. Alexa, A. Finkelstein, Y. Gingold, and A. Nealen. Pixelated image abstraction. In Proceedings of the Symposium on Non-Photorealistic Animation and Rendering, pages 29--36. Eurographics Association, 2012. Google ScholarDigital Library
- B. Gooch, E. Reinhard, and A. Gooch. Human facial illustrations: Creation and psychophysical evaluation. ACM Transactions on Graphics (TOG), 23(1):27--44, 2004. Google ScholarDigital Library
- J. Hays and I. Essa. Image and video based painterly animation. In Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, pages 113--120. ACM, 2004. Google ScholarDigital Library
- K. He, J. Sun, and X. Tang. Guided image filtering. In European conference on computer vision, pages 1--14. Springer, 2010. Google ScholarDigital Library
- A. Hertzmann. Painterly rendering with curved brush strokes of multiple sizes. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques, pages 453--460. ACM, 1998. Google ScholarDigital Library
- J. F. Hughes, A. van Dam, M. McGuire, D. F. Sklar, J. D. Foley, S. K. Feiner, and K. Akeley. Computer graphics: principles and practice (3rd ed.). Addison-Wesley Professional, Boston, MA, USA, July 2013.Google Scholar
- H. Kang, S. Lee, and C. K. Chui. Flow-based image abstraction. IEEE transactions on visualization and computer graphics, 15(1):62--76, 2009. Google ScholarDigital Library
- J. E. Kyprianidis and J. Döllner. Image abstraction by structure adaptive filtering. In TPCG, pages 51--58, 2008.Google Scholar
- P. Litwinowicz. Processing images and video for an impressionist effect. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques, pages 407--414. ACM Press/Addison-Wesley Publishing Co., 1997. Google ScholarDigital Library
- R. Margolin, A. Tal, and L. Zelnik-Manor. What makes a patch distinct? In CVPR, 2013. Google ScholarDigital Library
- R. Nagar and S. Raman. Saliency guided adaptive image abstraction. In The 5th National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), pages 16--19, 2015.Google ScholarCross Ref
- B. M. Oh, M. Chen, J. Dorsey, and F. Durand. Image-based modeling and photo editing. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pages 433--442. ACM, 2001. Google ScholarDigital Library
- A. Orzan, A. Bousseau, P. Barla, and J. Thollot. Structure-preserving manipulation of photographs. In Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, pages 103--110. ACM, 2007. Google ScholarDigital Library
- P. Perona and J. Malik. Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on pattern analysis and machine intelligence, 12(7):629--639, 1990. Google ScholarDigital Library
- PrismaInc. Prisma. Available at https://play.google.com/store/apps/details?id=com.neuralprisma&hl=en.Google Scholar
- P. Rosin and J. Collomosse. Image and Video-Based Artistic Stylisation, volume 42. Springer Science & Business Media, 2012. Google ScholarDigital Library
- M. P. Salisbury, M. T. Wong, J. F. Hughes, and D. H. Salesin. Orientable textures for image-based pen-and-ink illustration. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques, pages 401--406. ACM Press/Addison-Wesley Publishing Co., 1997. Google ScholarDigital Library
- M. C. Sousa and J. W. Buchanan. Observational models of graphite pencil materials. In Computer Graphics Forum, volume 19, pages 27--49, 2000.Google ScholarCross Ref
- M. Tang, L. Gorelick, O. Veksler, and Y. Boykov. Grabcut in one cut. In Proceedings of the IEEE International Conference on Computer Vision, pages 1769--1776, 2013. Google ScholarDigital Library
- C. Tomasi and R. Manduchi. Bilateral filtering for gray and color images. In Computer Vision, 1998. Sixth International Conference on, pages 839--846. IEEE, 1998. Google ScholarDigital Library
- G. Winkenbach and D. H. Salesin. Computer-generated pen-and-ink illustration. In Proceedings of the 21st annual conference on Computer graphics and interactive techniques, pages 91--100. ACM, 1994. Google ScholarDigital Library
- H. Winnemöller. Xdog: advanced image stylization with extended difference-of-gaussians. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering, pages 147--156. ACM, 2011. Google ScholarDigital Library
- H. Winnemöller, S. C. Olsen, and B. Gooch. Real-time video abstraction. In ACM Transactions On Graphics (TOG), volume 25, pages 1221--1226. ACM, 2006. Google ScholarDigital Library
- J. Zhang, S. Sclaroff, Z. Lin, X. Shen, B. Price, and R. Mech. Minimum barrier salient object detection at 80 fps. In Proceedings of the IEEE International Conference on Computer Vision, pages 1404--1412, 2015. Google ScholarDigital Library
- C. L. Zitnick and P. Dollár. Edge boxes: Locating object proposals from edges. In European Conference on Computer Vision, pages 391--405. Springer, 2014.Google ScholarCross Ref
Index Terms
Adaptive artistic stylization of images
Recommendations
Real-time saliency-aware video abstraction
Existing real-time automatic video abstraction systems rely on local contrast only for identifying perceptually important information and abstract imagery by reducing contrast in low-contrast regions while artificially increasing contrast in higher ...
Saliency-guided Enhancement for Volume Visualization
Recent research in visual saliency has established a computational measure of perceptual importance. In this paper we present a visual-saliency-based operator to enhance selected regions of a volume. We show how we use such an operator on a user-...
Real-time directional stylization of images and videos
This paper describes a real-time non-photorealistic rendering system that automatically produces stylistic effects from photos and videos. The algorithm includes the capture of salient shapes in the image using a smooth direction field and the ...
Comments