Skip to main content

Advertisement

SpringerLink
Log in

Optimized image resizing using flow-guided seam carving and an interactive genetic algorithm

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we introduce a novel method for content-aware image resizing based on flow-guided seam carving. It extends the existing seam carving framework by replacing the conventional energy field with a “structure-aware” energy field that takes into account the feature orientations in the image. Guided by this new energy field, our approach excels in preserving (i.e., avoiding the distortion of) important structures in the image, such as shape boundaries. We also present a simple user interface to further optimize the resizing result based on the genetic selection process among multiple resizing operators such as scaling, cropping, and flow-guided seam carving. We show that such simple user interaction, coupled with the genetic algorithm, dramatically increases the chances of producing the user-desired outcome.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Anthony S, Maneesh A, Doug D, David S, Michael C (2006) Gaze-based interaction for semi-automatic photo cropping. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 771–780

  2. Avidan S, Shamir A (2007) Seam carving for content-aware image resizing. In: Proceedings of ACM SIGGRAPH ’07, p 10

  3. Chen L, Xie X, Fan X, Ma W, Zhang H, Zhou H (2003) A visual attention model for adapting images on small displays. ACM Multimedia Syst 9(4):353–364

    Article  Google Scholar 

  4. Dong W, Zhou N, Paul JC Zhang X (2009) Optimized image resizing using seam carving and scaling. ACM Trans Graph 28(5):1–10

    Article  Google Scholar 

  5. FLICKR (2008) Share your photos. Watch the world. http://flickr.com

  6. Hao L, Xing X, Wei-Ying M, Hong-Jiang Z (2003) Automatic browsing of large pictures on mobile devices. In: Proceedings of the 11th ACM international conference on multimedia, pp 148–155

  7. Hays J, Essa I (2004) Image and video-based painterly animation. In: Proc. non-photorealistic animation and rendering, pp 113–120

  8. Interactive Evolution (1998) An introduction to genetic algorithms. MIT Press

  9. Jordan PW, Weerdmeester B, Thomas A, Mclelland IL (1996) Sus: a quick and dirty usability scale. In: Usability evaluation in industry, pp 189–194

  10. Kang H, LEE S, Chui C (2007) Coherent line drawing. In: Proceedings of ACM symposium on non-photorealistic animation and rendering, pp 43–50

  11. Kang H, Lee S, Chui C (2009) Flow-based image abstraction. IEEE Trans Vis Comput Graph 15(1):62–76

    Article  Google Scholar 

  12. Kim JS, Jeong SG, Juu YH, Kim CS (2011) Content-aware image and video resizing based on frequency domain analysis. IEEE Consum Electron 57(2):615–622

    Article  Google Scholar 

  13. Litwinowicz P (1997) Processing images and video for an impressionist effect. In: Proc. ACM SIGGRAPH, pp 407–414

  14. Paris S, Briceño H, Sillion F (2004) Capture of hair geometry from multiple images. ACM Trans Graph 23(3):712–719

    Article  Google Scholar 

  15. Perona P (1998) Orientation diffusions. IEEE Trans Image Process 7(3):457–467

    Article  Google Scholar 

  16. Pham TQ (2006) Spatiotonal adaptivity in super-resolution of undersampled image sequences. Delft University of Technology

  17. Rubinstein M, Shamir A, Avidan S (2008) Improved seam carving for video retargeting. In: Proceedings of ACM SIGGRAPH ’08, pp 1–9

  18. Rubinstein M, Shamir A, Avidan S (2009) Multi-operator media retargeting. ACM Trans Graph 28(3):1–11

    Article  Google Scholar 

  19. Tschumperlé D, Deriche R (2002) Orthonormal vector sets regularization with PDE’s and applications. Int J Comput Vis 50(3):237–252

    Article  MATH  Google Scholar 

  20. Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154

    Article  Google Scholar 

  21. Wang Y-S, Tai C-L, Sorkine O, Lee T-Y (2008) Optimized scale-and-stretch for image resizing. In: Proceedings of ACM SIGGRAPH Asia ’08, pp 1–8

  22. Weickert J (1996) Anisotropic diffusion in image processing. Dept of Mathematics, University of Kaiserslautern, Germany

  23. Wolf L, Guttmann M, Cohen-Or D (2007) Non-homogeneous content-driven video-retargeting. In: Proceedings of IEEE ICCV, pp 1–6

  24. Wu H, Wang YS, Feng KC, Wong TT, Lee TY, Heng PA (2010) Resizing by symmetry-summarization. ACM Trans Graph 29(6)159:1–9

    Article  Google Scholar 

  25. Xu C, Prince JL (1998) Snakes, shapes, and gradient vector flow. IEEE Trans Image Process 7(3):359–369

    Article  MATH  MathSciNet  Google Scholar 

  26. Yoon JC, Lee IK, Kang H (2012) Video painting based on a stabilized time-varying flow field. IEEE Trans Vis Comput Graph 18(1):58–67

    Article  Google Scholar 

Download references

Acknowledgement

This study was supported by 2011 Research Grant form Kangwon National University and the National Research Foundation of Korea (NRF) grant funded by the Korea government (MEST) (No. 2011-0028568).

Author information

Authors and Affiliations

  1. Department of Broadcasting Visual Arts Technology & Entertainment, Kangwon National University, Samcheok, Korea

    Jong-Chul Yoon

  2. Department of Computer Science, Yonsei University, Seoul, Korea

    Sun-Young Lee & In-Kwon Lee

  3. Department of Computer Science, University of Missouri, St. Louis, MO, USA

    Henry Kang

Authors
  1. Jong-Chul Yoon
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sun-Young Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. In-Kwon Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Henry Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jong-Chul Yoon.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yoon, JC., Lee, SY., Lee, IK. et al. Optimized image resizing using flow-guided seam carving and an interactive genetic algorithm. Multimed Tools Appl 71, 1013–1031 (2014). https://doi.org/10.1007/s11042-012-1242-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-012-1242-6

Keywords

Search

Navigation