Skip to main content

Advertisement

SpringerLink
Log in

Saliency-driven scaling optimization for image retargeting

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

This paper proposes a saliency-weighted scaling factor energy for image retargeting. Considering that salient objects should be scaled with a larger scaling factor with respect to nonsalient regions, we define a quadric energy to establish the relation between the scaling factor of a local region and its saliency. The quadric energy is the weighted sum of the square of scaling factors, where the weight of each scaling factor is inversely proportional to its corresponding saliency. Furthermore, a triangle similarity quadric energy is introduced to prevent salient regions from distortion. Compared to previous methods, our approach not only preserves the shapes of salient objects and the integrity of the whole image well, but also reserves more resolution to salient objects in target image even when the aspect ratio is unchanged.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Setlur, V., Lechner, T., Nienhaus, M., Gooch, M.: Retargeting images and video for preserving information saliency. Computer Graphics and Applications 27(5), 80–88 (2007)

    Article  Google Scholar 

  2. Shamir, A., Avidan, S.: Seam carving for media retargeting. Communication of the ACM 52(1), 77–85 (2009)

    Article  Google Scholar 

  3. Liu, L., Chen, R., Wolf, L., Cohen-or, D.: Optimizing photo composition. Computer Graphics Forum (Proceedings of Eurographics) 29(2), 469–478 (2010)

    Article  Google Scholar 

  4. Lam, H., Baudisch, P.: Summary thumbnails: readable overviews for small screen web browsers. In: CHI 2005, pp. 681–690

  5. Avidan, S., Shamir, A.: Seam carving for content-aware image retargeting. ACM Trans. Graph. 26(3), 267–276 (2007)

    Article  Google Scholar 

  6. Achanta, R., Susstrunk, S.: Saliency detection for content-aware image resizing. In: ICIP 2009, pp. 1001–1004

  7. Stephan, K., Johannes, K., Hendrik, L., Wolfgang, E.: FSCAV—Fast seam carving for size adaptation of videos. In: ACM Multimedia 2009, pp. 321–330

  8. Li, Z., Ishwar, P., Konrad, J.: Video condensation by ribbon carving. IEEE Transactions on Image Processing 18(11), 2572–2583 (2009)

    Article  MathSciNet  Google Scholar 

  9. Gal, R., Sorkine, O., Cohen-or, D.: Feature aware texturing. In: Proceedings of Eurographics Symposium on Rendering, pp. 297–303. (2006)

    Google Scholar 

  10. Wang, Y., Tai, C., Sorkine, O., Lee, T.: Optimized scale and stretch for image resizing. ACM Trans. Graph. 27(5), 1–8 (2008)

    Article  Google Scholar 

  11. Zhang, G., Cheng, M. Hu S., Martin, R.: A shape-preserving approach to image resizing. Computer Graphics Forum 28(7), 1897–1906 (2009)

    Article  Google Scholar 

  12. Karni, Z., Freedman, D., Gotsman, C.: Energy-based image deformation. Computer Graphics Forum 28(5), 1257–1268 (2009)

    Article  Google Scholar 

  13. Guo, Y., Liu, F., Shi, J., Zhou, Z., Gleicher, M.: Image retargeting using mesh parametrization. IEEE Trans. Multimedia 11(4), 856–867 (2009)

    Google Scholar 

  14. Ren, T., Liu, Y., Wu, G.: Image retargeting using multi-map constrained region warping. In: Proceedings of the Seventeen ACM International Conference on Multimedia, pp. 853–856. (2009)

    Chapter  Google Scholar 

  15. Pavi, D., Kobbelt, L.: Two-colored pixels. Computer Graphics Forum (Proceedings of Eurographics) 29(2), 743–752 (2010)

    Article  Google Scholar 

  16. Jin, Y., Liu, L., Wu, Q.: Nonhomogeneous scaling optimization for realtime image resizing. The Visual Computer 26(6), 769–778 (2010)

    Article  Google Scholar 

  17. Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. ACM Trans. Graph. 28(3), 1–11 (2009). 23

    Article  Google Scholar 

  18. Dong, W., Paul, J.: Adaptive content-aware image resizing. Computer Graphics Forum 28(3), 1–10 (2009)

    Google Scholar 

  19. Dong, W., Zhou, N., Paul, J., Zhang, X.: Optimized image resizing using seam carving and scaling. ACM Trans. Graph. 28(5), 1–10 (2009). 125

    Article  Google Scholar 

  20. Rubinstein, M., Shamir, A., Avidan, S.: Improved seam carving for video retargeting. ACM Trans. Graph. 27(3), 1–9 (2008)

    Article  Google Scholar 

  21. Philipp, K., Manuel, L., Alexanger, H.: A system for retargeting of streaming video. ACM Trans. Graph. 28(5), 126:1–10 (2009)

    Google Scholar 

  22. Wang, Y., Lin, H., Sorkine, O., Lee, T.: Motion-based video retargeting with optimized crop-and-warp. ACM Trans. Graph. 29(4), 90:1–9 (2010)

    Google Scholar 

  23. Shamir, A., Sorkine, O.: Visual media retargeting. In: Proceedings of ACM SIGGRAPH Asia Course(2009)

    Google Scholar 

  24. Vaquero, D., Turk, M., Pulli, K., Tico, M., Gelfand, N.: A survey of image retargeting techniques. Applications of Digital Image. Processing XXXIII, Proc. SPIE (2010)

  25. Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. Advances in Neural Information Processing Systems 19, 545–552 (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. South China University of Technology, Guangzhou, China

    Guiqing Li

  2. City University of Hong Kong, Hong Kong, China

    Dong Wang & Weijia Jia

  3. Sun Yat-Sen University, Guangzhou, China

    Xiaonan Luo

Authors
  1. Dong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guiqing Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Weijia Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiaonan Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Weijia Jia.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wang, D., Li, G., Jia, W. et al. Saliency-driven scaling optimization for image retargeting. Vis Comput 27, 853–860 (2011). https://doi.org/10.1007/s00371-011-0559-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-011-0559-x

Keywords

Search

Navigation