Skip to main content
SpringerLink
Log in

Nonhomogeneous scaling optimization for realtime image resizing

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

We present a novel approach for interactive content-aware image resizing. The resizing is performed on warping a triangular mesh over the image, which captures the image saliency information as well as the underlying image features. The warped triangular mesh and the horizontal and vertical scales of all triangles are simultaneously obtained by a quadratic optimization which can be achieved by solving a sparse linear system. Our approach can preserve the shapes of curved features in the resized images. The resizing operation can be performed in an interactive rate which makes the proposed approach practically useful for realtime image resizing. To guarantee a foldover free resizing result, we modify the optimization to a standard quadratic programming. A number of experimental results have shown that our approach has obtained pleasing results and outperforms the previous approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. ACM Trans. Graph. 26(3), 267–276 (2007) (Proc. SIGGRAPH)

    Article  Google Scholar 

  2. Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.: PatchMatch: a randomized correspondence algorithm for structural image editing. ACM Trans. Graph. 28(3) (2009) (Proc. SIGGRAPH)

  3. Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)

    Article  Google Scholar 

  4. Dong, W., Zhou, N., Paul, J.-C., Zhang, X.: Optimized image resizing using seam carving and scaling. ACM Trans. Graph. 28(5) (2009) (Proc. SIGGRAPH Asia)

  5. Fernandes, L., Oliveira, M.: Real-time line detection through improved hough transform voting scheme. Pattern Recogn. 41(1), 299–314 (2008)

    Article  MATH  Google Scholar 

  6. Grant, M., Boyd, S., Ye, Y.: CVX: Matlab software for disciplined convex programming. http://www.stanford.edu/~boyd/cvx

  7. Guo, Y., Liu, F., Shi, J., Zhou, Z., Gleicher, M.: Image retargeting using mesh parametrization. IEEE Trans. Multimed. 11(5), 856–867 (2009)

    Article  Google Scholar 

  8. Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Proc. Neural Information Processing Systems (NIPS), vol. 19, pp. 545–552 (2006)

  9. Intel math kernel library (2010). http://developer.intel.com

  10. Karni, Z., Freedman, D., Gotsman, C.: Energy-based content-aware image deformation. Comput. Graph. Forum 28(5), 1257–1268 (2009) (Proc. Symposium on Geometry Processing)

    Article  Google Scholar 

  11. Kim, H., Kumara, S.: New quality metrics for digital image resizing. Proc. SPIE 6696, 669608 (2007)

    Article  Google Scholar 

  12. Liu, L., Zhang, L., Xu, Y., Gotsman, C., Gortler, S.J.: A local/global approach to mesh parameterization. Comput. Graph. Forum 27(5), 1495–1504 (2008) (Proc. Symposium on Geometry Processing)

    Article  Google Scholar 

  13. Pritch, Y., Kav-Venaki, E., Peleg, S.: Shift-map image editing. In: Proc. of ICCV (2009)

  14. Reibman, A., Suthaharan, S.: A no-reference spatial aliasing measure for digital image resizing. In: Proc. ICIP, pp. 1184–1187 (2008)

  15. Rubinstein, M., Shamir, A., Avidan, S.: Improved seam carving for video retargeting. ACM Trans. Graph. 27(3), 1–9 (2008) (Proc. SIGGRAPH)

    Article  Google Scholar 

  16. Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. ACM Trans. Graph. 28(3), 1–11 (2009) (Proc. SIGGRAPH)

    Article  Google Scholar 

  17. Sederberg, T.W., Gao, P., Wang, G., Mu, H.: 2D shape blending: an intrinsic solution to the vertex path problem. In: Proc. SIGGRAPH, pp. 15–18 (1993)

  18. Seidel, R.: Constrained Delaunay triangulations and Voronoi diagrams with obstacles. Technical Report, Inst. for Information Processing, Graz, Austria (1988)

  19. Shamir, A., Sorkine, O.: Visual media retargeting. In: SIGGRAPH Asia Course (2009)

  20. Sorkine, O., Lipman, Y., Cohen-Or, D., Alexa, M., Rossl, C., Seidel, H.-P.: Laplacian surface editing. In: Proc. Symposium on Geometry Processing, pp. 179–188 (2004)

  21. Wang, Y.-S., Tai, C.L., Sorkine, O., Lee, T.-Y.: Optimized scale-and-stretch for image resizing. ACM Trans. Graph. 27(5), 1–8 (2008) (Proc. SIGGRAPH Asia)

    Article  Google Scholar 

  22. Wolf, L., Guttmann, M., Cohen-Or, D.: Nonhomogeneous content-driven video-retargeting. In: Proc. ICCV, pp. 1–6 (2007)

  23. Zhang, L., Liu, L., Gotsman, C., Gortler, S.J.: An as-rigid-as-possible approach to sensor network localization. ACM Trans. Sens. Netw. 6(4), 1–12 (2010)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics, Zhejiang University, Hangzhou, China

    Yong Jin, Ligang Liu & Qingbiao Wu

Authors
  1. Yong Jin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ligang Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Qingbiao Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ligang Liu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jin, Y., Liu, L. & Wu, Q. Nonhomogeneous scaling optimization for realtime image resizing. Vis Comput 26, 769–778 (2010). https://doi.org/10.1007/s00371-010-0472-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-010-0472-8

Keywords

Search

Navigation