Skip to main content
SpringerLink
Log in

Optimal multiple-seams search for image resizing with smoothness and shape prior

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Content-aware image resizing is of increasing relevance to allow high-quality image and video to be displayed on devices with different resolution. We present a novel method to find multiple seams simultaneously with global optimality for image resizing, incorporating both region smoothness and seam shape prior using a 3-D graph-theoretic approach. The globally optimal seams can be simultaneously achieved by solving a maximum flow problem based on an arc-weighted graph representation. Representing the resizing problem in an arc-weighted graph, we can incorporate a wide spectrum of constraints into the formulation, thus improving resizing results. By removing or inserting those multiple seams, the goal of content-aware image resizing is achieved. Due to simultaneous detection of multiple seams, our algorithm exhibits several good features: the ability to handle both crossing and non-crossing-seam cases, the ability to incorporate various feasible geometry constraints, and the ability to incorporate the seams importance, region smoothness and shape prior information. The proposed method was implemented and experimented on a variety of image data and compared with the state of the art in image resizing.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Achanta, R., Hemami, S., Estrada, F., Strunk, S.: Frequency-tuned salient region detection. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) (2009)

  2. Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. ACM Trans. Graph. 26(3), 10:1–10:9 (2007). Proceedings SIGGRAPH 2007

    Article  Google Scholar 

  3. Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Mach. Intell. 26, 359–374 (2004)

    Article  Google Scholar 

  4. Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23(11), 1222–1239 (2001). doi:10.1109/34.969114

    Article  Google Scholar 

  5. Gal, R., Sorkine, O., Cohen-Or, D.: Feature-aware texturing. In: Proceedings of Eurographics Symposium on Rendering, pp. 297–303 (2006)

  6. Han, D., Wu, X., Sonka, M.: Optimal multiple surfaces searching for video/image resizing—a graph-theoretic approach. In: ICCV’09. Kyoto (2009)

  7. Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998). doi:10.1109/34.730558

    Article  Google Scholar 

  8. Kolmogorov, V., Zabih, R.: What energy functions can be minimized via graph cuts? IEEE Trans. Pattern Anal. Mach. Intell. 26(2), 147–159 (2004) doi:10.1109/TPAMI.2004.1262177

    Article  Google Scholar 

  9. Kopf, S., Kiess, J., Lemelson, H., Effelsberg, W.: Fscav: fast seam carving for size adaptation of videos. In: MM’09: Proceedings of the Seventeen ACM International Conference on Multimedia, pp. 321–330. ACM, New York (2009). doi:10.1145/1631272.1631317

    Chapter  Google Scholar 

  10. Li, K., Wu, X., Chen, D.Z., Sonka, M.: Optimal surface segmentation in volumetric images-a graph-theoretic approach. IEEE Trans. Pattern Anal. Mach. Intell. 28(1), 119–134 (2006)

    Article  Google Scholar 

  11. Li, Z., Ishwar, P., Konrad, J.: Video condensation by ribbon carving. IEEE Trans. Image Process. 18(11), 2572–2583 (2009). doi:10.1109/TIP.2009.2026677

    Article  Google Scholar 

  12. Liu, F., Gleicher, M.: Video retargeting: automating pan and scan. In: MULTIMEDIA’06: Proceedings of the 14th Annual ACM International Conference on Multimedia, pp. 241–250. ACM, New York (2006). doi:10.1145/1180639.1180702

    Chapter  Google Scholar 

  13. Pritch, Y., Kav-Venaki, E., Peleg, S.: Shift-map image editing. In: ICCV’09. Kyoto (2009)

  14. Rubinstein, M., Shamir, A., Avidan, S.: Improved seam carving for video retargeting. ACM Trans. Graph. 27(3), 16:1–16:9 (2008). Proceedings SIGGRAPH 2008

    Article  Google Scholar 

  15. Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. In: SIGGRAPH’09: ACM SIGGRAPH 2009 Papers, pp. 1–11. ACM, New York (2009). doi:10.1145/1576246.1531329

    Chapter  Google Scholar 

  16. Setlur, V., Takagi, S., Raskar, R., Gleicher, M., Gooch, B.: Automatic image retargeting. In: MUM’05: Proceedings of the 4th International Conference on Mobile and Ubiquitous Multimedia, pp. 59–68. ACM, New York (2005). doi:10.1145/1149488.1149499

    Chapter  Google Scholar 

  17. Shamir, A., Avidan, S.: Seam carving for media retargeting. Commun. ACM 52(1), 77–85 (2009). doi:10.1145/1435417.1435437

    Article  Google Scholar 

  18. Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004). doi:10.1023/B:VISI.0000013087.49260.fb

    Article  Google Scholar 

  19. Wang, Y.S., Tai, C.L., Sorkine, O., Lee, T.Y.: Optimized scale-and-stretch for image resizing. ACM Trans. Graph. 27(5), 1–8 (2008). doi:10.1145/1409060.1409071

    Article  Google Scholar 

  20. Wolf, L., Guttmann, M., Cohen-Or, D.: Non-homogeneous content-driven video-retargeting. In: Proceedings of the Eleventh IEEE International Conference on Computer Vision (ICCV-07) (2007)

  21. Zhang, Y.F., Hu, S.M., Martin, R.R.: Shrinkability maps for content-aware video resizing. Comput. Graph. Forum 27(7), 1797–1804 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Radiation Oncology, The University of Iowa, Iowa City, IA, USA

    Dongfeng Han, Milan Sonka, John Bayouth & Xiaodong Wu

  2. Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, IA, USA

    Milan Sonka & Xiaodong Wu

Authors
  1. Dongfeng Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Milan Sonka
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. John Bayouth
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiaodong Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaodong Wu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Han, D., Sonka, M., Bayouth, J. et al. Optimal multiple-seams search for image resizing with smoothness and shape prior. Vis Comput 26, 749–759 (2010). https://doi.org/10.1007/s00371-010-0480-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-010-0480-8

Keywords

Search

Navigation