Skip to main content
Log in

Seam warping: a new approach for image retargeting for small displays

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Image retargeting is a technique to adapt an image to display on devices with different sizes and aspect ratios. When mobile devices with small displays are increasingly popular, it becomes important to retarget images that are intended for regular monitors to smaller mobile screens. Existing methods that retarget images to smaller devices, such as seam carving and warping, have some limitations: seam caving method may damage the integrity of the image, and warping method could fail when focus detection algorithm is not good. The target images obtained through the above algorithms often have obvious distortions. In this paper, we propose a new image retargeting method that combines seam caving and warping. This method preserves the advantage of warping in keeping focused areas of the image without discarding unfocused contents, and at the same time, uses seam finding scheme to address the problem of focus detection. The results of our experiment study on user preferences of retargeted images show that our approach is successful for image retargeting.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  • Achanta R, Hemami S, Estrada F, Susstrunk S (2009) Frequency-tuned salient region detection. In: Proceedings of the 2009 IEEE conference on computer vision and pattern recognition. IEEE, Miami, pp 1597–1604

  • Achanta R, Susstrunk S (2009) Saliency detection for content-aware image resizing. In: IEEE Intl. Conf. on Image Processing, pp 1005–1008

  • Avidan S, Shamir A (2007) Seam carving for content-aware image resizing. ACM Trans Graph 26:10–20

    Article  Google Scholar 

  • Barnes C, Shechtman E, Finkelstein A, Patchmatch GD (2009) A randomized correspondence algorithm for structural image editing. In ACM Trans. on graphics (Proc. of SIGGRAPH), vol 28, pp 341–352

  • Brand M (2009) Image and video retargeting by darting. In: International conference on image analysis and recognition, pp 33–42

  • Chen L-Q, Xie X, Fan X, Ma W-Y, Zhang H-J (2003) A visual attention model for adapting images on small displays. In: ACM Multimedia Systems Journal

  • Cho S, Choi H, Matsushita Y, Lee S (2009) Image retargeting using importance diffusion. In: International conference on image processing, pp 977–980

  • Ciocca G, Cusano C, Gasparini F, Schettini R (2007) Self-adaptive image cropping for small displays. IEEE Trans Consum Electron 53:1622–1627

    Article  Google Scholar 

  • Gao DS, Han SY, Vasconcelos N (2009) Discriminant saliency the detection of suspicious coincidences, and applications to visual recognition. IEEE Trans Pattern Anal Mach Intell 31:989–1005

    Article  Google Scholar 

  • Goferman S, Zelnik M, Tal L (2012) Context-aware saliency detection. IEEE Trans Pattern Anal Mach Intell 34:1915–1926

    Article  Google Scholar 

  • Guo Y, Liu F, Shi J, Zhou ZH (2009) Image retargeting using mesh parametrization. IEEE Trans Multimed 11:856–867

    Article  Google Scholar 

  • Itti L, Koch C, Niebur E (1998) A model of saliency-based vi-sual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20:1254–1470

    Article  Google Scholar 

  • Karczmarek P, Pedrycz W, Reformat M, Akhoundi E (2014) A study in facial regions saliency: a fuzzy measure approach. Soft Comput 18:379–391

    Article  Google Scholar 

  • Kim JS, Kim JH, Kim CS (2009) Adaptive image and video retargeting technique based on fourier analysis. In: IEEE Conference on computer vision and pattern recognition, pp 1730–1737

  • Lin SS, Yeh IC, Lin CH, Lee TY (2013) Patch-based image warping for content-aware retargeting. In: ACM Trans. on graphics (Proc. of SIGGRAPH), vol 15, pp 359–368

  • Liu F, Gleicher M (2005) Automatic image retargeting with fisheye view warping. In: ACM Symposium on user interface software and technology, pp 153–162

  • Luo SQ, Zhang JP, Zhang Q, Yuan XR (2012) Multi-operator image retargeting with automatic integration of direct and indirect seam carving. Image Vis Comput 30:655–667

    Article  Google Scholar 

  • Nishiyama M, Okabe T, Sato Y, Sato I (2009) Sensation-based photo cropping. In: ACM International conference on multimedia, pp 669–672

  • Pritch Y, Kav-Venaki E, Peleg S (2009) Shift-map image editing. In: IEEE International conference on computer vision, vol 30, pp 151–158

  • Ren T, Liu Y, Wu G (2009) Image retargeting based on global energy optimization. In: IEEE International conference on multimedia and expo, pp 406–409

  • Rubinstein M, Gutierrez D, Sorkine O, Shamir A (2010) A comparative study of image retargeting. ACM Trans Graph 29:81–95

    Article  Google Scholar 

  • Rubinstein M, Shamir A (2009) Multi-operator media retargeting. In: ACM Trans. on Graphics (Proc. of SIGGRAPH), vol 28, pp 1–11

  • Rubinstein M, Shamir A (2008) Improved seam carving for video retargeting. ACM Trans Graph. 27:1–9

    Article  Google Scholar 

  • Setlur V, Takagi S, Raskar R, Gleicher M, Gooch B (2005) Automatic image retargeting. In: ACM International conference on mobile and ubiquitous multimedia, pp 59–68

  • Srivastava V, Tripathi BK, Pathak VK (2014) Biometric recognition by hybridization of evolutionary fuzzy clustering with functional neural networks. J Ambient Intell Humaniz Comput 5:525–537

    Article  Google Scholar 

  • TalebiFard P, Leun VCM (2014) Context-aware dissemination of information and services in heterogeneous network environments. J Ambient Intell Humaniz Comput 5:775–787

    Article  Google Scholar 

  • Walther D, Koch C (2007) Modeling attention to salient proto-objects. Neural Networks 19:1395–1407

    Article  MATH  Google Scholar 

  • Wang YS, Tai CL, Sorkine O, Lee TY (2008) Optimized scale-and-stretch for image resizing. ACM Trans Graph 27:32–39

    Google Scholar 

  • Wang D, Li GQ, Jia WJ, Luo XN (2011) Saliency-driven scaling optimization for image retargeting. Vis Comput 27:853–860

    Article  Google Scholar 

  • Wei H, Lang B, Zuo QS (2014) An image representation of infrastructure based on non-classical receptive field. Soft Comput 18:109–123

    Article  Google Scholar 

  • Wolf L, Guttmann M, Cohen-Or D (2007) Non-homogeneous content-driven video-retargeting. In: IEEE International conference on computer vision, pp 1–8

  • Yoo S, Kim W, Kim C (2014) Saliency combined particle filtering for aircraft tracking. J Signal Process Syst 16:19–31

    Article  Google Scholar 

  • Zhang GX, Cheng SM, Hu MM, Martin RR (2009) A shape-preserving approach to image resizing. In: Computer Graphics Forum, vol 28, pp 1897–1906

  • Zhang LX, Song HZ, Ou ZM, Liang HK, Xiao L (2010) Fisheye transformation for image retargeting. In: ICIA2010, pp 1840–1845

  • Zhang LX, Song HZ, Ou ZM (2013) Image retargeting with multi-focus fisheye transformation. Vis. Comput 29:407–420

    Article  Google Scholar 

Download references

Acknowledgments

This work was jointly supported by Natural Science Foundation of Guangdong Province of China (#2014A030313454), and the National Spark Program of China (#2013GA780033).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kangshun Li.

Additional information

Communicated by V. Loia.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, L., Li, K., Ou, Z. et al. Seam warping: a new approach for image retargeting for small displays. Soft Comput 21, 447–457 (2017). https://doi.org/10.1007/s00500-015-1795-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-015-1795-1

Keywords

Navigation