Skip to main content
SpringerLink
Log in

Structure preservation of image using an efficient content-aware image retargeting technique

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

The presence of a wide range of high- and low-resolution devices renders the images to experience changes in respect to aspect ratio and size for better adaptability. This paper proposes a novel and effective technique that vanquishes the problems encountered in the conventional seam carving method. To achieve minimum distortion in salient objects of the image, the proposed technique restricts intersection or overlapping of multiple seams in the horizontal and vertical direction and bypasses them to the neighboring low energy pixel. The proposed technique hinders the pixel selection from a single row or column beyond the defined threshold so as to save the image information and reduce distortion at a single location. To justify the effectiveness of the proposed technique, results have been presented in comparison with the five state-of-the-art image retargeting techniques. Compared with the conventional techniques, this technique shows remarkable results in terms of low distortion percentage. The proposed technique also produces excellent results for shrinkage and enlargement of a single image multiple times.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Simakov, D., Caspi, Y., Shechtman, E., Irani, M.: Summarizing visual data using bidirectional similarity. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)

  2. Rubinstein, M., Gutierrez, D., Sorkine, O. and Shamir, A.: A comparative study of image retargeting. In: ACM Transactions on Graphics (TOG), vol. 29(6), p. 160 (2010)

  3. Liu, F., Gleicher, M.: Automatic image retargeting with fisheye-view warping. In: Proceedings of the 18th ACM Symposium on User Interface Software and Technology, Seattle, USA, pp. 153–162 (2005)

  4. Suh, B., Ling, H., Bederson, B.B., et al.: ‘Automatic thumbnail cropping and its effectiveness’. Proc. 16th ACM Symp. on User Interface Software and Technology, Vancouver, Canada, pp 95-104 (2003)

  5. Santella, A., Agrawala, M., DeCarlo, D., Salesin, D. and Cohen, M.: Gaze-based interaction for semi-automatic photo cropping. In Proceedings of the SIGCHI conference on Human Factors in computing systems, pp 771-780 (2006)

  6. Ciocca, G., Cusano, C., Gasparini, F., Schettini, R.: Self-adaptive image cropping for small displays. IEEE Trans. Consum. Electron. 53(4), 1622–1627 (2007)

    Article  Google Scholar 

  7. Wolf, L., Guttmann, M., Cohen-Or, D.: Non-homogeneous content—driven video—retargeting. In: IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil, pp. 1–6 (2007)

  8. Zhang, Y.F., Hu, S.M., Martin, R.R.: Shrinkability maps for content-aware video resizing. In: Computer Graphics Forum, vol. 27(7), pp. 1797–1804, Blackwell Publishing Ltd, Oxford (2008)

  9. Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. ACM Trans. Graph. (TOG) 28(3), 23:1–23:11 (2009)

    Article  Google Scholar 

  10. Dong, W., Zhou, N., Paul, J.C., et al.: Optimized image resizing using seam carving and scaling. ACM Trans. Graph. (TOG) 28(5), 125:1–125:10 (2009)

    Article  Google Scholar 

  11. Wang, Y.S., Tai, C.L., Sorkine, O., et al.: Optimized scale—and—stretch for image resizing. ACM Trans. Graph. (TOG) 27(5), 118:1–118:8 (2008)

    Article  Google Scholar 

  12. Cho, T.S., Butman, M., Avidan, S., Freeman, W.T.: The patch transform and its applications to image editing. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)

  13. Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: PatchMatch: a randomized correspondence algorithm for structural image editing. In: ACM Transactions on Graphics (ToG), vol. 28(3), p. 24 (2009)

  14. Pritch, Y., Kav-Venaki, E., Peleg, S.: Shift-map image editing. In: IEEE 12th International Conference on Computer Vision, Kyoto, Japan, pp. 151–158 (2009)

  15. Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. ACM Trans. Graph. (TOG) 26(3), 10:1–10:10 (2007)

    Article  Google Scholar 

  16. Goferman, S., Zelnik-Manor, L., Tal, A.: Context-aware saliency detection. IEEE Trans. Pattern Anal. Mach. Intell. 34(10), 1915–1926 (2011)

    Article  Google Scholar 

  17. Liu, Z., Yan, H., Shen, L., et al.: Adaptive image retargeting using saliency-based continuous seam carving. Opt. Eng. 49(1), 1–10 (2010)

    Article  Google Scholar 

  18. Pavić, D., Kobbelt, L.: Two-colored pixels. Comput. Graph. Forum 29(2), 743–752 (2010)

    Article  Google Scholar 

  19. Cho, D., Park, J., Oh, T.H., Tai, Y.W., So Kweon, I.: Weakly-and self-supervised learning for content-aware deep image retargeting. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 4558–4567 (2017)

  20. Zhou, Y., Zhang, L., Zhang, C., et al.: Perceptually aware image retargeting for mobile devices. IEEE Trans. Image Process. 27(5), 2301–2313 (2017)

    Article  MathSciNet  Google Scholar 

  21. Kang, L.W., Weng, M.F., Jheng, C.L., Tseng, C.Y., Ramesh, S.K., Gureja, A., Hsu, H.C., Yeh, C.H.: Content-aware image retargeting for image display on foldable mobile devices. Procedia Comput. Sci. 56, 104–110 (2015)

    Article  Google Scholar 

  22. Qi, S., Chi, Y.T.J., Peter, A.M., et al.: CASAIR: content and shape-aware image retargeting and its applications. IEEE Trans. Image Process. 25(5), 2222–2232 (2016)

    Article  MathSciNet  Google Scholar 

  23. Zhang, Y., Lin, W., Li, Q., Cheng, W., Zhang, X.: Multiple-level feature-based measure for retargeted image quality. IEEE Trans. Image Process. 27(1), 451–463 (2017)

    Article  MathSciNet  Google Scholar 

  24. Liang, Y., Liu, Y.J., Gutierrez, D.: Objective quality prediction of image retargeting algorithms. IEEE Trans. Vis. Comput. Graph. 23(2), 1099–1110 (2016)

    Article  Google Scholar 

  25. Zhang, L., Song, M., Zhao, Q., Liu, X., Bu, J., Chen, C.: Probabilistic graphlet transfer for photo cropping. IEEE Trans. Image Process. 22(2), 802–815 (2012)

    Article  MathSciNet  Google Scholar 

  26. Shen, J., Wang, D., Li, X.: Depth-aware image seam carving. IEEE Trans. Cybern. 43(5), 1453–1461 (2013)

    Article  Google Scholar 

  27. Li, K., Yan, B., Li, J., Majumder, A.: Seam carving based aesthetics enhancement for photos. Signal Process. Image Commun. 39, 509–516 (2015)

    Article  Google Scholar 

  28. Patel, D., Shanmuganathan, R.: Accelerated seam carving for image retargeting. IET Image Process. 13(6), 885–895 (2019)

    Article  Google Scholar 

  29. Chang, H.H., Shih, T.K., Chang, C.K., et al.: CMAIR: content and mask-aware image retargeting. Multimedia Tools Appl. 78(15), 1–28 (2019)

    Article  Google Scholar 

  30. Shao, F., Fu, Z., Jiang, Q., et al.: Transformation-aware similarity measurement for image retargeting quality assessment via bidirectional rewarping. In: IEEE Transactions on Systems, Man, and Cybernetics: Systems, pp. 1–15 (2019)

  31. Arar, M., Danon, D., Cohen-Or, D. et al.: Image resizing by reconstruction from deep features. Comput. Vis. Pattern Recogn. pp. 1–13. arXiv:1904.08475 (2019)

  32. Yan, B., Bare, B., Li, K., et al.: Learning quality assessment of retargeted images. Signal Process. Image Commun. 56, 12–19 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of CSE, Uttarakhand Technical University, Dehradun, India

    Ankit Garg

  2. GB Pant Engineering College, Pauri, India

    Ashish Negi

  3. Amity School of Engineering and Technology, Amity University Haryana, Gurgaon, India

    Prakhar Jindal

Authors
  1. Ankit Garg
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ashish Negi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Prakhar Jindal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ankit Garg.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Garg, A., Negi, A. & Jindal, P. Structure preservation of image using an efficient content-aware image retargeting technique. SIViP 15, 185–193 (2021). https://doi.org/10.1007/s11760-020-01736-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-020-01736-x

Keywords

Search

Navigation