Abstract
Image retargeting algorithms are primarily used for transferring and displaying images on devices with varying aspect ratios and resolutions. High-performance image retargeting algorithms can prevent issues such as distortion, deformation, and artifacts during the image retargeting process, resulting in retargeted images that maintain visual quality comparable to the original image. The key to this type of algorithm is to find a suitable energy function to estimate the importance of each pixel in the image. This paper proposes a new energy function, which combines the saliency map based on U2Net and the adaptive Canny edge map to optimize the gradient-based image importance map. Furthermore, threshold values are assigned to the two importance maps based on the proportion of salient objects in the overall image. This approach ensures that the target image retains the salient information and structural details of the original image while removing the minimum energy seams, thus avoiding image artifacts and distortions. To prevent excessive seam carving from distorting the image, we protect the main structure of the image by combining the seam carving and scaling algorithms and adaptively switching between the two. The experimental results show that, compared with the existing techniques, our method can generate more visually effective target images, and has achieved better performance on SIFTflow and SSMI evaluation indicators.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Disclosure of Interests
The authors have no competing interests.
References
Thevenaz, P., Blu, T., Unser, M.: Interpolation revisited [medical images application]. IEEE Trans. Med. Imaging 19(7), 739–758 (2000). https://doi.org/10.1109/42.875199
Suresha, D., Prakash, H.N.: Single picture super resolution of natural images using N-neighbor adaptive bilinear interpolation and absolute asymmetry based wavelet hard thresholding. In: 2016 2nd International Conference on Applied and Theoretical Computing and Communication Technology (iCATccT), pp. 387–393 (2016). https://doi.org/10.1109/ICATCCT.2016.7912029
Avidan, S, Shamir, A.: Seam carving for content-aware image resizing. In: ACM SIGGRAPH 2007 Papers (SIGGRAPH 2007), p. 10–es. Association for Computing Machinery, New York (2007). https://doi.org/10.1145/1275808.1276390
Chen, Y., Pan, Y., Song, M., Wang, M.: Improved seam carving combining with 3D saliency for image retargeting. Neurocomputing 151, 645–653 (2015)
Bo, Y., Jian, L., Jie, C., Wei, R., Zhiwei, G., Li, Z.: Rectangling panoramic images via sub-pixel seam carving. J. Comput. Aided Des. Comput. Graph. 28(10), 1723–1731 (2016)
Achanta, R., Susstrunk, S.: Saliency detection for content-aware image resizing. In: 2009 16th IEEE International Conference on Image Processing (ICIP), Cairo, pp. 1005–1008. IEEE (2009). https://doi.org/10.1109/ICIP.2009.5413815
Shen, J., Wang, D., Li, X.: Depth-aware image seam carving. IEEE Trans. Cybern. 43(5), 1453–1461 (2013). https://doi.org/10.1109/TCYB.2013.2273270
Zhang, Y., Sun, Z., Jiang, P., Huang, Y., Peng, J.: Hybrid image retargeting using optimized seam carving and scaling. Multimed. Tools Appl. 76, 8067–8085 (2017). https://doi.org/10.1007/s11042-016-3318-1
Cui, J., Cai, Q., Lu, H., Jia, Z., Tang, M.: Distortion-aware image retargeting based on continuous seam carving model. Signal Process. 166, 107242 (2020)
Shafieyan, F., Karimi, N., Mirmahboub, B., Samavi, S., Shirani, S.: Image retargeting using depth assisted saliency map. Signal Process. Image Commun. 50, 34–43 (2017). https://doi.org/10.1016/j.image.2016.10.006
Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. ACM Trans. Graph. 28, 1–11 (2009). https://doi.org/10.1145/1531326.1531329
Guo, D., Ding, J., Tang, J., Xu, M., Zhao, C.: NIF-based seam carving for image resizing. Multimed. Syst. 21, 603–613 (2015)
Cho, D., Park, J., Oh, T.-H., Tai, Y.-W., Kweon, I.S.: Weakly- and self-supervised learning for content-aware deep image retargeting. In: 2017 IEEE International Conference on Computer Vision (ICCV), Venice, pp. 4568–4577. IEEE (2017). https://doi.org/10.1109/ICCV.2017.488
Ahmadi, M., Karimi, N., Samavi, S.: Context-aware saliency detection for image retargeting using convolutional neural networks. Multimed. Tools Appl. 80, 11917–11941 (2021). https://doi.org/10.1007/s11042-020-10185-0
Wang, Y.-S., Tai, C.-L., Sorkine, O., Lee, T.-Y.: Optimized scale-and-stretch for image resizing. In: ACM SIGGRAPH Asia 2008 Papers, pp. 1–8 (2008). Author, F., Author, S.: Title of a proceedings paper. In: Editor, F., Editor, S. (eds.) CONFERENCE 2016, LNCS, vol. 9999, pp.1–13. Springer, Heidelberg (2016)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13, 600–612 (2004). https://doi.org/10.1109/TIP.2003.819861
Liu, C., Yuen, J., Torralba, A.: SIFTflow: dense correspondence across scenes and its applications. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 978–994 (2010)
Qin, X., Zhang, Z., Huang, C., Dehghan, M., Zaiane, O.R., Jagersand, M.: U2-Net: going deeper with nested U-structure for salient object detection. Pattern Recognit. 106, 107404 (2020). https://doi.org/10.1016/j.patcog.2020.107404
Acknowledgments
This research was funded by the following projects: Sanya University Curriculum Assessment Reform Pilot Project (SYJGKH2023130) and National Natural Science Foundation of China (NSFC) and National Research Foundation of Korea (NRF) Jointly Funded Cooperative Exchange Programme (31811540396).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Guo, Q., Xu, Y., Sun, L., Yang, T. (2024). Fusion of Saliency and Edge Map for Multi-operator Image Retargeting Algorithm. In: Huang, DS., Chen, W., Pan, Y. (eds) Advanced Intelligent Computing Technology and Applications. ICIC 2024. Lecture Notes in Computer Science, vol 14869. Springer, Singapore. https://doi.org/10.1007/978-981-97-5603-2_3
Download citation
DOI: https://doi.org/10.1007/978-981-97-5603-2_3
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-5602-5
Online ISBN: 978-981-97-5603-2
eBook Packages: Computer ScienceComputer Science (R0)