Abstract
Most image retargeting algorithms rely heavily on valid saliency map detection to proceed. However, the inefficiency of high quality saliency map detection severely restricts the application of these image retargeting methods. In this paper, we propose a random algorithm for efficient context-aware saliency map detection. Our method is a multiple level saliency map detection algorithm that integrates multiple level coarse saliency maps into the resulting saliency map and selectively updates unreliable regions of the saliency map to refine detection results. Because of the randomized search, our method requires very little additional memory beyond that for the input image and result map, and does not need to build auxiliary data structures to accelerate the saliency map detection. We have implemented our algorithm on a GPU and demonstrated the performance for a variety of images and video sequences, compared with state-of-the-art image processing.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Chen B, Sen P. Video carving. In: Short Papers Proceedings of Eurographics, Hersonisso Greece, 2008
Wolf L, Guttmann M, Cohen-Or D. Non-homogeneous content-driven video-retargeting. In: Proceedings of the Eleventh IEEE International Conference on Computer Vision, Rio de Janeiro, 2007. 1–6
Liu L, Chen R, Wolf L, et al. Optimizing photo composition. Comput Graph Forum, 2010, 29: 469–478
Rubinstein M, Shamir A, Avidan S. Improved seam carving for video retargeting. ACM Trans Graph, 2008, 27: 1–9
Itti L, Koch C, Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Patt Anal Mach Intell, 1998, 20: 1254–1259
Goferman S, Zelnik-Manor L, Tal A. Context-aware saliency detection. In: IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, 2010. 2376–2383
Barnes C, Shechtman E, Finkelstein A, et al. PatchMatch: a randomized correspondence algorithm for structural image editing. ACM Trans Graph, 2009, 28: 1–11
Pritch Y, Kav-Venaki E, Peleg S. Shift-map image editing. In: Proceedings of the Twelfth IEEE International Conference on Computer Vision, Kyoto, 2009. 151–158
Wang Y, Fu H, Sorkine O, et al. Motion-aware temporal coherence for video resizing. In: ACM SIGGRAPH Asia 2009 papers, ACM Press, 2009. 1–10.
Avidan S, Shamir A. Seam carving for content-aware image resizing. ACM Trans Graph, 2007, 26:1–8
Wang Y, Tai C, Sorkine O, et al. Optimized scale-and-stretch for image resizing. ACM Trans Graph, 2008, 27: 1–8
Rubinstein M, Shamir A, Avidan S. Multioperator media retargeting. ACM Trans Graph, 2009, 28: 1–11
Chen B, Lee K, Huang W, et al. Capturing intention-based full-frame video stabilization. Comput Graph Forum, 2008, 27: 1805–1814
Liu H, Xie X, Ma W, et al. Automatic browsing of large pictures on mobile devices. In: Proceedings of the Eleventh ACM International Conference on Multimedia, Berkeley, CA, USA, 2003. 148–155
Santella A, Agrawala M, DeCarlo D, et al. Gaze-based interaction for semi-automatic photo cropping. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Montréal, Canada, 2006. 771–780
Cho T, Butman M, Avidan S, et al. The patch transform and its applications to image editing. In: IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska, 2008. 1–8
Wang Y, Lee T, Tai C. Focus+ context visualization with distortion minimization. IEEE Trans Visual Comput Graph, 2008, 14: 1731–1738
Halton J. A retrospective and prospective survey of the Monte Carlo method. Siam Review, 1970, 12: 1–63
Hammersley J, Handscomb D. Monte Carlo methods. Taylor & Francis, Abingdon Oxfordshire, UK1964
Meteopolis N, Ulam S. The Monte Carlo method. J Am Stat Assoc, 1949, 44: 335–341
Yakowitz S. Computational Probability and Simulation. Massachusetts: Addison-Wesley Reading, 1977
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Huang, Z., He, F., Cai, X. et al. Efficient random saliency map detection. Sci. China Inf. Sci. 54, 1207–1217 (2011). https://doi.org/10.1007/s11432-011-4263-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11432-011-4263-2