Yuming Fang
ABSTRACT
In this paper, we propose a novel image retargeting algorithm to resize images based on the extracted saliency information from the compressed domain. Firstly, we utilize DCT coefficients in JPEG bitstream to perform saliency detection with the consideration of the human visual sensitivity. The obtained saliency information is used to determine the relative visual importance of each 8 x 8 block for the image. Furthermore, we propose a new adaptive block-level seam removal operation for connected blocks to resize the image. Thanks to the directly derived saliency information from the compressed domain, the proposed image retargeting algorithm effectively preserves the objects of attention, efficiently removes the less crucial regions, and therefore significantly outperforms the relevant state-of-the-art algorithms, as demonstrated with the careful analysis and in the extensive experiments.
- S. Avidan, and A. Shamir. Seam carving for content-aware image resizing. ACM TOG, 26(3), 2007. Google Scholar
Digital Library
- M. Rubinstein, A. Shamir, and S. Avidan. Improved seam carving for video retargeting. ACM TOG, 2008. Google ScholarDigital Library
- R. Achanta, and S. Susstrunk. Saliency detection for content-aware image resizing. In ICIP, 2009. Google ScholarDigital Library
- L. Wolf, M. Guttmann, and D. Cohen-OR. Non-homogeneous content-driven video retargeting. In ICCV, 2007.Google ScholarCross Ref
- T. Ren, Y. Liu, and G. Wu. Image retargeting based on global energy optimization. In ICME, 2009. Google ScholarDigital Library
- Y. Jin, L. Liu, and Q. Wu. Nonhomogeneous scaling optimization for realtime image resizing. In CGI, 2010.Google ScholarDigital Library
- S. Engel, X. Zhang, and B. Wandell. Colour tuning in human visual cortex measured with functional magnetic resonance imaging. Nature, 388(6), 1997.Google Scholar
- L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE TPAMI, 20(11), 1998. Google ScholarDigital Library
- R. T. Rockafellar, and R. J.-B. Wets. Variational Analysis. Springer-Verlag, 2005.Google Scholar
- W. S. Geisler, and J. S. Perry. A real-time foveated multi-solution system for low-bandwidth video communication. SPIE, 3299, 1998.Google Scholar
- T. Liu, J. Sun, N. Zheng, X. Tang, and H. Y. Shum. Learning to detect a salient object. In CVPR, 2007.Google ScholarCross Ref
- X. Hou and L. Zhang. Saliency detection: a spectral residual approach. In CVPR, 2007.Google ScholarCross Ref
- R. Achanta, S. Hemami, F. Estrada and S. Susstrunk. Frequency-tuned salient region detection. In CVPR, 2009.Google ScholarCross Ref
Index Terms
- Saliency-based image retargeting in the compressed domain
Recommendations
Video saliency detection incorporating temporal information in compressed domain
Saliency detection is widely used to pick out relevant parts of a scene as visual attention regions for various image/video applications. Since video is increasingly being captured, moved and stored in compressed form, there is a need for detecting ...
Bio-inspired visual saliency detection and its application on image retargeting
ICONIP'11: Proceedings of the 18th international conference on Neural Information Processing - Volume Part IIn this paper, we present a saliency guided image retargeting method. Our bio-inspired saliency measure integrates three factors: dissimilarity, spatial distance and central bias, and these three factors are supported by research on human vision system (...
Context-aware saliency detection for image retargeting using convolutional neural networks
AbstractImage retargeting is the task of making images capable of being displayed on screens with different sizes. This work should be done so that high-level visual information and low-level features such as texture remain as intact as possible to the ...
Comments