ABSTRACT
We propose a new energy function for seam carving based on forward gradient differences to preserve regular structures in images. The energy function measures the curvature inconsistency between the pixels that become adjacent after seam removal, and involves the difference of gradient orientation and magnitude of the pixels. Our objective is to minimize the differences induced by the removed seam, and the optimization is performed by dynamic programming based on multiple cumulative energy maps, each of which corresponds to the seam pattern associated with a pixel. The proposed technique preserves straight lines and regular shapes better than the original and improved seam carving, and can be easily combined with other types of energy functions within the seam carving framework. We evaluated the performance of our algorithm by comparing with the original and improved seam carving algorithms using public data.
- R. Achanta and S. Süsstrunk. Saliency detection for content-aware image resizing. In ICIP, 2009. Google ScholarDigital Library
- S. Avidan and A. Shamir. Seam carving for content-aware image resizing. ACM Trans. Graph., 26(3):10, 2007. Google ScholarDigital Library
- S. Cho, H. Choi, Y. Matsushita, and S. Lee. Image retargeting using importance diffusion. In ICIP, 2009. Google ScholarDigital Library
- W. Dong, N. Zhou, J.-C. Paul, and X. Zhang. Optimized image resizing using seam carving and scaling. ACM Trans. on Graph., 28(5), 2009. Google ScholarDigital Library
- Z. Karni, D. Freedman, and C. Gotsman. Energy-based image deformation. Computer Graphics Forum, 28(5):1257--1268, 2009. Google ScholarCross Ref
- P. Krähenbühl, M. Lang, A. Hornung, and M. Gross. A system for retargeting of streaming video. ACM Trans. on Graph., 28(5), 2009. Google ScholarDigital Library
- F. Liu and M. Gleicher. Automatic image retargeting with fisheye-view warping. In Proc.18th annual ACM Symp. on User Interface Software and Technology (UIST), 2005. Google ScholarDigital Library
- A. Mansfield, P. Gehler, C. Rother, and L. Van Gool. Visibility maps for improving seam carving. In Media Retargeting Workshop in conjunction with ECCV, 2010. Google ScholarDigital Library
- Y. Pritch, E. K. Venaki, and S. Peleg. Shift-Map Image Editing. In ICCV, 2009.Google Scholar
- M. Rubinstein, D. Gutierrez, O. Sorkine, and A. Shamir. A comparative study of image retargeting. ACM Trans. Graph., 29(6):160, 2010. Google ScholarDigital Library
- M. Rubinstein, A. Shamir, and S. Avidan. Improved seam carving for video retargeting. ACM Trans. on Graph., 27(3):1--9, 2008. Google ScholarDigital Library
- M. Rubinstein, A. Shamir, and S. Avidan. Multi-operator media retargeting. ACM Trans. Graph., 28(3), 2009. Google ScholarDigital Library
- B. Suh, H. Ling, B. B. Bederson, and D. W. Jacobs. Automatic thumbnail cropping and its effectiveness. In Proc. 16th ACM Symp. on User Interface Software and Technology (UIST), pages 95--104, 2003. Google ScholarDigital Library
- Y.-S. Wang, C.-L. Tai, O. Sorkine, and T.-Y. Lee. Optimized scale-and-stretch for image resizing. ACM Trans. on Graph., 27(5), 2008. Google ScholarDigital Library
- L. Wolf, M. Guttmann, and D. Cohen-Or. Non-homogeneous content-driven video-retargeting. In ICCV, 2007.Google ScholarCross Ref
Index Terms
- Seam carving with forward gradient difference maps
Recommendations
Improved seam carving for video retargeting
Video, like images, should support content aware resizing. We present video retargeting using an improved seam carving operator. Instead of removing 1D seams from 2D images we remove 2D seam manifolds from 3D space-time volumes. To achieve this we ...
Reverse Seam Carving
ICIG '11: Proceedings of the 2011 Sixth International Conference on Image and GraphicsSeam carving is an effective operator supporting content-aware resizing for both image reduction and expansion. However, repeated seam removing and inserting processes lead to excessively distortion image when imposed on seam insertion then removal ...
Seam carving based on dynamic energy regulation
AbstractSeam carving algorithm is widely used in content-based image scaling. By calculating the energy map of the image, it repeatedly removes the pixel line with the lowest energy sum, which can effectively retain the proportion of significant areas ...
Comments