skip to main content
10.1145/2393347.2396293acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
poster

Seam carving with forward gradient difference maps

Published:29 October 2012Publication History

ABSTRACT

We propose a new energy function for seam carving based on forward gradient differences to preserve regular structures in images. The energy function measures the curvature inconsistency between the pixels that become adjacent after seam removal, and involves the difference of gradient orientation and magnitude of the pixels. Our objective is to minimize the differences induced by the removed seam, and the optimization is performed by dynamic programming based on multiple cumulative energy maps, each of which corresponds to the seam pattern associated with a pixel. The proposed technique preserves straight lines and regular shapes better than the original and improved seam carving, and can be easily combined with other types of energy functions within the seam carving framework. We evaluated the performance of our algorithm by comparing with the original and improved seam carving algorithms using public data.

References

  1. R. Achanta and S. Süsstrunk. Saliency detection for content-aware image resizing. In ICIP, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. S. Avidan and A. Shamir. Seam carving for content-aware image resizing. ACM Trans. Graph., 26(3):10, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. S. Cho, H. Choi, Y. Matsushita, and S. Lee. Image retargeting using importance diffusion. In ICIP, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. W. Dong, N. Zhou, J.-C. Paul, and X. Zhang. Optimized image resizing using seam carving and scaling. ACM Trans. on Graph., 28(5), 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Z. Karni, D. Freedman, and C. Gotsman. Energy-based image deformation. Computer Graphics Forum, 28(5):1257--1268, 2009. Google ScholarGoogle ScholarCross RefCross Ref
  6. P. Krähenbühl, M. Lang, A. Hornung, and M. Gross. A system for retargeting of streaming video. ACM Trans. on Graph., 28(5), 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. F. Liu and M. Gleicher. Automatic image retargeting with fisheye-view warping. In Proc.18th annual ACM Symp. on User Interface Software and Technology (UIST), 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. A. Mansfield, P. Gehler, C. Rother, and L. Van Gool. Visibility maps for improving seam carving. In Media Retargeting Workshop in conjunction with ECCV, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Y. Pritch, E. K. Venaki, and S. Peleg. Shift-Map Image Editing. In ICCV, 2009.Google ScholarGoogle Scholar
  10. M. Rubinstein, D. Gutierrez, O. Sorkine, and A. Shamir. A comparative study of image retargeting. ACM Trans. Graph., 29(6):160, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. M. Rubinstein, A. Shamir, and S. Avidan. Improved seam carving for video retargeting. ACM Trans. on Graph., 27(3):1--9, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. M. Rubinstein, A. Shamir, and S. Avidan. Multi-operator media retargeting. ACM Trans. Graph., 28(3), 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. B. Suh, H. Ling, B. B. Bederson, and D. W. Jacobs. Automatic thumbnail cropping and its effectiveness. In Proc. 16th ACM Symp. on User Interface Software and Technology (UIST), pages 95--104, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Y.-S. Wang, C.-L. Tai, O. Sorkine, and T.-Y. Lee. Optimized scale-and-stretch for image resizing. ACM Trans. on Graph., 27(5), 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. L. Wolf, M. Guttmann, and D. Cohen-Or. Non-homogeneous content-driven video-retargeting. In ICCV, 2007.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Seam carving with forward gradient difference maps

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      MM '12: Proceedings of the 20th ACM international conference on Multimedia
      October 2012
      1584 pages
      ISBN:9781450310895
      DOI:10.1145/2393347

      Copyright © 2012 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 29 October 2012

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • poster

      Acceptance Rates

      Overall Acceptance Rate995of4,171submissions,24%

      Upcoming Conference

      MM '24
      MM '24: The 32nd ACM International Conference on Multimedia
      October 28 - November 1, 2024
      Melbourne , VIC , Australia

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader