skip to main content
10.1145/1631272.1631384acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
short-paper

Sensation-based photo cropping

Published: 19 October 2009 Publication History

Abstract

This paper proposes a novel method for automatically cropping a photo using a quality classifier that assesses whether the cropped region is agreeable to users. We statistically build this quality classifier using large photo collections available on websites where people manually insert quality scores to photos. We first trim the original image and then decide on the candidates for cropping. We find the cropped region with the highest quality score by applying the quality classifier to the candidates. Current automatic photo cropping techniques search for attention grabbing regions that consist of salient pixels from the original photo. They are not always pleasant to users because they do not take into account the quality of the cropped region. Our method with the quality classifier outperforms a state-of-the-art method that takes into consideration only the user's attention for automatic photo cropping.

References

[1]
DPChallenge: http://www.dpchallenge.com.
[2]
Flickr: http://www.flickr.com.
[3]
Photo.net: http://photo.net.
[4]
R. Datta, D. Joshi, J. Li, and J.Z. Wang. Studying aesthetics in photographic images using a computational approach. in Proc. ECCV, III:288 -- 301, 2006.
[5]
L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. PAMI, 20(11):1254 -- 1259, 1998.
[6]
Y. Ke, X. Tang, and F. Jing. The design of high-level features for photo quality assessment. in Proc. CVPR, 1:419 -- 426, 2006.
[7]
H.T. Lin, C.J. Lin, and R.C. Weng. A note on platt's probabilistic outputs for support vector machines. Machine Learning, 68(3):267 -- 276, 2007.
[8]
A. Loui, M.D. Wood, A. Scalise, and J. Birkelund. Multidimensional image value assessment and rating for automated albuming and retrieval. in Proc. ICIP, pages 97 -- 100, 2008.
[9]
J. Luo. Subject content-based intelligent cropping of digital photos. in Proc. ICME, pages 2218 -- 2221, 2007.
[10]
Y. Luo and X. Tang. Photo and video quality evaluation: Focusing on the subject. in Proc. ECCV, III:386 -- 399, 2008.
[11]
A. Santella, M. Agrawala, D. DeCarlo, D. Salesin, and M. Cohen. Gaze-based interaction for semi-automatic photo cropping. in Proc. SIGCHI Conf. Human Factors in Computing Systems, pages 771 -- 780, 2006.
[12]
B. Suh, H. Ling, B. Bederson, and D. Jacobs. Automatic thumbnail cropping and its effectiveness. in Proc. ACM UIST, pages 95 -- 104, 2003.
[13]
L.L. Thurstone. A law of comparative judgement. Psychological Review, 34:273 -- 286, 1927.

Cited By

View all
  • (2024)A new content-aware image resizing based on Rényi entropy and deep learningNeural Computing and Applications10.1007/s00521-024-09517-036:15(8885-8899)Online publication date: 30-Mar-2024
  • (2023)Image Cropping under Design ConstraintsProceedings of the 5th ACM International Conference on Multimedia in Asia10.1145/3595916.3626412(1-7)Online publication date: 6-Dec-2023
  • (2023)Composition-Guided Neural Network for Image Cropping Aesthetic AssessmentIEEE Transactions on Multimedia10.1109/TMM.2022.321500325(6836-6851)Online publication date: 2023
  • Show More Cited By

Index Terms

  1. Sensation-based photo cropping

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '09: Proceedings of the 17th ACM international conference on Multimedia
    October 2009
    1202 pages
    ISBN:9781605586083
    DOI:10.1145/1631272
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 October 2009

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. cropping
    2. photograph
    3. quality
    4. sensation

    Qualifiers

    • Short-paper

    Conference

    MM09
    Sponsor:
    MM09: ACM Multimedia Conference
    October 19 - 24, 2009
    Beijing, China

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)17
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 01 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)A new content-aware image resizing based on Rényi entropy and deep learningNeural Computing and Applications10.1007/s00521-024-09517-036:15(8885-8899)Online publication date: 30-Mar-2024
    • (2023)Image Cropping under Design ConstraintsProceedings of the 5th ACM International Conference on Multimedia in Asia10.1145/3595916.3626412(1-7)Online publication date: 6-Dec-2023
    • (2023)Composition-Guided Neural Network for Image Cropping Aesthetic AssessmentIEEE Transactions on Multimedia10.1109/TMM.2022.321500325(6836-6851)Online publication date: 2023
    • (2023)Joint Probability Distribution Regression for Image Cropping2023 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP49359.2023.10222223(990-994)Online publication date: 8-Oct-2023
    • (2023)ClipCrop: Conditioned Cropping Driven by Vision-Language Model2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)10.1109/ICCVW60793.2023.00037(294-304)Online publication date: 2-Oct-2023
    • (2023)Image Cropping with Spatial-aware Feature and Rank Consistency2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00969(10052-10061)Online publication date: Jun-2023
    • (2023)Polygonal finite element-based content-aware image warpingComputational Visual Media10.1007/s41095-022-0283-79:2(367-383)Online publication date: 3-Jan-2023
    • (2022)Grid Anchor Based Image Cropping: A New Benchmark and An Efficient ModelIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2020.302420744:3(1304-1319)Online publication date: 1-Mar-2022
    • (2022)Bioinspired Scene Classification by Deep Active Learning With Remote Sensing ApplicationsIEEE Transactions on Cybernetics10.1109/TCYB.2020.298148052:7(5682-5694)Online publication date: Jul-2022
    • (2022)Community-Aware Photo Quality Evaluation by Deeply Encoding Human PerceptionIEEE Transactions on Cybernetics10.1109/TCYB.2019.293731952:5(3136-3146)Online publication date: May-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media