Lyndon Kennedy
Roelof van Zwol
ABSTRACT
We propose a model for automatically cropping images based on a diverse set of content and spatial features. We approach this by extracting pixel-level features and aggregating them over possible crop regions. We then learn a regression model to predict the quality of the crop regions, via the degree to which they would overlaps with human-provided crops from these input features. Candidate images can then be cropped based an exhaustive sweep over candidate crop regions, where each region is scored and the highest-scoring region is retained. The system is unique in its ability to incorporate a variety of pixel-level importance cues when arriving at a final cropping recommendation. We test the system on a set of human-cropped images with a large set of features. We find that the system outperforms baseline approaches, particularly when the aspect ratio of the image is very different from the target thumbnail region.
- S. Avidan and A. Shamir. Seam carving for content-aware image resizing. ACM Transactions on Graphics, 26(3):10, 2007. Google Scholar
Digital Library
- G. Bradski and A. Kaehler. Learning OpenCV: Computer vision with the OpenCV library. O'Reilly Media, 2008.Google ScholarDigital Library
- C.-C. Chang and C.-J. Lin. LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.Google Scholar
- L. Chen, X. Xie, X. Fan, W. Ma, H. Zhang, and H. Zhou. A visual attention model for adapting images on small displays. Multimedia systems, 9(4):353--364, 2003.Google ScholarDigital Library
- G. Ciocca, C. Cusano, F. Gasparini, and R. Schettini. Self-adaptive image cropping for small displays. Consumer Electronics, IEEE Transactions on, 53(4):1622--1627, 2008. Google ScholarDigital Library
- H. Drucker, C. Burges, L. Kaufman, A. Smola, and V. Vapnik. Support vector regression machines. Advances in neural information processing systems, pages 155--161, 1997.Google Scholar
- S. Goferman, L. Zelnik-Manor, and A. Tal. Context-aware saliency detection. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 2376--2383. IEEE, 2010.Google ScholarCross Ref
- L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 20(11):1254--1259, 2002. Google ScholarDigital Library
- L. Marchesotti, C. Cifarelli, and G. Csurka. A framework for visual saliency detection with applications to image thumbnailing. In Computer Vision, 2009 IEEE 12th International Conference on, pages 2232--2239. IEEE, 2009.Google ScholarCross Ref
- V. Setlur, S. Takagi, R. Raskar, M. Gleicher, and B. Gooch. Automatic image retargeting. In Proceedings of the 4th international conference on Mobile and ubiquitous multimedia, pages 59--68. ACM, 2005. Google ScholarDigital Library
- F. Stentiford. Attention based auto image cropping. In The 5th International Conference on Computer Vision Systems, Bielefeld. Citeseer, 2007.Google Scholar
- B. Suh, H. Ling, B. Bederson, and D. Jacobs. Automatic thumbnail cropping and its effectiveness. In Proceedings of the 16th annual ACM symposium on User interface software and technology, pages 95--104. ACM, 2003. Google ScholarDigital Library
- W. Wang, Y. Wang, Q. Huang, and W. Gao. Measuring Visual Saliency by Site Entropy Rate. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 2368--2375. IEEE, 2010.Google ScholarCross Ref
- M. Zhang, L. Zhang, Y. Sun, L. Feng, and W. Ma. Auto cropping for digital photographs. In Multimedia and Expo, 2005. ICME 2005. IEEE International Conference on, page 4. IEEE, 2005.Google Scholar
Index Terms
- Learning crop regions for content-aware generation of thumbnail images
Recommendations
A smart automatic thumbnail cropping based on attention driven regions of interest extraction
ICIS '09: Proceedings of the 2nd International Conference on Interaction Sciences: Information Technology, Culture and HumanMost of the Content-Based Image Retrieval (CBIR) solutions treat each image as a whole. But the fact that often a user will be searching for a part of the image i.e., a region in the image with obvious semantic meaning as opposed to the entire picture ...
Detecting Perceptually Salient Texture Regions in Images
Special issue on perceptual organization in computer visionTexture or patterns on objects are often used as cues for quickly selecting important aspects of a scene. Such a selection can be important for a variety of tasks including object recognition, tracking, surveillance, and image indexing of databases. In ...
Saliency-based content-aware lifestyle image mosaics
We proposed a novel content-aware lifestyle image mosaic technique based on image saliency.A novel energy map for variable-size tile decomposition is proposed by combining NIF and GBVS.Saliency-weighted image retrieval is introduced to choose the tile ...
Comments