Skip to main content
SpringerLink
Log in

Object-aware image thumbnailing using image classification and enhanced detection of ROI

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Thumbnail images are used to display a large collection of photos in various digital devices. It aims for people to browse and search the image collection effectively. The provided thumbnail images are expressed in a much lower resolution compared to the resolution of the original image. Thus, it faces a significant problem of how to represent the content of a given image effectively in a tiny thumbnail image. Many image thumbnailing methods have been presented in literature for this purpose. However, the existing thumbnailing methods are designed to use a single method to all kinds of images, regardless of image contents. On the other hand, the proposed method employs two different thumbnail generation methods either of which is applied according to corresponding image context. To achieve this, we first classify images into two groups by detecting the object existence. Then, an ROI cropping method using a saliency map is presented for images with objects, in order to represent the important region of images in the thumbnail. Images without any interesting objects, such as landscape images, are considered to be resized by using a simple scaling method to maintain the whole image context. Experimental results show that the proposed method yields comparable performance on a variety of datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Alexe B, Deselaers T, Ferrari V (2012) Measuring the objectness of image windows. IEEE Trans Pattern Anal Mach Intell 34(11):2189–2202

    Article  Google Scholar 

  2. Amrutha I, Shylaja S, Natarajan S, Murthy K (2009) A smart automatic thumbnail cropping based on attention driven regions of interest extraction. In: Proceedings of the International Conference on Interaction Sciences: Information Technology, Culture and Human, pp 957–962. ACM

  3. Avidan S, Shamir A (2007) Seam carving for content-aware image resizing. ACM Trans Graph 26(3):267–276

    Article  Google Scholar 

  4. Choi J, Jung C, Lee J, Kim C (2014) Determining the existence of objects in an image and its application to image thumbnailing. IEEE Signal Process Lett 21(8):957–961

    Article  Google Scholar 

  5. Ciocca G, Schettini R (2010) Multiple image thumbnailing. In: Proceedings of the IS&T/SPIE Electronic Imaging, pp 75,370S–75,370S. International Society for Optics and Photonics

  6. Everingham M, Van Gool L, Williams CK, Winn J, Zisserman A (2010) The pascal visual object classes (voc) challenge. Int J Comput Vis 88(2):303–338

    Article  Google Scholar 

  7. Kennedy L, van Zwol R, Torzec N, Tseng B (2011) Learning crop regions for content-aware generation of thumbnail images. In: Proceedings of the ACM International Conference on Multimedia Retrieval, p 30

  8. Kim JS, Kim JH, Kim CS (2009) Adaptive image and video retargeting technique based on fourier analysis. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1730–1737

  9. Kim W, Kim C (2012) Saliency detection via textural contrast. Opt Lett 37(9):1550–1552

    Article  Google Scholar 

  10. Li X, Ling H (2009) Learning based thumbnail cropping. In: Proceedings of the IEEE International Conference on Multimedia and Expo, pp 558–561

  11. Lin SS, Lin CH, Yeh IC, Chang SH, Yeh CK, Lee TY (2013) Content-aware video retargeting using object-preserving warping. IEEE Trans Vis Comput Graph 19(10):1677–1686

    Article  Google Scholar 

  12. Liu F, Gleicher M (2005) Automatic image retargeting with fisheye-view warping. In: Proceedings of the ACM symposium on User interface software and technology, pp 153–162

  13. Liu T, Yuan Z, Sun J, Wang J, Zheng N, Tang X, Shum HY (2011) Learning to detect a salient object. IEEE Trans Pattern Anal Mach Intell 33(2):353–367

    Article  Google Scholar 

  14. Ma M, Guo JK (2004) Automatic image cropping for mobile device with built-in camera. In: Proceedings of the IEEE Consumer Communications and Networking Conference, pp 710–711

  15. Marchesotti L, Cifarelli C, Csurka G (2009) A framework for visual saliency detection with applications to image thumbnailing. In: Proceedings of the IEEE International Conference on Computer Vision, pp 2232–2239

  16. Mellina A, Sentinelli A, Marfia G, Roccetti M (2012) Areeb: Automatic refrain extraction for thumbnail. In: CCNC, pp 472–476

  17. Nishiyama M, Okabe T, Sato Y, Sato I (2009) Sensation-based photo cropping. In: Proceedings of the ACM international conference on Multimedia, pp 669–672

  18. Otsu N (1975) A threshold selection method from gray-level histograms. Automatica 11(285-296):23–27

    Google Scholar 

  19. Qu Z, Wang J, Xu M, Lu H (2013) Fusing warping, cropping, and scaling for optimal image thumbnail generation. In: Proceedings of the the 11th Asian Conference on Computer Vision, pp 445–456

  20. Rubinstein M, Gutierrez D, Sorkine O, Shamir A (2010) A comparative study of image retargeting. ACM Trans Graph 29(6):160:1–160:10

    Article  Google Scholar 

  21. Rubinstein M, Shamir A, Avidan S (2008) Improved seam carving for video retargeting. In: ACM Transactions on Graphics, vol 27, p 16

  22. Rubinstein M, Shamir A, Avidan S (2009) Multi-operator media retargeting. In: ACM Transactions on Graphics, vol 28, p 23. ACM

  23. Samadani R, Lim SH, Tretter D (2007) Representative image thumbnails for good browsing. In: Proceedings of the IEEE International Conference on Image Processing, vol 2, pp II–193

  24. Scharfenberger C, Waslander SL, Zelek JS, Clausi DA (2013) Existence detection of objects in images for robot vision using saliency histogram features. In: Proceedings of the International Conference on Computer and Robot Vision, pp 75–82

  25. Sentinelli A, Celetto L, Marfia G, Roccetti M (2013) Embedded key frame extraction in ugc scenarios. In: 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp 1–5. IEEE

  26. Stentiford F (2007) Attention based auto image cropping. In: Proceedings of the International Conference on Computer Vision Systems. Citeseer

  27. Suh B, Ling H, Bederson BB, Jacobs DW (2003) Automatic thumbnail cropping and its effectiveness. In: Proceedings of the ACM symposium on User interface software and technology, pp 95–104

  28. Sun J, Ling H (2013) Scale and object aware image thumbnailing. Int J Comput Vis 104(2):135–153

    Article  Google Scholar 

  29. Wang P, Wang J, Zeng G, Feng J, Zha H, Li S (2012) Salient object detection for searched web images via global saliency. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3194–3201

  30. Wang YS, Tai CL, Sorkine O, Lee TY (2008) Optimized scale-and-stretch for image resizing. In: ACM Transactions on Graphics, vol 27, p 118. ACM

  31. Wu Y, Liu X, Liu S, Ma KL (2013) Visizer: a visualization resizing framework. IEEE Trans Vis Comput Graph 19(2):278–290

    Article  Google Scholar 

  32. Xiao J, Hays J, Ehinger KA, Oliva A, Torralba A (2010) Sun database: Large-scale scene recognition from abbey to zoo. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3485–3492

  33. Yan J, Lin S, Kang SB, Tang X (2013) Learning the change for automatic image cropping. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 971–978

  34. Yang Y, Yang L, Wu G (2013) Smart thumbnail: Automatic image cropping by mining canonical query objects. In: Proceedings of the Advances in Multimedia Information Processing–PCM 2013, pp 337–349. Springer

  35. Yen TC, Tsai CM, Lin CW (2011) Maintaining temporal coherence in video retargeting using mosaic-guided scaling. IEEE Trans Image Process 20(8):2339–2351

    Article  MathSciNet  Google Scholar 

  36. Zhang L, Song M, Yang Y, Zhao Q, Zhao C, Sebe N (2013) Weakly supervised photo cropping. IEEE Trans Multimed 16(1):94–107

    Article  Google Scholar 

  37. Zhang M, Zhang L, Sun Y, Feng L, Ma W (2005) Auto cropping for digital photographs. In: Proceedings of the IEEE International Conference on Multimedia and Expo, pp 4–pp

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Korea Advanced Institute of Science and Technology(KAIST), Daejeon, 305-701, South Korea

    Jiwon Choi & Changick Kim

Authors
  1. Jiwon Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Changick Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Changick Kim.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Choi, J., Kim, C. Object-aware image thumbnailing using image classification and enhanced detection of ROI. Multimed Tools Appl 75, 16191–16207 (2016). https://doi.org/10.1007/s11042-015-2926-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2926-5

Keywords

Search

Navigation