Skip to main content
SpringerLink
Log in

A photograph reconstruction by object retargeting for better composition

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In digital photography, composition rules are essential for capturing highly aesthetic photographs. Aesthetic images create a response of visual appreciation to the viewers. Rule-of-thirds (RoT) is the most important and basic rule accepted by photographers for taking aesthetically pleasing shots. In this paper, a novel computational approach, “Retarget Object for Implementation of Rule-of-Thirds”, (ROI-RT) is presented. The ROI-RT technique automatically improves the composition of the photographs according to the photo composition guidelines. For achieving the mentioned task, the key adopted steps are main object segmentation by alpha matting, texture synthesis for occluded background, features extraction for ROI-RT, and retargeting the main object on synthesized background to reproduce a photograph which respects the composition rule RoT, in photography. Experimental results performed on various sets of photographs achieve a compositional accuracy rate of 95 % by proposed approach. Aesthetic scores for the resultant reconstructed photographs are attained by average subjective rating (SR) of 30 people and also computed by online evaluation methods of OSCAR and ACQUINE. Statistical significant test is applied and obtained P–value = 0.0001 < 0.05 shows a promising performance of our ROI-RT compositional scheme. A comparison with existing photo composition techniques shows that ROI-RT provides us a better aesthetic photographic composition.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Attribution non-commercial liscence. http://www.flickr.com/creativecommons/ [Online; accessed 1-Sep-2014]

  2. Banerjee S, Evans BL (2007) In-camera automation of photographic composition rules. IEEE Trans Image Process 16(7):1807–1820

    Article  MathSciNet  Google Scholar 

  3. Barnes C, Shechtman E, Finkelstein A, Goldman DB (2009) PatchMatch: a randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics (Proc. SIGGRAPH), 28(3)

  4. Cambridge in colors a learning community for photographers. http://www.cambridgeincolour.com/tutorials/rule-of-thirds.htm. [Online; accessed 4-Mar-2015]

  5. Chang Y-Y; Chen H-T (2009) Finding good composition in panoramic scenes. In: ICCV, pages 2225–2231. IEEE

  6. Datta R, Wang JZ (2010) Acquine: aesthetic quality inference engine - real-time automatic rating of photo aesthetics. In: Proceedings of the International Conference on Multimedia Information Retrieval, MIR ’10, pages 421–424, New York, ACM

  7. Levin A, Rav-Acha A, Lischinski D (2007) Spectral matting. In: IEEE Conference on Computer Vision and Pattern Recognition, 2007. CVPR ’07.pages 1–8

  8. Liu L, Chen R, Wolf L, Cohen-Or D (2010) Optimizing photo composition. Comput Graph Forum 29(2):469–478

    Article  Google Scholar 

  9. Mai L, Le H, Niu Y, Liu F (2011). Rule of thirds detection from photograph. pages 91–96

  10. Mansfield A, Gehler P, Van Gool L, Rother C (2010) Scene carving: scene consistent image retargeting. In Proceedings of the 11th European conference on Computer vision: Part I, ECCV’10, pages 143–156, Berlin, Springer-Verlag

  11. Merris R (1994) Laplacian matrices of graphs: a survey. Linear Algebra Appl 197–198:143–176

    Article  MathSciNet  MATH  Google Scholar 

  12. Online public database, flicker.com. http://www.flicker.com. [Online; accessed 10-Aug-2013]

  13. Online public database, photo.net. http://www.photo.net [Online; accessed 15-July-2013]

  14. Online public database, photoshelter.com. http://www.photoshelter.com[Online; accessed 10-July-2013]

  15. Online p-value calculator. http://graphpad.com/quickcalcs/pValue1/. [Online; accessed 13-January-2015]

  16. Oxford advanced learner’s dictionary. www.oald8.oxfordlearnersdictionaries.com [Online; accessed 5-June-2013]

  17. Park J, Lee J-Y, Tai Y-W, Kweon IS (2012) Modeling photo composition and its application to photo re-arrangement. In: 2012 19th IEEE International Conference on Image Processing (ICIP), pages 2741–2744

  18. Ren T, Liu Y, Wu G (2009) Image retargeting based on global energy optimization. In: IEEE International Conference on Multimedia and Expo, 2009. ICME 2009, pages 406–409, June 2009.

  19. Riaz S, Choi D-Y, Pyun J-Y, Lee S-W (2015) Automatic segmentation improvement based on parameter-free spectral matting. J Chin Inst Eng 38:437–446

    Article  Google Scholar 

  20. Riaz S, Lee S-W (2012) Main object segmentation in marco photography. pages 103–104, Kuming, China

  21. Rother C, Kolmogorov V, Blake A (2004) “grabcut”: Interactive foreground extraction using iterated graph cuts. ACM Trans Graph 23(3):309–314

    Article  Google Scholar 

  22. Setlur V, Takagi S, Raskar R, Gleicher M, Gooch B (2005) Automatic image retargeting. In: Proceedings of the 4th international conference on Mobile and ubiquitous multimedia, MUM ’05, pages 59–68, New York, ACM

  23. Sun J, Ling H (2011) Scale and object aware image retargeting for thumbnail browsing. In 2011 I.E. International Conference on Computer Vision (ICCV), pages 1511–1518

  24. Yao L, Suryanarayan P, Qiao M, Wang JZ, Li J (2012) Oscar: On-site composition and aesthetics feedback through exemplars for photographers. Int J Comput Vis 96(3):353–383

    Article  Google Scholar 

Download references

Acknowledgments

This study was supported by research fund from Chosun University, 2015.

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Computer Vision and Image Processing Laboratory, Seoul, South Korea

    Sidra Riaz & Unsang Park

  2. Department of Computer Engineering, Computer Vision and Multimedia Laboratory, Gwangju, South Korea

    Sang-Woong Lee

Authors
  1. Sidra Riaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Unsang Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sang-Woong Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sang-Woong Lee.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Riaz, S., Park, U. & Lee, SW. A photograph reconstruction by object retargeting for better composition. Multimed Tools Appl 75, 16439–16460 (2016). https://doi.org/10.1007/s11042-015-3037-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-3037-z

Keywords

Search

Navigation