skip to main content
10.1145/2671188.2749363acmconferencesArticle/Chapter ViewAbstractPublication PagesicmrConference Proceedingsconference-collections
short-paper

Multiple Aesthetic Attribute Assessment by Exploiting Relations Among Aesthetic Attributes

Published: 22 June 2015 Publication History

Abstract

Current research of aesthetic assessment for images assumes one aesthetic score or one aesthetic label for an image, ignoring the relations of multiple aesthetic-related attributes. However, most images can be described by multiple aesthetic attributes simultaneously. Therefore, in this paper, we propose multiple aesthetic attribute prediction and classification by modeling relations among aesthetic attributes through Bayesian Networks (BN). In order to realize continuous aesthetic attribute prediction, each aesthetic attribute is represented by a three-node BN, including the discretized aesthetic attribute label, the predicted aesthetic attribute score, and the measurement of the aesthetic attribute score. In addition, the relations among multiple aesthetic attributes are modeled by another discrete BN, whose structure and conditional probabilities are learned from the training data. The attribute measurements are obtained by an existing image-driven regression method. With the learned BN, we infer the true discrete label and continuous score for each attribute by combining the relations among attributes with the previously obtained measurements. Experiments on the Memorability dataset show the superiority of our proposed approach to current image-driven methods for both multiple continuous aesthetic attribute score prediction and multiple discrete aesthetic attribute label classification, indicating the effectiveness of the captured relations for aesthetic quality assessment.

References

[1]
Ritendra Datta, Dhiraj Joshi, Jia Li, and James Z Wang, "Studying aesthetics in photographic images using a computational approach," in ECCV 2006, pp. 288--301. Springer, 2006.
[2]
Mark Desnoyer and David Wettergreen, "Aesthetic image classification for autonomous agents," in ICPR 2010. IEEE, 2010, pp. 3452--3455.
[3]
S. Dhar, V. Ordonez, and T. L. Berg, "High level describable attributes for predicting aesthetics and interestingness," in CVPR 2011, June 2011, pp. 1657--1664.
[4]
Hsiao-Hang Su, Tse-Wei Chen, Chieh-Chi Kao, Winston H. Hsu, and Shao-Yi Chien, "Scenic photo quality assessment with bag of aesthetics-preserving features," in ACM MM'11. 2011, pp. 1213--1216, ACM.
[5]
Yiwen Luo and Xiaoou Tang, "Photo and video quality evaluation: Focusing on the subject," in ECCV 2008, pp. 386--399. Springer, 2008.
[6]
Kuo-Yen Lo, Keng-Hao Liu, and Chu-Song Chen, "Assessment of photo aesthetics with efficiency," in ICPR 2012. IEEE, 2012, pp. 2186--2189.
[7]
Xin Lu, Zhe Lin, Hailin Jin, Jianchao Yang, and James Z. Wang, "Rapid: Rating pictorial aesthetics using deep learning," in ACM MM'14. 2014, pp. 457--466, ACM.
[8]
Subhabrata Bhattacharya, Rahul Sukthankar, and Mubarak Shah, "A framework for photo-quality assessment and enhancement based on visual aesthetics," in ACM MM'10. 2010, pp. 271--280, ACM.
[9]
Pere Obrador, Michele Saad, Poonam Suryanarayan, and Nuria Oliver, "Towards Category-Based Aesthetic Models of Photographs," in Proceedings of the 18th International Conference on Advances in Multimedia Modeling - Volume Part I (MMM 2012), 2012, pp. 63--76.
[10]
Phillip Isola, Jianxiong Xiao, Antonio Torralba, and Aude Oliva, "What makes an image memorable?" in CVPR 2011, 2011, pp. 145--152.
[11]
Svetlana Lazebnik, Cordelia Schmid, and Jean Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in CVPR 2006. IEEE, 2006, vol. 2, pp. 2169--2178.
[12]
Aude Oliva and Antonio Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," IJCV, vol. 42, no. 3, pp. 145--175, 2001.
[13]
Pedro F. Felzenszwalb, Ross B. Girshick, David McAllester, and Deva Ramanan, "Object detection with discriminatively trained part-based models," TPAMI, vol. 32, no. 9, pp. 1627--1645, 2010.
[14]
Eli Shechtman and Michal Irani, "Matching local self-similarities across images and videos," in CVPR 2007. IEEE, 2007, pp. 1--8.
[15]
Cassio P. De Campos and Qiang Ji, "Efficient structure learning of bayesian networks using constraints," JMLR, vol. 12, pp. 663--689, 2011.
[16]
David Kahle, Terrance Savitsky, Stephen Schnelle, and Volkan Cevher, "Junction tree algorithm," STAT, vol. 631, 2008.
[17]
"Flickr {online}," http://www.flickr.com.
[18]
"Photo.net {online}," http://photo.net.
[19]
"Dpchallenge {online}," http://www.dpchallenge.com.
[20]
"Terragalleria {online}," http://www.terragalleria.com.
[21]
Naila Murray, Luca Marchesotti, and Florent Perronnin, "Ava: A large-scale database for aesthetic visual analysis," in CVPR 2012. IEEE, 2012, pp. 2408--2415.
[22]
Wei Luo, Xiaogang Wang, and Xiaoou Tang, "Content-based photo quality assessment," in ICCV 2011. IEEE, 2011, pp. 2206--2213.
[23]
Phillip Isola, Devi Parikh, Antonio Torralba, and Aude Oliva, "Understanding the intrinsic memorability of images," in NIPS, 2011, pp. 2429--2437.

Cited By

View all
  • (2022)Image Aesthetic Assessment: A Comparative Study of Hand-Crafted & Deep Learning ModelsIEEE Access10.1109/ACCESS.2022.320919610(101770-101789)Online publication date: 2022
  • (2019)Facial Action Unit Recognition and Intensity Estimation Enhanced Through Label DependenciesIEEE Transactions on Image Processing10.1109/TIP.2018.287833928:3(1428-1442)Online publication date: 1-Mar-2019
  • (2017)Image aesthetics assessment using Deep Chatterjee's machine2017 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN.2017.7965953(941-948)Online publication date: May-2017

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICMR '15: Proceedings of the 5th ACM on International Conference on Multimedia Retrieval
June 2015
700 pages
ISBN:9781450332743
DOI:10.1145/2671188
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 June 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. aesthetic assessment
  2. bayesian network
  3. multi-label tasks

Qualifiers

  • Short-paper

Funding Sources

  • NSFC

Conference

ICMR '15
Sponsor:

Acceptance Rates

ICMR '15 Paper Acceptance Rate 48 of 127 submissions, 38%;
Overall Acceptance Rate 254 of 830 submissions, 31%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Image Aesthetic Assessment: A Comparative Study of Hand-Crafted & Deep Learning ModelsIEEE Access10.1109/ACCESS.2022.320919610(101770-101789)Online publication date: 2022
  • (2019)Facial Action Unit Recognition and Intensity Estimation Enhanced Through Label DependenciesIEEE Transactions on Image Processing10.1109/TIP.2018.287833928:3(1428-1442)Online publication date: 1-Mar-2019
  • (2017)Image aesthetics assessment using Deep Chatterjee's machine2017 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN.2017.7965953(941-948)Online publication date: May-2017

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media