Abstract
Domain-specific knowledge of paintings defines a wide range of concepts for annotation and flexible retrieval of paintings. In this work, we employ the ontology of artistic concepts that includes visual (or atomic) concepts at the intermediate level and high-level concepts at the application level. Visual-level concepts include artistic color and brushwork concepts that serve as cues for annotating high-level concepts such as the art periods for paintings. To assign artistic color concepts, we utilize inductive inference method based on probabilistic SVM classification. For brushwork annotation, we employ previously developed transductive inference framework that utilizes multi-expert approach, where individual experts implement transductive inference by exploiting both labeled and unlabelled data. In this paper, we combine the color and brushwork concepts with low-level features and utilize a modification of the transductive inference framework to annotate art period concepts to the paintings collection. Our experiments on annotating art period concepts demonstrate that: a) the use of visual-level concepts significantly improves the accuracy as compared to using low-level features only; and b) the proposed framework out-performs the conventional baseline method.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Canaday, J.: Mainstreams of Modern Art. Saunders College Publishing (1981)
Chua, T.-S., Lim, S.-K., Pung, H.-K.: Content-based retrieval of segmented images. In: ACM MM, pp. 211–218 (1994)
Corridoni, J.M., Del Bimbo, A., Pala, P.: Retrieval of Paintings Using Effects Induced by Color Features. In: CAIVD, pp. 2–11 (1998)
El-Yaniv, R., Gerzon, L.: Effective Transductive Learning via PAC-Bayesian Model Selection. Technical Report CS-2004-05, IIT (2004)
Friedman, J.H.: An overview of predictive learning and function approximation. In: Statistics to Neural Networks. NATO/ASI, pp. 1–61. Springer, Heidelberg (1994)
Herik, H.J., van den Postma, E.O.: Discovering the Visual Signature of Painters. In: Future Directions for Intelligent Systems and Information Sciences, pp. 129–147 (2000)
Itten, J.: The Art of Color. Reinhold Pub. Corp., NY (1961)
Kaplan, L.M., Kuo, C.-C.J.: Texture roughness analysis and synthesis via extended self-similar (ESS) model. IEEE Trans. Pattern Anal. Machine Intell., 1043–1056 (1995)
Li, J., Wang, J.Z.: Studying Digital Imagery of Ancient Paintings by Mixtures of Stochastic Models. IEEE Trans. on Image Proc. 13(3) (2004)
Low, W.-C., Chua, T.-S.: Color-Based Relevance Feedback for Image Retrieval. In: IW-MMDBMS, pp. 116–123 (1998)
Manjunath, B.S., Ma, W.Y.: Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Machine Intell. (18), 837–842 (1996)
Marchenko, Y., Chua, T.-S., Aristarkhova, I., Jain, R.: Representation and Retrieval of Paintings based on Art History Concepts. In: IEEE Int’l Conf. on Multimedia and Expo (ICME) (2004)
Marchenko, Y., Chua, T.-S., Aristarkhova, I.: Analysis of paintings using Color Concepts. In: IEEE Int’l Conf. on Mm and Expo (ICME) (2005)
Marchenko, Y., Chua, T.-S., Jain, R.: Semi-supervised Annotation of Brushwork in Painting Domain using Serial Combinations of Multiple Experts. ACM Multimedia (2006)
Marchenko, Y., Chua, T.-S., Jain, R.: Transductive Inference Using Multiple Experts for Brushwork Annotation in Paintings Domain. ACM Multimedia (2006)
Paul Getty Trust. Art and Architecture Thesauri and United List of Artist names (2000), available at http://www.getty.edu/research/conducting_research/vocabularies/
Teague, M.R.: Image Analysis via the General Theory of Moments. Journal of the Optical Society of America 70(8), 920–930
Vapnik, V.: Estimation of Dependences Based on Empirical Data. Springer, New York (1982)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Marchenko, Y., Chua, TS., Jain, R. (2006). Ontology-Based Annotation of Paintings Using Transductive Inference Framework. In: Cham, TJ., Cai, J., Dorai, C., Rajan, D., Chua, TS., Chia, LT. (eds) Advances in Multimedia Modeling. MMM 2007. Lecture Notes in Computer Science, vol 4351. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69423-6_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-69423-6_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69421-2
Online ISBN: 978-3-540-69423-6
eBook Packages: Computer ScienceComputer Science (R0)