Marchenko Yelizaveta
ABSTRACT
Many recent studies perform annotation of paintings based on brushwork. In these studies the brushwork is modeled indirectly as part of the annotation of high-level artistic concepts such as the artist name using low-level texture. In this paper, we develop a serial multi-expert framework for explicit annotation of paintings with brushwork classes. In the proposed framework, each individual expert implements transductive inference by exploiting both labeled and unlabelled data. To minimize the problem of noise in the feature space, the experts select appropriate features based on their relevance to the brushwork classes. The selected features are utilized to generate several models to annotate the unlabelled patterns. The experts select the best performing model based on Vapnik combined bound. The transductive annotation using multiple experts out-performs the conventional baseline method in annotating patterns with brushwork classes.
- Chua T.-S., Lim S.-K., Pung H.-K. "Content-based retrieval of segmented images". ACM MM, 211--218, 1994. Google Scholar
Digital Library
- El-Yaniv, R., and Gerzon, L. Effective Transductive Learning via PAC-Bayesian Model Selection. Technical Report CS-2004-05, IIT, 2004.Google Scholar
- Friedman J. H., An overview of predictive learning and function approximation, From Statistics to Neural Networks, Springer Verlag, NATO/ASI, 1-61,1994.Google Scholar
- Herik, H.J. van den, Postma, E.O. Discovering the Visual Signature of Painters. In Future Directions for Intelligent Systems and Information Sciences, 129--147, 2000.Google Scholar
- Imam, I.F., Michalski, R.S., and Kerschberg, L. "Discovering Attribute Dependence in Databases by Integrating Symbolic Learning and Statistical Analysis Techniques", AAAI Workshop on Knowledge Discovery in DB, 1993.Google Scholar
- Kaplan L. M. and Kuo C.-C. J., "Texture roughness analysis and synthesis via extended self-similar (ESS) model," IEEE Trans. Pattern Anal. Machine Intell (17), 1043--1056, 1995. Google ScholarDigital Library
- Li J., Wang J. Z. Studying Digital Imagery of Ancient Paintings by Mixtures of Stochastic Models, IEEE Trans. on Image Proc, vol. 13 (3), 2004. Google ScholarDigital Library
- Manjunath B. S., Ma W. Y., "Texture features for browsing and retrieval of image data," IEEE Trans. Pattern Anal. Machine Intell (18), 837--842, 1996. Google ScholarDigital Library
- Marchenko Y., Chua T.-S., Aristarkhova I., Jain R. Representation and Retrieval of Paintings based on Art History Concepts. IEEE Int'l Conf. on Multimedia and Expo (ICME), 2004.Google Scholar
- Marchenko Y., Chua T.-S., Aristarkhova I., Analysis of paintings using Color Concepts. IEEE Int'l Conf. on Mm and Expo (ICME), 2005.Google Scholar
- Marchenko Y., Chua T.-S., Jain R., Semi-supervised Annotation of Brushwork in Painting Domain using Serial Combinations of Multiple Experts, Technical Report, NUS, Singapore, 2006.Google Scholar
- Rahman A. F. R, Fairhurst M. C: Serial Combination of Multiple Experts: A Unified Evaluation. Pat. Anal. Appl. 2(4), 292--311, 1999.Google Scholar
- Schueermann J, Doster W. A decision theoretic approach to hierarchical classifier design. Pattern Recognition; 17(3), 359--369, 1983. Google ScholarDigital Library
- Teague, M.R. Image Analysis via the General Theory of Moments, Journal of the Optical Society of America, 70 (8), 920--930.Google ScholarCross Ref
- Vapnik, V. Estimation of Dependences Based on Empirical Data. Springer Verlag, New York, 1982. Google ScholarDigital Library
Index Terms
- Transductive inference using multiple experts for brushwork annotation in paintings domain
Recommendations
Semi-supervised annotation of brushwork in paintings domain using serial combinations of multiple experts
MM '06: Proceedings of the 14th ACM international conference on MultimediaMany recent studies perform annotation of paintings based on brushwork. They model the brushwork indirectly as part of annotation of high-level artistic concepts such as artist name using low-level texture features and supervised inference methods. In ...
Auto-annotation of paintings using social annotations,domain ontology and transductive inference
PCM'07: Proceedings of the multimedia 8th Pacific Rim conference on Advances in multimedia information processingKnowledge of paintings domain includes a variety of sources such as essays, visual examples, ontologies of artistic concepts and user- provided annotations. This knowledge serves several purposes. First, it defines a wide range of concepts for ...
Ontology-based annotation of paintings using transductive inference framework
MMM'07: Proceedings of the 13th international conference on Multimedia Modeling - Volume Part IDomain-specific knowledge of paintings defines a wide range of concepts for annotation and flexible retrieval of paintings. In this work, we employ the ontology of artistic concepts that includes visual (or atomic) concepts at the intermediate level and ...
Comments