Abstract
How to retrieve a required image from tens of thousands of images is challenging task. In this paper, we proposed a novel semantic context model for automatic annotation with context and spatial information. We reconstructed the image annotation as a multi-class classification problem and assign each object a label considering each object as an individual in both learning and annotation stage. And then, the class distribution of query region is estimated using Gaussian mixture model whose parameters are learned by expectation maximum algorithm. The posterior probabilities of all the concepts are obtained according to modified Bayesian rule. In the experiment, we conduct the performance evaluation on LabelMe image databases including 2651 images and 25653 regions. The experimental results illustrated that our proposed model effectively improve the performance of image annotation system, and the context information and height information could improve the precision of image annotation separately.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Zhang, D., Islam, M.M., Lu, G.: A review on automatic image annotation techniques. Pattern Recogn. 45(1), 346–362 (2012)
Tao, D., Cheng, J., Gao, X., Li, X., Deng, C.: Robust sparse coding for mobile image labeling on the cloud. IEEE Trans. Circuits Syst. Video Technol. 27(1), 62–72 (2017)
Carneiro, G., Chan, A., Moreno, P., Vasconcelos, N.: Supervised learning of semantic classes for image annotation and retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 29(3), 394–410 (2007)
Uricchio, T., Ballan, L., Seidenari, L., Del Bimbo, A.: Automatic image annotation via label transfer in the semantic space. Pattern Recogn. 71, 144–157 (2017)
Zhang, J., Wu, Q., Shen, C., Zhang, J., Lu, J.: Multi-label image classification with regional latent semantic dependencies, pp. 1–11 (2016). arXiv preprint arXiv:1612.01082
Liu, C., Yuen, J., Torralba, A.: Nonparametric scene parsing: label transfer via dense scene alignment. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 1972–1979. IEEE (2009)
Vatani, A., Ahvanooey, M.T., Rahimi, M.: An effective automatic image annotation model via attention model and data equilibrium. order 9(03) (2018)
Li, J., Wang, J.: Real-time computerized annotation of pictures. IEEE Trans. Pattern Anal. Mach. Intell. 30(6), 985–1002 (2008)
Shi, F., Wang, J., Wang, Z.: Region-based supervised annotation for semantic image retrieval. AEU-Int. J. Electron. Commun. 65(11), 929–936 (2011)
Torralba, A., Murphy, K., Freeman, W., Rubin, M.: Context-based vision system for place and object recognition. In: 2003 Proceedings of the Ninth IEEE International Conference on Computer Vision, pp. 273–280. IEEE (2003)
Acknowledgments
This research was supported by the National Natural Science Foundation of China (Grant No. 41701521, 41771436), A Project of Shandong Province Higher Educational Science and Technology Program (Grant No. J15LH08) and Shandong Provincial Natural Science Foundation, China (Grant No. ZR2018LF005). We also thank the anonymous referees for their helpful comments and suggestions.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Fu, X., Wang, D., Niu, S., Zhang, H. (2018). A Semantic Context Model for Automatic Image Annotation. In: Huang, DS., Jo, KH., Zhang, XL. (eds) Intelligent Computing Theories and Application. ICIC 2018. Lecture Notes in Computer Science(), vol 10955. Springer, Cham. https://doi.org/10.1007/978-3-319-95933-7_62
Download citation
DOI: https://doi.org/10.1007/978-3-319-95933-7_62
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-95932-0
Online ISBN: 978-3-319-95933-7
eBook Packages: Computer ScienceComputer Science (R0)