Abstract
Existing automatic image annotation (AIA) models that depend solely on low-level image features often produce poor results, particularly when annotating real-life collections. Tag co-occurrence has been shown to improve image annotation by identifying additional keywords associated with user-provided keywords. However, existing approaches have treated tag co-occurrence as a static measure over time, thereby ignoring the temporal trends of many tags. The temporal distribution of tags, however, caused by events, seasons, memes, etc. provide a strong source of evidence beyond keywords for AIA. In this paper we propose a temporal tag co-occurrence approach to improve upon the current state-of-the-art automatic image annotation model. By replacing the annotated tags with more temporally significant tags, we achieve statistically significant increases to annotation accuracy on a real-life timestamped image collection from Flickr.
This research was supported by the the European Community’s FP7 Programme under grant agreements nr 288024 (LiMoSINe).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Athanasakos, K., Stathopoulos, V., Jose, J.M.: A Framework for Evaluating Automatic Image Annotation Algorithms. In: Gurrin, C., He, Y., Kazai, G., Kruschwitz, U., Little, S., Roelleke, T., Rüger, S., van Rijsbergen, K. (eds.) ECIR 2010. LNCS, vol. 5993, pp. 217–228. Springer, Heidelberg (2010)
Smeulders, A., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years 22(12), 1349–1380 (2000)
Santini, S., Gupta, A., Jain, R.: Emergent semantics through interaction in image databases 13(3), 337–351 (2001)
Monaghan, F., O’Sullivan, D.: Leveraging Ontologies, Context and Social Networks to Automate Photo Annotation. In: Falcidieno, B., Spagnuolo, M., Avrithis, Y., Kompatsiaris, I., Buitelaar, P. (eds.) SAMT 2007. LNCS, vol. 4816, pp. 252–255. Springer, Heidelberg (2007)
Li, W., Sun, M.: Automatic Image Annotation Based on WordNet and Hierarchical Ensembles. In: Gelbukh, A. (ed.) CICLing 2006. LNCS, vol. 3878, pp. 417–428. Springer, Heidelberg (2006)
Sigurbjörnsson, B., van Zwol, R.: Flickr tag recommendation based on collective knowledge. In: WWW 2008, pp. 327–336. ACM, New York (2008)
Allan, J.: Topic detection and tracking, pp. 1–16. Kluwer Academic Publishers, Norwell (2002)
Whiting, S., Moshfeghi, Y., Jose, J.M.: Exploring term temporality for pseudo-relevance feedback. In: SIGIR 2011, pp. 1245–1246. ACM, New York (2011)
Cattuto, C., Benz, D., Hotho, A., Stumme, G.: Semantic Grounding of Tag Relatedness in Social Bookmarking Systems. In: Sheth, A.P., Staab, S., Dean, M., Paolucci, M., Maynard, D., Finin, T., Thirunarayan, K. (eds.) ISWC 2008. LNCS, vol. 5318, pp. 615–631. Springer, Heidelberg (2008)
Jin, S., Lin, H., Su, S.: Query expansion based on folksonomy tag co-occurrence analysis, 300–305 (August 2009)
Yao, J., Cui, B., Huang, Y., Zhou, Y.: 2010 IEEE 26th International Conference on Data Engineering (ICDE), pp. 780–783 (March 2010)
Byde, A., Cayzer, S.: Personalized tag recommendations via tagging and content-based similarity metrics, New York (2) (2007)
Duygulu, P., Barnard, K., de Freitas, J.F.G., Forsyth, D.: Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part IV. LNCS, vol. 2353, pp. 97–112. Springer, Heidelberg (2002)
Jeon, J., Lavrenko, V., Manmatha, R.: Automatic image annotation and retrieval using cross-media relevance models. In: SIGIR 2003, NY, USA, pp. 119–126 (2003)
Lavrenko, V., Choquette, M., Croft, W.B.: Cross-lingual relevance models. In: SIGIR 2002, pp. 175–182. ACM, New York (2002)
Lavrenko, V., Manmatha, R., Jeon, J.: A model for learning the semantics of pictures. In: NIPS. MIT Press (2003)
Carneiro, G., Chan, A.B., Moreno, P.J., Vasconcelos, N.: Supervised learning of semantic classes for image annotation and retrieval. IEEE Transactions 29 (2007)
Makadia, A., Pavlovic, V., Kumar, S.: Baselines for image annotation. Int. J. Comput. Vision 90(1), 88–105 (2010)
Llorente, A., Manmatha, R., Rüger, S.: Image retrieval using markov random fields and global image features. In: CIVR 2010, pp. 243–250. ACM, NY (2010)
Kleinberg, J.: Bursty and hierarchical structure in streams. In: KDD 2002, pp. 91–101. ACM, New York (2002)
Leskovec, J., Backstrom, L., Kleinberg, J.: Meme-tracking and the dynamics of the news cycle. In: KDD 2009, pp. 497–506. ACM, New York (2009)
Garg, N., Weber, I.: Personalized, interactive tag recommendation for flickr. In: RecSys, pp. 67–74 (2008)
Miller, G.A.: Wordnet: A lexical database for english. Communications of the ACM 38, 39–41 (1995)
Sigurbjörnsson, B., van Zwol, R.: Flickr tag recommendation based on collective knowledge. In: WWW, pp. 327–336 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
McParlane, P.J., Jose, J.M. (2013). Exploiting Time in Automatic Image Tagging. In: Serdyukov, P., et al. Advances in Information Retrieval. ECIR 2013. Lecture Notes in Computer Science, vol 7814. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36973-5_44
Download citation
DOI: https://doi.org/10.1007/978-3-642-36973-5_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-36972-8
Online ISBN: 978-3-642-36973-5
eBook Packages: Computer ScienceComputer Science (R0)