Abstract
State of the art image tagging systems are limited because they allow users to annotate image tags in noun form, which cannot fully express the semantics of image content. In this paper, we propose Linked Tag, a semi-automatic image annotation system that inserts semantic relationships between tags. The proposed annotation method connects image tags using predicate words that can capture the contexts in which the image tags are used. In particular, we exploit Linked Data such as DBPedia in order to connect the image tags with a property value. Compared with tag-based annotation and ontology-based annotation systems, Linked Tag eliminates a large amount of manual labor and enhances the semantic expression of image content. We also introduce two annotation-based applications on Linked Tag. First, we propose SPARQL query processing for image retrieval, which enables us to express visual appearance as well as semantic information. Second, we propose a novel tag-ranking algorithm based on the link analysis in the RDF annotation graph. Finally, we demonstrate the operation of our proposed system and analyze its efficacy.









Similar content being viewed by others
References
Bizer C, Heath T, Berners-Lee T (2009) Linked data – the story so far. Int J Semant Web Inf 5(3):1–22
Bizer C, Lehmann J, Kobilarov G, Auer S, Becker C, Cyganiak R, Hellmann S (2009) DBPedia – A crystallization point for the web of data. J Web Semant 7:154–165
Carroll J, Bizer C, Hayes P, Stickler P (2011) Named graphs. J Web Semant 3(4):247–267
Chen N, Zhou Q-Y, Prasanna V (2012) Understanding web images by object relation network. In: Proceedings of 21st international conference on world wide web. Lyon, pp 291–300
Fadzi S, Setchi R (2010) Semantic approach to image retrieval using statistical models based on a lexical ontology. In: Proceedings of knowledge-based and intelligent information & engineering system. Cardiff, pp 240–250
Hollink L, Schreiber G, Wielemaker J, Wielinga B (2003) Semantic annotation of image collections. In: Proceedings of KCAP. New York, pp 41–48
Im D-H, Park G-D (2013) STAG: semantic image annotation using relationships between tags. In: Proceedings of IEEE ICISA. Pattaya, pp 571–572
Jarvelin K, Kekalainen J (2002) Cumulated gain-based evaluation of IR techniques. ACM Trans Inf Syst 20(4):422–446
Jeong J-W, Hong H-K, Lee D-H (2013) i-TagRanker: an efficient tag ranking system for image sharing and retrieval using the semantic relationships between tags. Multimed Tool Appl 62:451–478
Khan L (2007) Standards for image annotation using semantic web. Comput Stand Inter 29(2):196–204
Kleinberg JM (1999) Authoritative sources in a hyperlinked environment. J ACM 46(5):604–632
Klyne G, Carroll JJ (2004) Resource description framework (RDF): concepts and abstract syntax. http://w3c.org/TR/rdf-concepts/, W3C Recommendation
Lancker W, Deursen D, Verborgh R, Walle R (2013) Semantic media decision taking using N3Logic. Multimed Tool Appl 63:7–26
Lee K, Kim H, Jang C, Kim H-J (2008) FolksoViz: a subsumption-based folksonomy visualization using wikipedia texts. In: Proceedings of 17th international conference on world wide web. Beijing, pp 1093–1094
Lee S-H, Jang G-H, Lee S-H, Jung S-H, Woo Y-T (1997) A content-based image retrieval system using extended SQL in RDBMS. In: Proceedings of ICICS. Singapore, pp 1069–1072
Lindstaedt S, Morzinger R, Sorschag R, Pammer V, Thallinger G (2009) Automatic image annotation using visual content and folksonomies. Multimed Tool Appl 42(1):97–113
Magesh N, Thangaraj P (2011) Semantic image retrieval based on ontology and SPARQL query. In: Proceedings of ICACT. Pyeongchang, pp 12–16
Overell S, Sigurbjornsson B, Zwol R (2009) Classifying tags using open content resources. In: Proceedings of the 2nd ACM conference on web search and data mining. Barcelona, pp 64–73
Prud’hommeaux E, Seaborne A (2008) SPARQL query language for RDF. http://w3c.org/TR/rdf-sparql-query/, W3C Recommendation
Sun A, Bhowmick S, Nguyen T, Ba G (2011) Tag-based social image retrieval: an emprirical evaluation. J Am Soc Inf Sci Tec 62(12):2364–2381
Toupikov N, Umbrich J, Delbru R, Hausenblas M, Tummarello G (2009) DING! Dataset ranking using formal descriptions. In: Proceedings of the www 2009 workshop on linked data on the web (LDOW2009). Mardrid
Yang J, Matsuo Y, Ishizuka M (2007) Triple tagging: toward bridging folksonomy and semantic web. In: Proceedings of ISWC. Pusan, p 14
Yeung C, Gibbins N, Shadbolt N (2009) Contextualising tags in collaborative tagging systems. In: Proceedings of the 20th ACM conference on hypertext and hypermedia. Torino, pp 251–260
Zhang X, Li Z, Chao L (2013) Improving image tags by exploiting web search results. Multimed Tool Appl 62:601–631
Acknowledgments
This work was supported by a National Research Foundation of Korea (NRF) grant funded by the Korea government (MEST) (No. NRF-2009-0078828).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Im, DH., Park, GD. Linked tag: image annotation using semantic relationships between image tags. Multimed Tools Appl 74, 2273–2287 (2015). https://doi.org/10.1007/s11042-014-1855-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-014-1855-z