Skip to main content
SpringerLink
Log in

i-TagRanker: an efficient tag ranking system for image sharing and retrieval using the semantic relationships between tags

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Folksonomy, considered a core component for Web 2.0 user-participation architecture, is a classification system made by user’s tags on the web resources. Recently, various approaches for image retrieval exploiting folksonomy have been proposed to improve the result of image search. However, the characteristics of the tags such as semantic ambiguity and non-controlledness limit the effectiveness of tags on image retrieval. Especially, tags associated with images in a random order do not provide any information about the relevance between a tag and an image. In this paper, we propose a novel image tag ranking system called i-TagRanker which exploits the semantic relationships between tags for re-ordering the tags according to the relevance with an image. The proposed system consists of two phases: 1) tag propagation phase, 2) tag ranking phase. In tag propagation phase, we first collect the most relevant tags from similar images, and then propagate them to an untagged image. In tag ranking phase, tags are ranked according to their semantic relevance to the image. From the experimental results on a Flickr photo collection about over 30,000 images, we show the effectiveness of the proposed system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Notes

  1. Least Common Super-concept of tag i and j

References

  1. Baziz M, Boughanem M, Aussenac-Gilles N (2005) Conceptual indexing based on document content representation. In: Crestani F, Ruthven I (eds) Context: nature, impact, and role, vol 3507. Lecture notes in computer science. Springer Berlin, Heidelberg, pp 2021–2043. doi:10.1007/11495222_14

    Google Scholar 

  2. Benevenuto F, Duarte F, Rodrigues T, Almeida VAF, Almeida JM, Ross KW (2008) Understanding video interactions in youtube. Paper presented at the Proceeding of the 16th ACM international conference on Multimedia, Vancouver, British Columbia, Canada

  3. Budanitsky A, Hirst G (2001) Semantic distance in WordNet: an experimental, application-oriented evaluation of five measures. In: Workshop on Wordnet and Other Lexical Resources, Second Meeting of the North American Chapter of the Association for Computational Linguistics

  4. Chatzichristofis SA, Boutalis YS (2008) FCTH: Fuzzy Color and Texture Histogram - A Low Level Feature for Accurate Image Retrieval. In: Image Analysis for Multimedia Interactive Services, 2008. WIAMIS '08. Ninth International Workshop on. pp 191–196

  5. Chatzichristofis SA, Zagoris K, Boutalis YS, Papamarkos N (2010) Accurate image retrieval based on compact composite descriptors and relevance feedback information. IJPRAI 24(2):207–244. doi:10.1142/S0218001410007890

    Google Scholar 

  6. Chi Z, Yan H, Pham T (1996) Fuzzy algorithms: with applications to image processing and pattern recognition, vol 10. Advances in Fuzzy Systems-Applications and Theory. World Sciencific

  7. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on. pp 886–893 vol. 881

  8. Datta R, Joshi D, Li J, Wang JZ (2008) Image retrieval: ideas, influences, and trends of the new age. ACM Comput Surv 40(2):1–60. doi:10.1145/1348246.1348248

    Article  Google Scholar 

  9. Fellbaum C (1998) Wordnet: an electronic lexical database. MIT Press, Cambridge, MA

    MATH  Google Scholar 

  10. Flickr. http://www.flickr.com

  11. Flickr-Pool (2010) available at http://flickr.com/groups/fruitandveg

  12. Frey BJ, Dueck D (2007) Clustering by passing messages between data points. Science 315:972–976

    Article  MathSciNet  MATH  Google Scholar 

  13. Hirst G, D. S-O (1998) Lexical chains as representations of context for the detection and correction of malapropisms. Fellbaum C. MA: MIT Press

  14. JWNL (2010) available at http://sourceforge.net/projects/jwordnet

  15. JWordNetSim (2010) available at http://nlp.shef.ac.uk/result/software.html

  16. Kasutani E, Yamada A (2001) The MPEG-7 color layout descriptor: a compact image feature description for high-speed image/video segment retrieval. In: Image Processing, 2001. Proceedings. 2001 International Conference on. pp 674–677 vol. 671

  17. Kekäläinen J, Järvelin K (2002) Cumulated gain-based evaluation of IR techniques. ACM Trans Inf Syst 20(4):422–446. doi:10.1145/582415.582418

    Article  Google Scholar 

  18. Leachok C, Chodorow M (1998) Combining local context and WordNet similarity for word sense identification In: Fellbaum C (ed) WordNet: An electronic lexical database. MIT Press

  19. Lee D-H, Kim H-J (2001) A fast content-based indexing and retrieval technique by the shape information in large image database. J Syst Softw 56(2):165–182. doi:10.1016/S0164-1212(00)00095-9

    Article  Google Scholar 

  20. Li X, Snoek CGM, Worring M (2008) Learning tag relevance by neighbor voting for social image retrieval. Paper presented at the Proceeding of the 1st ACM international conference on Multimedia information retrieval, Vancouver, British Columbia, Canada

  21. Li X, Snoek CGM, Worring M (2010) Unsupervised multi-feature tag relevance learning for social image retrieval. Paper presented at the Proceedings of the ACM International Conference on Image and Video Retrieval, Xi'an, China

  22. Lienhart R, Romberg S, Hörster E (2009) Multilayer pLSA for multimodal image retrieval. Paper presented at the Proceeding of the ACM International Conference on Image and Video Retrieval, Santorini, Fira, Greece

  23. Lin D (1998) Automatic retrieval and clustering of similar words. Paper presented at the Proceedings of the 17th international conference on Computational linguistics - Volume 2, Montreal, Quebec, Canada

  24. Lindstaedt S, Morzinger R, Sorschag R, Pammer V, Thallinger G (2009) Automatic image annotation using visual content and folksonomies. Multimed Tool Appl 42(1):97–113. doi:10.1007/s11042-008-0247-7

    Article  Google Scholar 

  25. Liu D, Hua X-S, Wang M, Zhang H-J (2010) Retagging social images based on visual and semantic consistency. Paper presented at the Proceedings of the 19th international conference on World wide web, Raleigh, North Carolina, USA

  26. Liu D, Hua X-S, Yang L, Wang M, Zhang H-J (2009) Tag ranking. Paper presented at the Proceedings of the 18th international conference on World wide web, Madrid, Spain

  27. Mackay WE (1989) EVA: an experimental video annotator for symbolic analysis of video data. SIGCHI Bull 21(2):68–71. doi:10.1145/70609.70617

    Article  Google Scholar 

  28. Monay F, Gatica-Perez D (2004) PLSA-based image auto-annotation: constraining the latent space. Paper presented at the Proceedings of the 12th annual ACM international conference on Multimedia, New York, NY, USA

  29. Ooi BC, Tan K-L, Chua TS, Hsu W (1998) Fast image retrieval using color-spatial information. VLDB J 7(2):115–128. doi:10.1007/s007780050057

    Article  Google Scholar 

  30. Oomoto E, Tanaka K (1993) OVID: design and implementation of a video-object database system. IEEE Trans Knowl Data Eng 5(4):629–643

    Article  Google Scholar 

  31. Park K-W, Jeong J-W, Lee D-H (2007) OLYBIA: ontology-based automatic image annotation system using semantic inference rules. In: Advances in databases: concepts, systems and applications, vol 4443. Lecture notes in computer science. Springer Berlin/Heidelberg, pp 485–496. doi:10.1007/978-3-540-71703-4_42

  32. Pedersen T, Patwardhan S, Michelizzi J (2004) WordNet::Similarity: measuring the relatedness of concepts. Paper presented at the Demonstration Papers at HLT-NAACL 2004, Boston, Massachusetts

  33. Raykar VC, Duraiswami R (2006) Fast optimal bandwidth selection for kernel density estimation. Paper presented at the SIAM International Conference on Data Mining

  34. Resnik P (1998) Semantic similarity in a taxonnomy: an information-based measure and its application to problems of ambiguity in natural language. J Artif Intell Res 11:95–130

    Google Scholar 

  35. Rijsbergen CJV, Robertson SE, Porter MF (1980) New models in probabilistic information retrieval vol 5587. British Library research & development reports British Library Lending Division

  36. Sanchez D, Moreno A (2008) Learning non-taxonomic relationships from web documents for domain ontology construction. Data Knowl Eng 64(3):600–623

    Article  Google Scholar 

  37. Smith JR, Chang S-F (1996) VisualSEEk: a fully automated content-based image query system. Paper presented at the Proceedings of the fourth ACM international conference on Multimedia, Boston, Massachusetts, United States

  38. Wikipedia (2010) available at http://www.wikipedia.org

  39. Wu Z, Palmer M (1994) Verbs semantics and lexical selection. Paper presented at the Proceedings of the 32nd annual meeting on Association for Computational Linguistics, Las Cruces, New Mexico

  40. Xu H, Wang J, Hua X-S, Li S (2009) Tag refinement by regularized LDA. In: ACM Multimedia' 09. pp 573–576

Download references

Acknowledgements

This research was supported by the MKE(The Ministry of Knowledge Economy), Korea and Microsoft Research, under IT/SW Creative research program supervised by the NIPA(National IT Industry Promotion Agency) (NIPA-2010-C1810-1002-0012)

Author information

Authors and Affiliations

  1. KDE Laboratory, Department of Computer Science & Engineering, Hanyang University, Sa-3 dong, Sangrok-gu, Ansan-si, Kyunggi-do, 426-791, Republic of Korea

    Jin-Woo Jeong, Hyun-Ki Hong & Dong-Ho Lee

Authors
  1. Jin-Woo Jeong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hyun-Ki Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dong-Ho Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dong-Ho Lee.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jeong, JW., Hong, HK. & Lee, DH. i-TagRanker: an efficient tag ranking system for image sharing and retrieval using the semantic relationships between tags. Multimed Tools Appl 62, 451–478 (2013). https://doi.org/10.1007/s11042-011-0903-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-011-0903-1

Keywords

Search

Navigation