Skip to main content
SpringerLink
Log in

Adaptive diversification for tag-based social image retrieval

  • Regular Paper
  • Published:
International Journal of Multimedia Information Retrieval Aims and scope Submit manuscript

Abstract

With the great popularity of social photos sharing websites, a tremendous volume of digital images is hosted together with their associated tags. Thus, extensive research efforts have been dedicated to tag-based social image search which enables users to formulate their queries using tags. However, tag queries are often ambiguous and typically short. Diversifying search results is a common solution in the absence of further knowledge about the user’s intention. Such approach aims to retrieve relevant images covering as much of the diverse meanings the query may have. However, not all queries are uniformly ambiguous and hence different diversification strategies might be suggested. In such a context, two new processes are jointly investigated at query pre-processing and post-processing levels. On the one hand, we propose a multi-view concept-based query expansion process, using a predefined list of semantic concepts, which aims to weight concepts from different views or contexts, aggregate the obtained weights and select the most representative ones using a dynamic threshold. On the other hand, we propose a new ranking process called “adaptive diverse relevance ranking” which automatically predicts an effective trade-off between relevance scores and diversity scores according to the query ambiguity level. Thorough experiments using 12 ambiguous queries over the NUS-WIDE dataset show the effectiveness of our approach versus classical uniform diversification approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. http://www.kullin.net/2012/01/instagram-now-growing-faster-than-flickr/.

  2. http://thesocialskinny.com/100-social-media-statistics-for-2012/.

  3. http://instagram.com/press/.

References

  1. Abbasi R (2011) Query expansion in folksonomies. In: Declerck T, Granitzer M, Grzegorzek M, Romanelli M, Rger S, Sintek M (eds) Semantic multimedia. Lecture notes in computer science, vol 6725. Springer, Berlin, pp 1–16

  2. Arampatzis A, Kamps J, Robertson S (2009) Where to stop reading a ranked list? Threshold optimization using truncated score distributions. In: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval, SIGIR ’09. ACM, New York, pp 524–531. doi:10.1145/1571941.1572031

  3. Carbonell J, Goldstein J (1998) The use of mmr, diversity-based reranking for reordering documents and producing summaries. In: Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, SIGIR ’98. ACM, New York. doi:10.1145/290941.291025

  4. Fakhfakh R, Ksibi A, Ben Ammar A, Ben Amar C (2013) Enhancing query interpretation by combining textual and visual analyses. In: Advanced Logistics and Transport (ICALT), 2013 International Conference on, IEEE, pp 170–175

  5. Feki G, Ksibi A, Ammar AB, mar CB (2012) Regimvid at imageclef2012: Improving diversity in personal photo ranking using fuzzy logic. In: ImageCLEF12, pp -1-1

  6. Feki G, Ksibi A, Ben Ammar A, Ben Amar C (2013) Improving image search effectiveness by integrating contextual information. In: Content-Based Multimedia Indexing (CBMI), 2013 11th International Workshop on, IEEE , pp 149–154

  7. Hoque E, Hoeber O, Gong M (2011) Evaluating the trade-offs between diversity and precision for web image search using concept-based query expansion. In: WI-IAT 2011, vol 3, pp 130–133

  8. Hoque E, Hoeber O, Gong M (2012) Balancing the trade-offs between diversity and precision for web image search using concept-based query expansion. J Emerg Technol Web Intell 4(1):26–34

    Google Scholar 

  9. Jin S, Lin H, Su S (2009) Query expansion based on folksonomy tag co-occurrence analysis. In: GrC, pp 300–305

  10. Jing Y, Rowley HA, Wang J, Tsai D, Rosenberg C, Covell M (2012) Google image swirl: a large-scale content-based image visualization system. In: WWW ’2012, ACM, New York, pp 539–540

  11. Kato M, Ohshima H, Oyama S, Tanaka K (2008) Can social tagging improve web image search? In: Web Information Systems Engineering-WISE 2008. Springer, Berlin, pp 235–249

  12. Ksibi A, Ammar AB, Amar CB (2012) Effective concept detection using second order co-occurence flickr context similarity measure socfcs. In: CBMI, pp 1–6

  13. Ksibi A, Ben Ammar A, Ben Amar C (2013) Enhanced context-based query-to-concept mapping in social image retrieval. In: Content-based multimedia indexing (CBMI), 2013 11th International Workshop on, IEEE. pp 85–89

  14. Ksibi A, Dammak M, Ben Ammar A, Mejdoub M, Ben Amar C (2012) Flickr-based semantic context to refine automatic photo annotation. In: Image processing theory, tools and applications (IPTA), 2012 3rd International Conference on, IEEE. pp 377–382

  15. Ksibi A, Feki G, Ammar AB, Amar CB (2013) Effective diversification for ambiguous queries in social image retrieval. Computer analysis of images and patterns. Springer, Berlin, pp 571–578

  16. van Leuken RH, Garcia L, Olivares X, van Zwol R (2009) Visual diversification of image search results. WWW ’09. ACM, New York, pp 341–350

  17. Mejdoub M, Ben Amar C (2013) Classification improvement of local feature vectors over the knn algorithm. Multimedia Tools Appl 64(1): 197–218. doi:10.1007/s11042-011-0900-4

  18. Myoupo D, Popescu A, Le Borgne H, Moëllic PA (2010) Multimodal image retrieval over a large database. In: Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments, CLEF’09. Springer, Berlin, pp 177–184. http://dl.acm.org/citation.cfm?id=1885110.1885135

  19. Radlinski F, Bennett PN, Carterette B, Joachims T (2009) Redundancy, diversity and interdependent document relevance. SIGIR Forum 43(2): 46–52. doi:10.1145/1670564.1670572.

    Google Scholar 

  20. Santos RL, Macdonald C, Ounis I (2010) Exploiting query reformulations for web search result diversification. In: Proceedings of the 19th international conference on World wide web, WWW ’10. ACM, New York, pp 881–890. doi:10.1145/1772690.1772780

  21. Sun A, Bhowmick SS, Nguyen KTN, Bai G (2011) Tag-based social image retrieval: An empirical evaluation. JASIST 62(12):2364–2381

    Article  Google Scholar 

  22. Tang X, Liu K, Cui J, Wen F, Wang X (2012) Intentsearch: capturing user intention for one-click internet image search. IEEE Trans Pattern Anal Mach Intell 34(7):1342–1353. http://doi.ieeecomputersociety.org/10.1109/TPAMI.2011.242

    Google Scholar 

  23. Wang S, Jing F, He J, Du Q, Zhang L (2007) Igroup: presenting web image search results in semantic clusters. In: CHI ’07. ACM, New York, pp. 587–596. doi:10.1145/1240624.1240718

  24. Wei XY, Ngo CW, Jiang YG (2008) Selection of concept detectors for video search by ontology-enriched semantic spaces. Multimedia IEEE Trans 10(6):1085–1096. doi:10.1109/TMM.2008.2001382

    Article  Google Scholar 

  25. Weinberger KQ, Slaney M, Van Zwol R (2008) Resolving tag ambiguity. In: Proceedings of the 16th ACM international conference on Multimedia, MM ’08. ACM, New York, pp 111–120. doi:10.1145/1459359.1459375

  26. Yang K, Wang M, Hua XS, Zhang HJ (2010) Social image search with diverse relevance ranking. MMM’10. Springer, Berlin, pp 174–184

Download references

Author information

Authors and Affiliations

  1. Research Groups on Intelligent Machines, University of Sfax, BP 1173, Sfax, 3038, Tunisia

    Amel Ksibi, Anis Ben Ammar & Chokri Ben Amar

Authors
  1. Amel Ksibi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anis Ben Ammar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chokri Ben Amar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Amel Ksibi.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ksibi, A., Ben Ammar, A. & Ben Amar, C. Adaptive diversification for tag-based social image retrieval. Int J Multimed Info Retr 3, 29–39 (2014). https://doi.org/10.1007/s13735-013-0045-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13735-013-0045-5

Keywords

Search

Navigation