Abstract
Many research have been focusing on how to match the textual query with visual images and their surrounding texts or tags for Web image search. The returned results are often unsatisfactory due to their deviation from user intentions. In this paper, we propose a novel image ranking approach to web image search, in which we use social data from social media platform jointly with visual data to improve the relevance between returned images and user intentions (i.e., social relevance). Specifically, we propose a community-specific Social-Visual Ranking(SVR) algorithm to rerank the Web images by taking social relevance into account. Through extensive experiments, we demonstrated the importance of both visual factors and social factors, and the effectiveness and superiority of the social-visual ranking algorithm for Web image search.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Broder, A., Kumar, R., Maghoul, F., Raghavan, P., Rajagopalan, S., Stata, R., Tomkins, A., Wiener, J.: Graph structure in the web. Computer Networks 33(1-6), 309–320 (2000)
Järvelin, K., Kekäläinen, J.: Ir evaluation methods for retrieving highly relevant documents. In: Proceedings of the 23rd Annual International ACM SIGIR, SIGIR 2000, pp. 41–48. ACM, New York (2000)
Jing, Y., Baluja, S.: Visualrank: Applying pagerank to large-scale image search. IEEE Transactions on Pattern Analysis and Machine Intelligence 30(11), 1877–1890 (2008)
Kondor, R.I., Lafferty, J.: Diffusion kernels on graphs and other discrete structures. In: Proceedings of the ICML, pp. 315–322 (2002)
Larson, M., Kofler, C., Hanjalic, A.: Reading between the tags to predict real-world size-class for visually depicted objects in images. In: Proceedings of the 19th ACM Multimedia, MM 2011, pp. 273–282. ACM, New York (2011)
Li, X., Snoek, C.G., Worring, M.: Learning tag relevance by neighbor voting for social image retrieval. In: Proceedings of the 1st ACM Multimedia Information Retrieval, MIR 2008, pp. 180–187. ACM, New York (2008)
Liu, J., Lai, W., Hua, X.-S., Huang, Y., Li, S.: Video search re-ranking via multi-graph propagation. In: Proceedings of the 15th Multimedia, MULTIMEDIA 2007, pp. 208–217. ACM, New York (2007)
Liu, Y., Mei, T., Hua, X.-S.: Crowdreranking: exploring multiple search engines for visual search reranking. In: Proceedings of the 32nd International ACM SIGIR, SIGIR 2009, pp. 500–507. ACM, New York (2009)
Nister, D., Stewenius, H.: Scalable recognition with a vocabulary tree. In: Computer Vision and Pattern Recognition, vol. 2, pp. 2161–2168 (2006)
Page, L., Brin, S., Motwani, R., Winograd, T.: The pagerank citation ranking: Bringing order to the web. Technical Report 1999-66, Stanford InfoLab (November 1999) (previous)
Park, L.A.F., Ramamohanarao, K.: Mining web multi-resolution community-based popularity for information retrieval. In: Proceedings of the Sixteenth ACM CIKM, CIKM 2007, pp. 545–554. ACM, New York (2007)
Sang, J., Liu, J., Xu, C.: Exploiting user information for image tag refinement. In: Proceedings of the 19th ACM Multimedia, MM 2011, pp. 1129–1132. ACM, New York (2011)
Wang, M., Ni, B., Hua, X.-S., Chua, T.-S.: Assistive tagging: A survey of multimedia tagging with human-computer joint exploration. ACM Comput. Surv. 44(4), 25:1–25:24 (2012)
Wang, M., Yang, K., Hua, X.-S., Zhang, H.-J.: Towards a relevant and diverse search of social images. IEEE Transactions on Multimedia 12(8), 829–842 (2010)
Zhang, S., Huang, Q., Hua, G., Jiang, S., Gao, W., Tian, Q.: Building contextual visual vocabulary for large-scale image applications. In: Proceedings of Multimedia, MM 2010, pp. 501–510. ACM, New York (2010)
Zhou, W., Lu, Y., Li, H., Song, Y., Tian, Q.: Spatial coding for large scale partial-duplicate web image search. In: Proceedings of Multimedia, MM 2010, pp. 511–520. ACM, New York (2010)
Zhou, W., Tian, Q., Lu, Y., Yang, L., Li, H.: Latent visual context learning for web image applications. Pattern Recognition 44(10-11), 2263–2273 (2011); Semi-Supervised Learning for Visual Content Analysis and Understanding
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, S., Cui, P., Luan, H., Zhu, W., Yang, S., Tian, Q. (2013). Social Visual Image Ranking for Web Image Search. In: Li, S., et al. Advances in Multimedia Modeling. MMM 2013. Lecture Notes in Computer Science, vol 7732. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35725-1_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-35725-1_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35724-4
Online ISBN: 978-3-642-35725-1
eBook Packages: Computer ScienceComputer Science (R0)