skip to main content
10.1145/2671188.2749294acmconferencesArticle/Chapter ViewAbstractPublication PagesicmrConference Proceedingsconference-collections
short-paper

Parallel AP Clustering and Re-ranking for Automatic Image-Text Alignment and Large-Scale Web Image Search

Published: 22 June 2015 Publication History

Abstract

In this paper, an automatic image-text alignment algorithm is developed for achieving more accurate indexing and retrieval of large-scale web images. First, large-scale web pages are crawled, where the informative images and their most relevant auxiliary text blocks are extracted. Second, parallel image clustering is performed to partition large-scale informative web images into a large number of clusters. By grouping the visually-similar (near-duplicate) web images into the same cluster, our parallel image clustering algorithm can significantly reduce the huge uncertainty on the relatedness between the web images and their auxiliary text terms, which can provide a good starting point for supporting automatic image-text alignment. Finally, a relevance re-ranking algorithm is developed to identify the most relevant visual text terms for the visually-similar web images in the same cluster. Our experiments on large-scale web images have obtained very positive results.

References

[1]
S. Feng, V. Lavrenko, R. Manmatha, "Multiple Bernoulli relevance models for image and video annotation", ACM SIGIR, 2004.
[2]
T. L. Berg, A. C. Berg, J. Edwards, D. A. Forsyth, "Who's in the picture", NIPS, 2004.
[3]
N. Zhou, J. Fan, "Automatic image-text alignment for large-scale web image indexing and retrieval", Pattern Recognition, vol. 48, no. 1, pp. 205--219, 2015.
[4]
R. Fergus, L. Fei-Fei, P. Perona, A. Zisserman, "Learning object categories from Google's image search", IEEE CVPR, 2006.
[5]
D. Cai, X. He, Z. Li, W.-Y. Ma, J.-R. Wen, "Hierarchical clustering of WWW image search resultsusing visual, textual, and link information", ACM Multimedia, 2004.
[6]
X.-J. Wang, W.-Y. Ma, G.-R. Xue, X. Li, "Multi-modal similarity propagation and its applicationfor web image retrieval", ACM Multimedia, 2004.
[7]
Y. Gao, J. Peng, H. Luo, D.A. Keim, J. Fan, "An interactive approach for filtering out junk images from keyword-based Google search results", IEEE Trans. Circuits Syst. Video Techn., vol. 19, no. 12, pp. 1851--1865, 2009.
[8]
J. Fan, Y. Shen, N. Zhou, Y. Gao, "Harvesting large-scale weakly-tagged image databases from the web", IEEE CVPR, pp. 802--809, 2010.
[9]
P. Pham, M. Moens, T. Tuytelaars, "Cross-media alignment of names and faces", IEEE Trans. on Multimedia, vol. 12, no. 1, 2010.
[10]
B. Frey, D. Dueck, "Clustering by passing messages between data points", Science, vol. 315, pp. 972--976, 2007.
[11]
D. Liu, X.-S, Hua, L. Yang, M. Wang, H.-J. Zhang, "Tag ranking", WWW, 2009.
[12]
Y. Shen, J. Fan, "Leveraging loosely-tagged images and inter-object correlations for tag recommendation." ACM Multimedia, pp.5--14, 2010.
[13]
I. Givoni, C. Chung, B. J. Frey, "Hierarchical affinity propagation", UAI, 2011.
[14]
Y. Jia, J. Wang, C. Zhang, X. S. Hua, "Finding image exemplars using fast sparse affinity propagation", ACM Multimedia, 2008.
[15]
W. Hsu, L. Kennedy, S. F. Chang, "Video search reranking via information bottleneck principle", ACM Multimedia, 2006.
[16]
N. Zhou, Y. Shen, J. Peng, X. Feng, J. Fan, "Leveraging auxiliary text terms for automatic image annotation", WWW, 2011.
[17]
J. Liu, W. Lai, X.-S. Hua, Y. Huang, S. Li, "Video search re-ranking via multi-graph propagation", ACM Multimedia, 2007.
[18]
C. Wang, F. Jing, L. Zhang, H. J. Zhang, "Image annotation refinement using random walk with restarts", ACM Multimedia, 2006.

Cited By

View all
  • (2017)An automatic image-text alignment method for large-scale web image retrievalMultimedia Tools and Applications10.1007/s11042-016-4059-x76:20(21401-21421)Online publication date: 1-Oct-2017

Index Terms

  1. Parallel AP Clustering and Re-ranking for Automatic Image-Text Alignment and Large-Scale Web Image Search

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      ICMR '15: Proceedings of the 5th ACM on International Conference on Multimedia Retrieval
      June 2015
      700 pages
      ISBN:9781450332743
      DOI:10.1145/2671188
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 22 June 2015

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. automatic image-text alignment
      2. parallel image clustering
      3. relevance re-ranking
      4. uncertainty reduction

      Qualifiers

      • Short-paper

      Funding Sources

      • Nature Science Foundation of Fujian Province
      • National Nature Science Foundation of China

      Conference

      ICMR '15
      Sponsor:

      Acceptance Rates

      ICMR '15 Paper Acceptance Rate 48 of 127 submissions, 38%;
      Overall Acceptance Rate 254 of 830 submissions, 31%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)4
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 24 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2017)An automatic image-text alignment method for large-scale web image retrievalMultimedia Tools and Applications10.1007/s11042-016-4059-x76:20(21401-21421)Online publication date: 1-Oct-2017

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media