Welcome to the InfoSci Platform
Annotating Images by Mining Image Search

Annotating Images by Mining Image Search

Xin-Jing Wang, Lei Zhang, Xirong Li, Wei-Ying Ma
Copyright: © 2009 |Pages: 27
ISBN13: 9781605661889|ISBN10: 1605661880|EISBN13: 9781605661896
DOI: 10.4018/978-1-60566-188-9.ch014
Cite Chapter Cite Chapter

MLA

Wang, Xin-Jing, et al. "Annotating Images by Mining Image Search." Semantic Mining Technologies for Multimedia Databases, edited by Dacheng Tao, et al., IGI Global, 2009, pp. 323-349. https://doi.org/10.4018/978-1-60566-188-9.ch014

APA

Wang, X., Zhang, L., Li, X., & Ma, W. (2009). Annotating Images by Mining Image Search. In D. Tao, D. Xu, & X. Li (Eds.), Semantic Mining Technologies for Multimedia Databases (pp. 323-349). IGI Global. https://doi.org/10.4018/978-1-60566-188-9.ch014

Chicago

Wang, Xin-Jing, et al. "Annotating Images by Mining Image Search." In Semantic Mining Technologies for Multimedia Databases, edited by Dacheng Tao, Dong Xu, and Xuelong Li, 323-349. Hershey, PA: IGI Global, 2009. https://doi.org/10.4018/978-1-60566-188-9.ch014

Export Reference

Mendeley
Favorite

Abstract

Although it has been studied for years by computer vision and machine learning communities, image annotation is still far from practical. In this chapter, the authors propose a novel attempt of modeless image annotation, which investigates how effective a data-driven approach can be, and suggest annotating an uncaptioned image by mining its search results. The authors collected 2.4 million images with their surrounding texts from a few photo forum Web sites as our database to support this data-driven approach. The entire process contains three steps: (1) the search process to discover visually and semantically similar search results; (2) the mining process to discover salient terms from textual descriptions of the search results; and (3) the annotation rejection process to filter noisy terms yielded by step 2. To ensure real time annotation, two key techniques are leveraged – one is to map the high dimensional image visual features into hash codes, the other is to implement it as a distributed system, of which the search and mining processes are provided as Web services. As a typical result, the entire process finishes in less than 1 second. Since no training dataset is required, our proposed approach enables annotating with unlimited vocabulary, and is highly scalable and robust to outliers. Experimental results on real Web images show the effectiveness and efficiency of the proposed algorithm.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.