Zheng-Jun Zha
Xian-Sheng Hua
Abstract
Query suggestion is an effective approach to bridge the Intention Gap between the users' search intents and queries. Most existing search engines are able to automatically suggest a list of textual query terms based on users' current query input, which can be called Textual Query Suggestion. This article proposes a new query suggestion scheme named Visual Query Suggestion (VQS) which is dedicated to image search. VQS provides a more effective query interface to help users to precisely express their search intents by joint text and image suggestions. When a user submits a textual query, VQS first provides a list of suggestions, each containing a keyword and a collection of representative images in a dropdown menu. Once the user selects one of the suggestions, the corresponding keyword will be added to complement the initial query as the new textual query, while the image collection will be used as the visual query to further represent the search intent. VQS then performs image search based on the new textual query using text search techniques, as well as content-based visual retrieval to refine the search results by using the corresponding images as query examples. We compare VQS against three popular image search engines, and show that VQS outperforms these engines in terms of both the quality of query suggestion and the search performance.
- Beeferman, D. and Berger, A. 2000. Agglomerative clustering of a search engine query log. In Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 407--416. Google Scholar
Digital Library
- Ben-Hur, A., Horn, D., Siegelmann, H., and Vapnik, V. 2001. Support vector clustering. J. Amer. Soc. Inform. Sci. Techn. 2, 125--137.Google Scholar
- Boyd, S. and Vandenberghe, L. 2004. Convex Optimization. Cambridge University Press. Google ScholarDigital Library
- Carpineto, C., de Mori, R., Romano, G., and Bigi, B. 2001. An information-theoretic approach to automatic query expansion. ACM Trans. Inform. Syst. 19, 1, 1--27. Google ScholarDigital Library
- Cui, J., Wen, F., and Tang, X. 2008. Real time goggle and live image search re-ranking. In Proceedings of the ACM Conference on Multimedia. 729--732. Google ScholarDigital Library
- Datta, R., Joshi, D., Li, J., and Wang, J. Z. 2008. Image retrieval: ideas influence, and trends of the new age. ACM Comput. Surv. Google ScholarDigital Library
- Fisher, R. A. 1970. Statistical Methods for Research Workers. Macmillan.Google Scholar
- Fonseca, B. M., Golgher, P., Possas, B., Ribeiro-Neto, B., and Ziviani, N. 2005. Concept-based interactive query expansion. In Proceedings of the ACM Conference on Information and Knowledge Management. 696--703. Google ScholarDigital Library
- Frey, B. and Dueck, D. 2007. Clustering by passing messages between data points. Science 315, 5814.Google ScholarCross Ref
- Gerrig, R. J. and Zimbardo, P. G. 2001. Psychology and Life 16 Ed. Allyn & Bacon.Google Scholar
- Heesch, D. and Rger, S. 2004. Nnk networks for content-based image retrieval. In Proceedings of European Conference on Information Retrieval.Google Scholar
- Hsu, W., Kennedy, L., and Chang, S.-F. 2006. Video search reranking via information bottleneck principle. In Proceedings of ACM Multimedia. Google ScholarDigital Library
- Huang, C.-K., Chien, L.-F., and Oyang, Y.-J. 2003. Relevant term suggestion in interactive web search based on contextual information in query session logs. J. Amer. Soc. Inform. Sci. Techn. 54, 7, 638--649. Google ScholarDigital Library
- Jarvelin, K. and Kekalainen, J. 2000. Ir evaluation methods for retrieving highly relevant documents. In Proceedings of the ACM SIGKDD Conference on Research and Development in Information Retrieval. 41--48. Google ScholarDigital Library
- Jia, Y., Wang, J., Zhang, C., and Hua, X.-S. 2008. Finding image exemplars using fast sparse affinity propagation. In Proceedings of ACM Multimedia. Google ScholarDigital Library
- Jones, R., Rey, B., Madani, O., and Greiner, W. 2006. Generating query substitutions. In Proceedings of the International Conference on World Wide Web. 387--396. Google ScholarDigital Library
- Kullback, S. and Leibler, R. A. 1951. On information and sufficiency. Ann. Math. Stat. 22, 1, 79--86.Google ScholarCross Ref
- Lam-Adesina, A. M. and Jones, G. J. F. 2001. Applying summarization techniques for term selection in relevance feedback. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval. 1--9. Google ScholarDigital Library
- Lew, M. S., Sebe, N., Djeraba, C., and Jain, R. 2006. Content-based multimedia information retrieval: State of the art and challenges. ACM Trans. Multimed. Comput. Comm. Appl. Google ScholarDigital Library
- Liu, Y., Mei, T., and Hua, X.-S. 2009. Crowdreranking:exploring multiple search engines for visual search reranking. In Proceedings of the ACM Conference on Research and Development in Information Retrieval. Google ScholarDigital Library
- Ricardo, B.-Y., Carlos, H., and Marcelo, M. 2004. Query recommendation using query logs in search engines. In Proceedings of the International Conference on Extending Database Technology.Google Scholar
- Sigurbjornsson, B. and van Zwol, R. 2008. Flickr tag recommendation based on collective knowledge. In Proceedings of the 17th International Conference on World Wide Web. Google ScholarDigital Library
- Smeulders, A. W., Worring, M., Santini, S., Gupta, A., and Jain, R. 2000. Content based image retrieval at the end of the early years. IEEE Trans. Patt. Anal. Mach. Intell. 22, 12. Google ScholarDigital Library
- Tian, X., Yang, L., Wang, J., Yang, Y., Wu, X., and Hua, X.-S. 2008. Bayesian video search reranking. In Proceedings of the ACM Conference on Multimedia. 131--140. Google ScholarDigital Library
- Weinberger, K., Slaney, M., and van Zwol, R. 2008. Resolving tag ambiguity. In Proceedings of ACM Conference on Multimedia. Google ScholarDigital Library
- Wen, J.-R., Nie, J.-Y., and Zhang, H.-J. 2003. Clustering user queries of a search engine. In Proceedings of the International Conference on World Wide Web. 162--168. Google ScholarDigital Library
- Xu, J. and Croft, W. B. 1996. Query expansion using local and global document analysis. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval. 4--11. Google ScholarDigital Library
- Yan, R., Hauptmann, A., and Jin, R. 2003. Multimedia search with pseudo-relevance feedback. In Proceedings of the International Conference on Image and Video Retrieval. 238--247. Google ScholarDigital Library
- Yu, S., Cai, D., Wen, J.-R., and Ma, W.-Y. 2003. Improving pseudo-relevance feedback in web information retrieval using web page segmentation. In Proceedings of the International Conference on World Wide Web. 11--18. Google ScholarDigital Library
- Zha, Z.-J., Yang, L., Mei, T., Wang, M., and Wang, Z. 2009. Viusal query suggestion. In Proceedings of ACM Conference on Multimedia. 15--24. Google ScholarDigital Library
Index Terms
- Visual query suggestion: Towards capturing user intent in internet image search
Recommendations
Visual query suggestion
MM '09: Proceedings of the 17th ACM international conference on MultimediaQuery suggestion is an effective approach to improve the usability of image search. Most existing search engines are able to automatically suggest a list of textual query terms based on users' current query input, which can be called Textual Query ...
Visual query attributes suggestion
MM '12: Proceedings of the 20th ACM international conference on MultimediaQuery suggestion is an effective solution to help users deliver their search intent. While many query suggestion approaches have been proposed for test-based image retrieval with query-by-keywords, query suggestion for content-based image retrieval (...
Personalized Query Suggestion Diversification
SIGIR '17: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information RetrievalQuery suggestions help users refine their queries after they input an initial query. We consider the task of generating query suggestions that are personalized and diversified. We propose a personalized query suggestion diversification model (PQSD), ...
Comments