Abstract
An important trend in web information processing is the support of content-based multimedia retrieval (CBMR). However, the most prevailing paradigm of CBMR, such as content-based image retrieval, content-based audio retrieval, etc, is rather conservative. It can only retrieve media objects of single modality. With the rapid development of Internet, there is a great deal of media objects of different modalities in the multimedia documents such as webpages, which exhibit latent semantic correlation. Cross-media retrieval, as a new multi-media retrieval method, is to retrieve all the related media objects with multi-modalities via submitting a query media object. To the best of our knowledge, this is the first study on how to speed up the cross-media retrieval via indexes. In this paper, based on a Cross-Reference-Graph(CRG)-based similarity retrieval method, we propose a novel unified high-dimensional indexing scheme called CIndex, which is specifically designed to effectively speedup the retrieval performance of the large cross-media databases. In addition, we have conducted comprehensive experiments to testify the effectiveness and efficiency of our proposed method.
This work is partially supported by the Program of National Natural Science Foundation of China under Grant No. 60873022; The Program of Zhejiang Provincial Natural Science Foundation of China under Grant No. Y1080148; The Key Program of Science and Technology of Zhejiang Province under Grant No. 2008C13082; The Open Project of Zhejiang Provincial Key Laboratory of Information Network Technology; The Key Project of Special Foundation for Young Scientists in Zhejiang Gongshang University under Grant No. Q09-7.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
McGurk, H., MacDonald, J.: Hearing Lips and Seeing Voices. Nature 264, 746–748 (1976)
Flickner, M., Sawthney, H., Niblack, W., et al.: Query by image and video content: The QBIC system. IEEE Computers 28(9), 23–31 (1995)
Rui, Y., Huang, T.-S., Chang, S.-F.: Image Retrieval: Current Techniques, Promising Directions and Open Issues. JVCIR 10, 39–62 (1999)
Smith, J.R., Chang, S.-F.: VisualSEEK: a fully automated content-based image query system. In: ACM Multimedia (1996)
Chang, S.F., Chen, W., Meng, H.J., Sundaram, H., Zhong, D.: VideoQ: An automated content based video search system using visual cues. In: ACM Multimedia (1997)
Smith, J., Chang, S.-F.: WebSEEK, a content-based image and video search and catalog tool for the Web. IEEE Multimedia (1997)
Zhao, X.Y., Zhuang, Y.-T., Wu, F.: Audio Clip Retrieval with Fast Relevance Feedback based on Constrained Fuzzy Clustering and Stored Index Table. In: Chen, Y.-C., Chang, L.-W., Hsu, C.-T. (eds.) PCM 2002. LNCS, vol. 2532. Springer, Heidelberg (2002)
Jagadish, H.V., Ooi, B.-C., Shen, H.T., Tan, K.-L.: Towards efficient multi-feature query processing. IEEE TKDE 18(3), 350–362 (2006)
Shen, H.T., Zhou, X.F., Cui, B.: Indexing and Integrating Multiple Features for WWW images. World Wide Web Journal 9(3), 343–364 (2006)
Yang, J., Li, Q., Zhuang, Y.-T.: Octopus: Aggressive Search of Multi-Modality Data Using Multifaceted Knowledge Base. In: WWW (2002)
Wu, F., Zhang, H., Zhuang, Y.-T.: Learning Semantic Correlations for Cross-Media Retrieval. In: ICIP (2006)
Zhuang, Y.-T., Yang, Y., Wu, F.: Mining Semantic Correlation of Heterogeneous Multimedia Data for Cross-media Retrieval. IEEE TMM 10(2), 221–229 (2008)
Böhm, C., Berchtold, S., Keim, D.: Searching in High-dimensional Spaces: Index Structures for Improving the Performance of Multimedia Databases. ACM Computing Surveys 33(3) (2001)
Guttman, R.: R-tree: A dynamic index structure for spatial searching. In: SIGMOD (1984)
Weber, R., Schek, H., Blott, S.: A quantitative analysis and performance study for similarity-search methods in high-dimensional spaces. In: VLDB (1998)
Jagadish, H.V., Ooi, B.C., Tan, K.L., Yu, C., Zhang, R.: iDistance: An Adaptive B+-tree Based Indexing Method for Nearest Neighbor Search. ACM TODS 30(2), 364–397 (2005)
Zhang, T., Ramakrishnan, R., Livny, M.: BIRCH: An efficient data clustering method for very large databases. In: SIGMOD (1996)
Yang, J., Li, Q., Liu, L.W.-Y., Zhuang, Y.-T.: Searching for Flash Movies on the Web: a Content and Context Based Framework. World Wide Web Journal 8(4), 495–517 (2004)
Tenenbaum, J.B., de Silva, V., Langford, J.C.: A Global Geometric Framework for Nonlinear Dimensionality Reduction. Science 290(5500), 2319–2323 (2000)
Microsoft Encarta (2006), http://encarta.msn.com/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhuang, Y., Li, Q., Chen, L. (2009). A Unified Indexing Structure for Efficient Cross-Media Retrieval. In: Zhou, X., Yokota, H., Deng, K., Liu, Q. (eds) Database Systems for Advanced Applications. DASFAA 2009. Lecture Notes in Computer Science, vol 5463. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-00887-0_59
Download citation
DOI: https://doi.org/10.1007/978-3-642-00887-0_59
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-00886-3
Online ISBN: 978-3-642-00887-0
eBook Packages: Computer ScienceComputer Science (R0)