research-article

Object-based image retrieval with kernel on adjacency matrix and local combined features

Authors:

Wenyu QuAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 8, Issue 4

Article No.: 54, Pages 1 - 18

https://doi.org/10.1145/2379790.2379796

Published: 30 November 2012 Publication History

Abstract

In object-based image retrieval, there are two important issues: an effective image representation method for representing image content and an effective image classification method for processing user feedback to find more images containing the user-desired object categories. In the image representation method, the local-based representation is the best selection for object-based image retrieval. As a kernel-based classification method, Support Vector Machine (SVM) has shown impressive performance on image classification. But SVM cannot work on the local-based representation unless there is an appropriate kernel. To address this problem, some representative kernels are proposed in literatures. However, these kernels cannot work effectively in object-based image retrieval due to ignoring the spatial context and the combination of local features.

In this article, we present Adjacent Matrix (AM) and the Local Combined Features (LCF) to incorporate the spatial context and the combination of local features into the kernel. We propose the AM-LCF feature vector to represent image content and the AM-LCF kernel to measure the similarities between AM-LCF feature vectors. According to the detailed analysis, we show that the proposed kernel can overcome the deficiencies of existing kernels. Moreover, we evaluate the proposed kernel through experiments of object-based image retrieval on two public image sets. The experimental results show that the performance of object-based image retrieval can be improved by the proposed kernel.

References

[1]

Carson, C., Belongie, S., Greenspan, H., and Malik, J. 2004. Blobworld: Image segmentation using expectation-maximization and its application to image querying. IEEE Trans. Pattern Anal. Mach. Intell. 24, 1026--1038.

Digital Library

[2]

Chapelle, O., Haffiner, P., and Vapnik, V. 1999. Svms for histogram-based image classification. IEEE Trans. Neural Netw. 10, 234--778.

Digital Library

[3]

Felzenszwalb, P. F. and Huttenlocher, D. P. 2004. Efficient graph-based image segmentation. Inte. J. Comput. Vis. 59, 167--181.

Digital Library

[4]

Gosselin, P. H., Cord, M., and Foliguet, S. P. 2007a. Kernels on bags for multi-object database retrieval. In Proceedings of the 6th ACM International Conference on Image and Video Retrieval. 226--231.

Digital Library

[5]

Gosselin, P. H., Cord, M., and Foliguet, S. P. 2007b. Kernels on bags of fuzzy regions for fast object retrieval. In Proceedings of IEEE International Conference on Image Processing. 177--180.

[6]

Gosselin, P. H., Cord, M., and Foliguet, S. P. 2008. Combining visual dictionary, kernel-based similarity and learning strategy for image category retrieval. Comput. Vis. Image Understand. 110, 403--417.

Digital Library

[7]

Grauman, K. and Darrell, T. 2005. The pyramid match kernel: Discriminative classification with sets of image features. InProceedings of the 10th IEEE International Conference on Computer Vision. Vol. 2, 1458--1465.

Digital Library

[8]

Grauman, K. and Darrell, T. 2007. Approximate correspondences in high dimensions. Adv. in Neural Inf. Process. Syst. 19, 505--512.

[9]

Griffin, G., Holub, A., and Perona, P. 2007. Caltech-256 object category dataset. Tech. rep. 7694, California Institute of Technology.

[10]

Harchaoui, Z. and Bach, F. 2007. Image classification with segmentation graph kernels. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 1--8.

[11]

Haussler, D. 1999. Convolution kernel for structure data. Tech. rep. UCS-CRL-99-10.

[12]

Hsiao, J. H. and Chen, M. S. 2009. Intention-Focused active reranking for image object retrieval. In Proceedings of the 18th ACM Conference on Information and Knowledge Management. 157--166.

Digital Library

[13]

Hsu, C. W., C Hang, C. C., and Lin, C. J. 2003. A practical guide to support vector classification. Tech. rep. Department of Computer Science, National Taiwan University.

[14]

Kou, Y. H., Chen, K. T., Chiang, C. H., and Hsu, W. H. 2009. Query expansion for hash-based image object retrieval. In Proceedings of the 17th ACM International Conference on Multimedia. 65--74.

Digital Library

[15]

Lazebnik, S., Schmid, C., and Ponce, J. 2006. Beyond bags of features: Spatial pyramid matching for recognizing natural scence categories. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2169--2178.

Digital Library

[16]

Lebrun, J., Foliguet, S. P., and Gosselin, P. H. 2008. Image retrieval with graph kernel on regions. In Proceedings of the 19th International Conference on Pattern Recognition. 1--4.

[17]

Lyu, S. 2005. Mercer kernels for object recognition with local features. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Vol. 2, 223--229.

Digital Library

[18]

Perronnin, F. and Dance, C. 2007. Fisher kernels on visual vocabularies for image categorization. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 1--8.

[19]

Philbin, J., Chum, O., Isard, M., Sivic, J., and Zisserman, A. 2008. Lost in quantization: Improving particular object retrieval in large scale image databases. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 1--8.

[20]

Pontil, M. and Verri, A. 1998. Support vector machines for 3d object recognition. IEEE Trans. Pattern Anal. Mach. Intell. 20, 637--646.

Digital Library

[21]

Shawe-Taylor, J. and Cristianini, N. 2004. Kernel Methods for Pattern Analysis. Cambridge University Press.

Digital Library

[22]

Sivic, J. and Zisserman, A. 2003. Video google: A text retrieval approach to object matching in videos. In Proceedings of the 9th IEEE International Conference on Computer Vision. Vol. 2, 1470--1477.

Digital Library

[23]

Vapnik, V. 1998. Statistical learning theory. John Wiley & Sons, New York.

[24]

Wallraven, C. and Caputo, B. 2003. Recognition with local features: the kernel recipe. In Proceedings of the 9th IEEE International Conference on Computer Vision. Vol. 2, 257--264.

Digital Library

[25]

Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., and Gong, Y. 2010. Locality-Constrained linear coding for image classification. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 3360--3367.

[26]

Wang, J. Z., Li, J., and Wiederhold, G. 2001. Simplicity: Semantics-Sensitive integrated matching for picture libraries. IEEE Trans. Pattern Analy. Mach. Intell. 23, 947--963.

Digital Library

[27]

Zhang, L., Lin, F. Z., and Zhang, B. 2001. Support vector machine learning for image retrieval. In Proceedings of International Conference on Image Processing. Vol. 2, 721--724.

[28]

Zheng, Q. F. and Gao, W. 2008. Constructing visual phrases for effective and efficient object-based image retrieval. ACM Trans. Multimedia Comput. Comm. Appli. 5, 7:1--7:19.

Digital Library

Cited By

Jiang WLv QYan CTang KZhang J(2018)Robust Semisupervised Nonnegative Local Coordinate Factorization for Data RepresentationComplexity10.1155/2018/79632102018Online publication date: 1-Aug-2018
https://dl.acm.org/doi/10.1155/2018/7963210
Miao JLi ZQu WZhou ZLiu ZLiu W(2018)Approximate Nearest Neighbor Search Based on Hierarchical Multi-Index Hashing2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI)10.1109/SmartWorld.2018.00302(1791-1796)Online publication date: Oct-2018
https://doi.org/10.1109/SmartWorld.2018.00302
Jiang WFeng XMa TXing LTang K(2018)Robust Local Learning and Discriminative Concept Factorization for Data RepresentationIEEE Access10.1109/ACCESS.2018.28799866(68675-68685)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2879986
Show More Cited By

Index Terms

Object-based image retrieval with kernel on adjacency matrix and local combined features
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
2. Information systems
  1. Information retrieval
    1. Retrieval models and ranking

Recommendations

Constructing visual phrases for effective and efficient object-based image retrieval

The explosion of multimedia data necessitates effective and efficient ways for us to get access to our desired ones. In this article, we draw an analogy between image retrieval and text retrieval and propose a visual phrase-based approach to retrieve ...
Effective and efficient object-based image retrieval using visual phrases
MM '06: Proceedings of the 14th ACM international conference on Multimedia

In this paper, we draw an analogy between image retrieval and text retrieval and propose a visual phrase-based approach to retrieve images containing desired objects. The visual phrase is defined as a pair of adjacent local image patches and is ...
An user preference information based kernel for SVM active learning in content-based image retrieval
MIR '04: Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval

Relevance feedback is a critical component for content-based retrieval systems. Effective learning algorithms are needed to accurately and quickly capture the user's query concept, under the daunting challenges of high dimensional data and small number ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 8, Issue 4

November 2012

139 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/2379790

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 November 2012

Accepted: 01 December 2011

Revised: 01 September 2011

Received: 01 March 2011

Published in TOMM Volume 8, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Natural Science Foundation of China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
280
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jiang WLv QYan CTang KZhang J(2018)Robust Semisupervised Nonnegative Local Coordinate Factorization for Data RepresentationComplexity10.1155/2018/79632102018Online publication date: 1-Aug-2018
https://dl.acm.org/doi/10.1155/2018/7963210
Miao JLi ZQu WZhou ZLiu ZLiu W(2018)Approximate Nearest Neighbor Search Based on Hierarchical Multi-Index Hashing2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI)10.1109/SmartWorld.2018.00302(1791-1796)Online publication date: Oct-2018
https://doi.org/10.1109/SmartWorld.2018.00302
Jiang WFeng XMa TXing LTang K(2018)Robust Local Learning and Discriminative Concept Factorization for Data RepresentationIEEE Access10.1109/ACCESS.2018.28799866(68675-68685)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2879986
Xing LDong HJiang WTang K(2018)Nonnegative matrix factorization by joint locality-constrained and ℓ2,1-norm regularizationMultimedia Tools and Applications10.1007/s11042-017-4970-977:3(3029-3048)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1007/s11042-017-4970-9
Pan JLi ZQu WXu Y(2015)Variable-Weight and Multi-index Similarity Measure for Feature FusionProceedings of the 2015 Ninth International Conference on Frontier of Computer Science and Technology10.1109/FCST.2015.29(1-7)Online publication date: 26-Aug-2015
https://dl.acm.org/doi/10.1109/FCST.2015.29
Li ZQu WCao JQi HStojmenovic M(2015)ECDSPattern Recognition10.1016/j.patcog.2014.08.00948:2(402-410)Online publication date: 1-Feb-2015
https://dl.acm.org/doi/10.1016/j.patcog.2014.08.009
Li ZQu WCao JQi HStojmenovic M(2013)ECDSProceedings of the 2013 International Conference on Computer-Aided Design and Computer Graphics10.1109/CADGraphics.2013.31(180-187)Online publication date: 16-Nov-2013
https://dl.acm.org/doi/10.1109/CADGraphics.2013.31
Li ZQu WCao JSu ZQi H(2012)Geometry-based 2D shape descriptor for retrieval in large database2012 IEEE 11th International Conference on Signal Processing10.1109/ICoSP.2012.6491769(1096-1101)Online publication date: Oct-2012
https://doi.org/10.1109/ICoSP.2012.6491769

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents