Abstract
With the large number of local feature detectors and descriptors in the literature of Content-Based Image Retrieval (CBIR), in this work we propose a solution to predict the optimal combination of features, for improving image retrieval performances, based on the spatial complementarity of interest point detectors. We review several complementarity criteria of detectors and employ them in a regression based prediction model, designed to select the suitable detectors combination for a dataset. The proposal can improve retrieval performance even more by selecting optimal combination for each image (and not only globally for the dataset), as well as being profitable in the optimal fitting of some parameters. The proposal is appraised on three state-of-the-art datasets to validate its effectiveness and stability. The experimental results highlight the importance of spatial complementarity of the features to improve retrieval, and prove the advantage of using this model to optimally adapt detectors combination and some parameters.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Agrawal, M., Konolige, K., Blas, M.: Censure: center surround extremas for realtime feature detection and matching. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5305, pp. 102–115. Springer, Heidelberg (2008)
Atrey, P.K., Hossain, M.A., Saddik, A.E., Kankanhalli, M.S.: Multimodal fusion for multimedia analysis: a survey. Multimed. Syst. 16, 345–379 (2010)
Bay, H., Ess, A., Tuytelaars, T., Gool, L.V.: Speeded-up robust features (surf). Comput. Vis. Image Underst. 11(3), 346–359 (2008)
Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. Pattern Anal. Mach. Intell. 24(4), 509–522 (2002)
Bhowmik, N., Gonzalez, V.R., Gouet-Brunet, V., Pedrini, H., Bloch, G.: Efficient fusion of multidimensional descriptors for image retrieval. In: International Conference on Image Processing, pp. 5766–5770, October 2014
Deselaers, T., Keysers, D., Ney, H.: Features for image retrieval: an experimental comparison. Inf. Retr. 11(2), 77–107 (2008)
Ehsan, S., Clark, A.F., McDonald-Maier, K.D.: Rapid online analysis of local feature detectors and their complementarity. Sensors 13(8), 10876 (2013)
Ferreira, C.D., Santos, J.A., da Silva Torres, R., Goncalves, M.A., Rezende, R.C., Fan, W.: Relevance feedback based on genetic programming for image retrieval. Pattern Recogn. Lett. 32(1), 27–37 (2011). Image Processing, Computer Vision and Pattern Recognition in Latin America
Gales, G., Crouzil, A., Chambon, S.: Complementarity of feature point detectors. In: Richard, P., Braz, J. (eds.) VISAPP(1), pp. 334–339. INSTICC Press, Setubal (2010)
Heidemann, G.: Focus-of-attention from local color symmetries. Pattern Anal. Mach. Intell. 26(7), 817–830 (2004)
Leutenegger, S., Chli, M., Siegwart, R.: BRISK: binary robust invariant scalable keypoints. In: International Conference on Computer Vision, pp. 2548–2555, November 2011
Li, X., Larson, M., Hanjalic, A.: Pairwise geometric matching for large-scale object retrieval. In: Computer Vision and Pattern Recognition, pp. 5153–5161, June 2015
Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide baseline stereo from maximally stable extremal regions. In: Proceedings of the British Machine Vision Conference, pp. 36.1–36.10 (2002)
Mikolajczyk, K., Leibe, B., Schiele, B.: Local features for object class recognition. In: International Conference on Computer Vision, vol. 2, pp. 1792–1799, October 2005
Mikolajczyk, K., Schmid, C.: Scale and affine invariant interest point detectors. Int. J. Comput. Vis. 60(1), 63–86 (2004)
Neshov, N.: Comparison on late fusion methods of low level features for content based image retrieval. In: Mladenov, V., Koprinkova-Hristova, P., Palm, G., Villa, A.E., Appollini, B., Kasabov, N. (eds.) ICANN 2013. LNCS, vol. 8131, pp. 619–627. Springer, Heidelberg (2013)
Rashedi, E., Nezamabadi-pour, H., Saryazdi, S.: A simultaneous feature adaptation and feature selection method for content-based image retrieval systems. Knowl.-Based Syst. 39, 85–94 (2013)
Risojevic, V., Babic, Z.: Fusion of global and local descriptors for remote sensing image classification. IEEE Geosci. Remote Sens. Lett. 10(4), 836–840 (2013)
Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to sift or surf. In: International Conference on Computer Vision, pp. 2564–2571, November 2011
da Silva Torres, R., Falcao, A.X., Goncalves, M.A., Papa, J.P., Zhang, B., Fan, W., Fox, E.A.: A genetic programming framework for content-based image retrieval. Pattern Recogn. 42(2), 283–292 (2009). Learning Semantics from Multimedia Content
Schmid, C., Mohr, R.: Local grayvalue invariants for image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 19(5), 530–534 (1997)
Snoek, C.G.M., Worring, M., Smeulders, A.W.M.: Early versus late fusion in semantic video analysis. In: Proceedings of the 13th Annual ACM International Conference on Multimedia. pp. 399–402. ACM, New York (2005)
Sun, J.: Local selection of features for image search and annotation. In: Proceedings of the 22nd ACM International Conference on Multimedia. pp. 655–658. ACM, New York (2014)
Wacht, M., Shan, J., Qi, X.: A short-term and long-term learning approach for content-based image retrieval. In: 2006 Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2006, vol. 2, p. II, May 2006
Yue, J., Li, Z., Liu, L., Fu, Z.: Content-based image retrieval using color and texture fused features. Math. Comput. Model. 54(3–4), 1121–1127 (2011). Mathematical and Computer Modeling in Agriculture
Zhang, W., Qin, Z., Wan, T.: Image scene categorization using multi-bag-of-features. In: Proceedings of International Conference on Machine Learning and Cybernetics, vol. 4, pp. 1804–1808 (2011)
Zhou, Y., Zeng, D., Zhang, S., Tian, Q.: Augmented feature fusion for image retrieval system. In: Proceedings of the 5th ACM on International Conference on Multimedia Retrieval, pp. 447–450. ACM, New York (2015)
Acknowledgments
The authors are grateful to Nicéphore Cité, Institut national de l’information géographique et forestière (IGN) and French project POEME ANR-12-CORD-0031 for the financial support.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Bhowmik, N., Gouet-Brunet, V., Wei, L., Bloch, G. (2017). Adaptive and Optimal Combination of Local Features for Image Retrieval. In: Amsaleg, L., Guðmundsson, G., Gurrin, C., Jónsson, B., Satoh, S. (eds) MultiMedia Modeling. MMM 2017. Lecture Notes in Computer Science(), vol 10133. Springer, Cham. https://doi.org/10.1007/978-3-319-51814-5_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-51814-5_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-51813-8
Online ISBN: 978-3-319-51814-5
eBook Packages: Computer ScienceComputer Science (R0)