Abstract
In this paper we propose an efficient queried-by-example retrieval system which is able to retrieve trademark images by similarity from patent and trademark offices’ digital libraries. Logo images are described by both their semantic content, by means of the Vienna codes, and their visual contents, by using shape and color as visual cues. The trademark descriptors are then indexed by a locality-sensitive hashing data structure aiming to perform approximate k-NN search in high dimensional spaces in sub-linear time. The resulting ranked lists are combined by using a weighted Condorcet method and a relevance feedback step helps to iteratively revise the query and refine the obtained results. The experiments demonstrate the effectiveness and efficiency of this system on a realistic and large dataset.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24(4), 509–522 (2002)
de Condorcet, M.: Essai sur l’application de l’analyse à la probabilité des decisions rendues à la pluralité des voix. 1785
Eakins, J.P., Shields, K., Boardman, J.: ARTISAN: A shape retrieval system based on boundary family indexing. In: Storage and Retrieval for Still Image and Video Databases IV. Proc. SPIE, vol. 2670, pp. 17–28 (1996)
Gionis, A., Indyk, P., Motwani, R.: Similarity search in high dimensions via hashing. In: Proceedings of the 25th International Conference on Very Large Data Bases, pp. 518–529 (1999)
Hesson, A., Androustos, D.: Logo and trademark detection in images using color wavelet co-occurrence histograms. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1233–1236 (2008)
Hitam, M.S., Yussof, H.J.W., Jawahir, W.N., Deris, M.M.: Hybrid Zernike moments and color-spatial technique for content-based trademark retrieval. In: Proceedings of the International Symposium on Management Engineering (2006)
Hodge, V.J., Hollier, G., Austin, J., Eakins, J.: Identifying perceptual structures in trademark images. In: Proceedings 5th IASTED International Conference on Signal Processing, Pattern Recognition, and Applications (2008)
Hsieh, I.S., Fan, K.C.: Multiple classifiers for color flag and trademark image retrieval. IEEE Trans. Image Process. 10(6), 938–950 (2001)
Iguchi, H., Abe, K., Misawa, T., Kimura, H., Daido, Y.: Recognition of grouping patterns in trademarks based on the Gestalt psychology. Electron. Commun. Jpn. 92(10), 49–60 (2009)
Indyk, P., Motwani, R.: Approximate nearest neighbors: towards removing the curse of dimensionality. In: Proceedings of the 30th Annual ACM Symposium on Theory of Computing, pp. 604–613 (1998)
Kwan, P.W.H., Toraichi, K., Kameyama, K., Kawazoe, F., Nakamura, K.: TAST-trademark application assistant. In: Proceedings of the International Conference on Image Processing, pp. 884–887 (2002)
Mori, G., Belongie, S., Malik, J.: Efficient shape matching using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 27(11), 1832–1837 (2005)
Ravela, S., Manmatha, R.: Multi-modal retrieval of trademark images using global similarity. Technical Report UM-CS-1999-032, University of Massachusetts (1999)
Ren, M., Eakins, J.P., Briggs, P.: Human perception of trademark images: Implications for retrieval system design. J. Electron. Imaging 9(4), 564–575 (2000)
Rocchio, J.: Relevance feedback in information retrieval. In: SMART Retrieval System: Experiments in Automatic Document Processing, pp. 313–323 (1971)
Schietse, J., Eakins, J.P., Veltkamp, R.C.: Practice and challenges in trademark image retrieval. In: Proceedings of the 6th ACM International Conference on Image and Video Retrieval, pp. 518–524 (2007)
Wu, J.K., Mehtre, B.M., Gao, Y.J., Lam, P.C., Narasimhalu, A.D.: STAR - a multimedia database system for trademark registration. In: Risch, T., Litwin, W. (eds.) ADB 1994. LNCS, vol. 819. Springer, Heidelberg (1994)
Wyszecki, G., Stiles, W.S.: Color science: Concepts and methods, quantitative data and formulae. John Wiley and Sons, New York (1982)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rusiñol, M., Aldavert, D., Karatzas, D., Toledo, R., Lladós, J. (2011). Interactive Trademark Image Retrieval by Fusing Semantic and Visual Content. In: Clough, P., et al. Advances in Information Retrieval. ECIR 2011. Lecture Notes in Computer Science, vol 6611. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20161-5_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-20161-5_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-20160-8
Online ISBN: 978-3-642-20161-5
eBook Packages: Computer ScienceComputer Science (R0)