Abstract
This paper concentrates on the user-centered search task at ImageCLEF 2004. In this work, we combine both textual and visual features for cross-language image retrieval, and propose two interactive retrieval systems – T_ICLEF and VCT_ICLEF. The first one incorporates a relevance feedback mechanism based on textual information while the second one combines textual and image information to help users find a target image. The experimental results show that VCT_ICLEF had a better performance in almost all cases. Overall, it helped users find the topic image within a fewer iterations with a maximum of 2 iterations saved. Our user survey also reported that a combination of textual and visual information is helpful to indicate to the system what a user really wanted in mind.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ciocca, G., Gagliardi, I., Schettini, R.: Quicklook2: An integrated multimedia system. International Journal of Visual Languages and Computing, Special Issue on Querying Multiple Data Sources 12(1), 81–103 (2001)
Clough, P., Sanderson, M., Müller, H.: The CLEF Cross Language Image Retrieval Track (ImageCLEF) 2004. In: Proceedings of the CLEF 2004 Workshop, Bath, UK, pp. 459–473 (2004)
Cox, I.J., Minka, T.P., Papathomas, T.V., Yianilos, P.N.: The Bayesian image retrieval system, pichunter: Theory, implementation, and psychophysical experiments. IEEE Transactions on Image Processing, Special Issue on Digital Libraries 9(1), 20–37 (2000)
Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., Steele, D., Yanker, P.: Query by Image and Video Content: The QBIC system. IEEE Computer 28(9), 23–32 (1995)
Ishikawa, Y., Subramanya, R., Faloutsos, C.: Mindreader: Query databases through multiple examples. In: Proceedings of 24th VLDB Conference, New York, pp. 218–227 (1998)
Kohonen, T.: The Self-Organizing Map. Neurocomputing 21(1-3), 1–6 (1998)
Kushki, A., Androutsos, P., Plataniotis, K.N., Venetsanopoulos, A.N.: Query Feedback for Interactive Image Retrieval. IEEE Transactions on Circuits and Systems for Video Technology 14(5), 644–655 (2004)
Lu, Y., Hu, C., Zhu, X., Zhang, H., Yang, Q.: A unified framework for semantics and feature based relevance feedback in image retrieval systems. In: Proceedings of 8th ACM Multimedia International Conference, Los Angeles, CA, pp. 31–37 (2000)
Meilhac, C., Nastar, C.: Relevance feedback and category search in image databases. In: IEEE Int. Conf. Multimedia Computing and Systems, pp. 512–517 (1999)
Miller, G.: WordNet: A Lexical Database for English. Communications of the ACM, 39–45 (1995)
Rocchio, J.J.: Relevance feedback in information retrieval. In: Salton, G. (ed.) The SMART Retrieval System: Experiments in Automatic Document Processing, pp. 313–323. Prentice-Hall, Englewood Cliffs (1971)
Rui, Y., Huang, T.S.: Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Circuits Syst. Video Technol. 8(5), 644–655 (1999)
Rui, Y., Huang, T.S.: A novel relevance feedback technique in image retrieval. In: Proceedings of the 7th ACM International Conference on Multimedia, Orlando, FL, pp. 67–70 (1999)
Salton, G., McGill, M.J. (eds.): Introduction to Modern Information Retrieval. McGraw-Hill, New York (1983)
Swain, M.J., Ballard, D.H.: Color Indexing. International Journal of Computer Vision 7, 11–32 (1991)
Vasconcelos, N., Lippman, A.: Learning from user feedback in image retrieval systems. In: Proc. NIPS 1999, Denver, CO (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cheng, PC., Yeh, JY., Ke, HR., Chien, BC., Yang, WP. (2005). Comparison and Combination of Textual and Visual Features for Interactive Cross-Language Image Retrieval. In: Peters, C., Clough, P., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds) Multilingual Information Access for Text, Speech and Images. CLEF 2004. Lecture Notes in Computer Science, vol 3491. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11519645_77
Download citation
DOI: https://doi.org/10.1007/11519645_77
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27420-9
Online ISBN: 978-3-540-32051-7
eBook Packages: Computer ScienceComputer Science (R0)