Abstract
Relevance feedback has proven to be a powerful tool to bridge the semantic gap between low-level features and high-level human concepts in content-based image retrieval (CBIR). However, traditional short-term relevance feedback technologies are confined to using the current feedback record only. Log-based long-term learning captures the semantic relationships among images in a database by analyzing the historical relevance information to boost the retrieval performance effectively. In this paper, we propose an expanded-judging model to analyze the historical log data’s semantic information and to expand the feedback sample set from both positive and negative relevant information. The index table is used to facilitate the log analysis. The expanded-judging model is applied in image retrieval by combining with short-term relevance feedback algorithms. Experiments were carried out to evaluate the proposed algorithm based on the Corel image database. The promising experimental results validate the effectiveness of our proposed expanded-judging model.
Similar content being viewed by others
References
Yap, K.-H., & Wu, K. (2005). A soft relevance framework in content-based image retrieval systems. IEEE Transactions on Circuits and Systems, 15(2), 1557–1568.
Aboulmagd, H., El-Gayar, N., & Onsi, H. (2009). A new approach in content-based image retrieval using fuzzy. Telecommunications Systems, 40(1), 55–66. doi:10.1007/s11235-008-9142-9.
Flickher, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., Steele, D., & Yanker, P. (1995). Query by image and video content: the QBIC system. IEEE Computer, 28(9), 23–32. doi:10.1109/2.410146.
Rui, Y., Huang, T. S., & Mehrotra, S. (1997). Content-based image retrieval with relevance feedback in MARS. In Proceedings of the IEEE international conference on image processing, Washington, DC (Vol. 2, pp. 815–818). doi:10.1109/ICIP.1997.638621.
Smith, J. R., & Chang, S. F. (1996). VisualSEEk: a fully automated contentbased image query system. In Proceedings of ACM multimedia, November 1996 (pp. 87–98).
Cox, I. J., Miller, M. L., Minka, T. P., Papathomas, T. V., & Yianilos, P. N. (2000). The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments. IEEE Transactions on Image Processing, 9(1), 20–37. doi:10.1109/83.817596.
Wang, B., He, M.-W., Wang, S., & Wang, M. (2007). Image retrieval using long term learning relevance feedback. In Proceedings of IEEE international conference on machine learning and cybernetics, Aug. 2007 (Vol. 7, pp. 3985–3990). doi:10.1109/ICMLC.2007.4370843.
Rui, Y., Huang, T. S., Ortega, M., & Mehrotra, S. (1998). Relevance feedback: a power tool in interactive content-based image retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 8(5), 644–655. doi:10.1109/76.718510.
Rui, Y., Huang, T., Mehrotra, S., & Ortega, M.A. (1997). A relevance feedback architecture for content-based multimedia information retrieval systems. In Proceedings of IEEE workshop on content based access of image and video libraries, November 1997 (pp. 82–89). doi:10.1109/IVL.1997.629724.
Vasconcelos, N., & Lippman, A. (2000). Bayesian relevance feedback for content-based image retrieval. In Proceedings of IEEE workshop on content-based access to image and video libraries, June 2000 (pp. 63–67). doi:10.1109/IVL.2000.853841.
Hoi, S. C. H., Lyu, M. R., & Jin, R. (2006). A unified log-based relevance feedback scheme for image retrieval. IEEE Transactions on Knowledge and Data Engineering, 18(4), 509–524. doi:10.1109/TKDE.2006.1599389.
Lu, Y., Hu, C., Zhu, X., Zhang, H., & Yang, Q. (2000). A unified framework for semantics and feature based relevance feedback in image retrieval systems. In Proceedings of the eighth ACM international conference on multimedia (pp. 31–37).
He, X., Ma, W.-Y., & Zhang, H.-J. (2004). Learning an image manifold for retrieval. In Proceedings of the 12th annual ACM international conference on multimedia (pp. 17–23).
Ivasic-Kos, M., Pavlic, M., & Poscis, P. (2009). The analysis and overview of semantic image representation. In Proceedings of the ITI 2009 31st international conference on information technology interfaces, June 2009 (pp. 181–186). doi:10.1109/ITI.2009.5196076.
Barrett, S., Chang, R., & Qi, X. (2009). A fuzzy combined learning approach to content-based image retrieval. In Proceedings of IEEE international conference on multimedia and expo (pp. 838–841). doi:10.1109/ICME.2009.5202625.
Fechser, S., Chang, R., & Qi, X. (2010). Inter-query semantic learning approach to image retrieval. In Proceedings of IEEE international conference on acoustics speech and signal processing (pp. 1246–1249). doi:10.1109/ICASSP.2010.5495405.
Patino-Escarcina, R. E., & Ferreira Costa, J. A. (2008). The semantic clustering of images and its relation with low level color features. In Proceedings of IEEE international conference on semantic computing (pp. 74–79). doi:10.1109/ICSC.2008.81.
Javidi, M., Aski, B. S., Homaei, H., & Pourreza, H. R. (2008). A new approach for interactive image retrieval based on fuzzy feedback and support vector machine. In Proceedings of IEEE international conference on computational intelligence for modelling control & automation (pp. 1205–1210). doi:10.1109/CIMCA.2008.176.
Gilbert, A. D., Chang, R., & Qi, X. (2010). A retrieval pattern-based inter-query learning approach for content-based image retrieval. In Proceedings of IEEE international conference on image processing (pp. 3197–3200). doi:10.1109/ICIP.2010.5654156.
Jini, Z. S. S. (2010). Semantic image retrieval using relevance feedback and reinforcement learning algorithm. In Proceedings of international symposium on communications and mobile network (pp. 1–4). doi:10.1109/ISVC.2010.5654900.
Hoi, S. C. H., Liu, W., & Chang, S.-F. (2008). Semi-supervised distance metric learning for collaborative image retrieval. In Proceedings of international conference on computer vision and pattern recognition (pp. 1–7). doi:10.1109/CVPR.2008.4587351.
Zhou, X.-D., Zhang, L., Liu, L., et al. (2002). A relevance feedback method in image retrieval by analyzing feedback log file. In Proceedings of IEEE international conference on machine learning and cybernetics, Nov. 2002 (Vol. 3, pp. 1641–1646). doi:10.1109/ICMLC.2002.1167491.
Li, M. J., Chen, Z., Liu, W. Y., & Zhang, H. J. (2001). A statistical correlation model for image retrieval. In Proceedings of the 3rd international workshop on multimedia information retrieval, Ottawa, Canada (pp. 42–45).
Lv, H, Huang, X.-L. & Zhang, J. (2009). A long-term learning algorithm in CBIR based on log-analyzing. In Proceedings of IEEE international conference on engineering management and service sciences, Oct. 2009 (pp. 1–4). doi:10.1109/ICMSS.2009.5301084.
Horng, Y. J., Chen, S. M., Chang, Y. C., & Lee, C. H. (2005). A new method for fuzzy information retrieval based on fuzzy hierarchical clustering and fuzzy inference techniques. IEEE Transactions on Fuzzy Systems, 13(2), 216–228. doi:10.1109/TFUZZ.2004.840134.
Singh, R., Vatsa, M., Singh, S. K., & Upadhyay, S. (2009). Integrating SVM classification with SVD watermarking for intelligent video authentication. Telecommunications Systems, 40(1), 5–15. doi:10.1007/s11235-008-9141-x.
Stricker, M., & Orengo, M. (1995). Similarity of color images. In Proceedings of SPIE storage and retrieval for image and video databases III, San Jose (pp. 381–392).
Iqbal, Q., & Aggarwal, J. K. (2002). CIRES: a system for content-based retrieval in digital image libraries. In Proceedings of IEEE international conference on control, automation, robotics and vision, Dec. 2002 (Vol. 1, pp. 205–210). New York: IEEE Press. doi:10.1109/ICARCV.2002.1234821.
Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973). Textural features for image classification. IEEE Transactions on Systems, Man and Cybernetics, 3, 610–621. doi:10.1109/TSMC.1973.4309314.
Chun, Y. D., Kim, N. C., & Jang, I. H. (2008). Content-based image retrieval using multiresolution color and texture features. IEEE Transactions on Multimedia, 10(6), 1073–1084.
Porkawe, K., Ortega, M., & Mehrotra, S. (1999). Query reformulation for content based multimedia retrieval in MARS. In Proceedings of IEEE international conference on multimedia computing and systems, July 1999 (Vol. 2, pp. 747–751). doi:10.1109/MMCS.1999.778578.
Acknowledgements
The authors would like to thank the reviews for insight comments that helped to improve the paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
This paper was recommended by MINES 2010, and was supported in part by the Doctoral Fund of Ministry of Education of China (20090018110001), the program for New Century Excellent Talents in University (NCET-07-0768), and 211 Project of China.
Rights and permissions
About this article
Cite this article
Lu, H., Huang, X., Yang, L. et al. A novel long-term learning algorithm for relevance feedback in content-based image retrieval. Telecommun Syst 54, 265–275 (2013). https://doi.org/10.1007/s11235-013-9732-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11235-013-9732-z