Skip to main content
SpringerLink
Log in

ImSe: Exploratory Time-Efficient Image Retrieval System

  • Chapter
  • First Online:
Book cover Information Retrieval (RuSSIR 2014)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 505))

Included in the following conference series:

  • 1956 Accesses

Abstract

We consider the problem of Content-Based Image Retrieval (CBIR) with interactive user feedback when the user is unable to query the system with natural language text. We employ content-based techniques with Relevance Feedback mechanism to capture the precise need of the user and interactively refine the query. We apply the Exploration/Exploitation trade-off with Hierarchical Gaussian Process Bandits and pseudo feedback in order to tackle the problem of optimization in face of uncertainty and to improve the quality of multiple images selection. We tackle the scalability issue with Self-Organizing Map as a preprocessing techniques. A prototype system called ImSe was developed and tested in experiments with real users in different types of search tasks. The experiments show favorable results and indicate the benefits of proposed aprroach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  1. Auer, P., Hussain, Z., Kaski, S., Klami, A., Kujala, J., Laaksonen, J., Leung, A.P., Pasupa, K., Shawe-Taylor, J.: Pinview: implicit feedback in content-based image retrieval. JMLR 11, 51–57 (2010)

    Google Scholar 

  2. Cox, I., Miller, M., Minka, T., Papathomas, T., Yianilos, P.: The Bayesian image retrieval system, pichunter: theory, implementation, and psychophysical experiments. Image Process. 9(1), 20–37 (2000)

    Article  Google Scholar 

  3. Datta, R., Li, J., Wang, J.: Content-based image retrieval: approaches and trends of the new age. In: Multimedia information retrieval, pp. 253–262. ACM (2005)

    Google Scholar 

  4. Hellinger, E.: Neue begründung der theorie quadratischer formen von unendlichvielen veränderlichen. Journal für die reine und angewandte Mathematik 136, 210–271 (1909)

    Article  MathSciNet  MATH  Google Scholar 

  5. Huiskes, M., Lew, M.: The MIR flickr retrieval evaluation. In: MIR 2008 (2008)

    Google Scholar 

  6. Hussain, Z., Leung, A.P., Pasupa, K., Hardoon, D.R., Auer, P., Shawe-Taylor, J.: Exploration-exploitation of eye movement enriched multiple feature spaces for content-based image retrieval. In: Balcázar, J.L., Bonchi, F., Gionis, A., Sebag, M. (eds.) ECML PKDD 2010, Part I. LNCS, vol. 6321, pp. 554–569. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  7. Kato, T., Kurita, T., Otsu, N., Hirata, K.: A sketch retrieval method for full color image database-query by visual example. In: Pattern Recognition. Computer Vision and Applications, IAPR, pp. 530–533. IEEE (1992)

    Google Scholar 

  8. Kohonen, T.: Self-organizing Maps, vol. 30. Springer Verlag, Heidelberg (2001)

    MATH  Google Scholar 

  9. Konyushkova, K., Glowacka, D.: Content-based image retrieval with hierarchical gaussian process bandits with self-organizing maps. In: ESANN (2013)

    Google Scholar 

  10. Kosch, H., Maier, P.: Content-based image retrieval systems-reviewing and benchmarking. JDIM 8(1), 54–64 (2010)

    Google Scholar 

  11. Laaksonen, J., Koskela, M., Laakso, S., Oja, E.: Picsom-content-based image retrieval with self-organizing maps. Pattern Recognition Letters 21(13), 1199–1207 (2000)

    Article  MATH  Google Scholar 

  12. Manjunath, B., Ohm, J., Vasudevan, V., Yamada, A.: Color and texture descriptors. Circuits and Systems for Video Technology 11(6), 703–715 (2001)

    Article  Google Scholar 

  13. Hussain, Z., Auer, P., Leung, A., Shawe-Taylor, J.: Report on using side information for exploration-exploitation trade-offs, fp7-216529 pinview. Technical report, European Community’s Seventh Framework Programme (2009)

    Google Scholar 

  14. Pandey, S., Agarwal, D., Chakrabarti, D., Josifovski, V.: Bandits for taxonomies: a model-based approach. In: SIAM International Conference on Data Mining (SDM) (2007)

    Google Scholar 

  15. Smeulders, A., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. Pattern Analysis and Machine Intelligence 22(12), 1349–1380 (2000)

    Article  Google Scholar 

  16. Srinivas, N., Krause, A., Kakade, S., Seeger, M.: Gaussian process bandits without regret: An experimental design approach. In: CoRR (2009). arxiv.org/abs/0912.3995

  17. Eickhoff, J.: Onboard Computers, Onboard Software and Satellite Operations. SAT, vol. 1. Springer, Heidelberg (2012)

    Book  Google Scholar 

  18. Veltkamp, R.C., Tanase, M.: Content-Based Image Retrieval Systems: A Survey, pp. 1–62. Department of Computing Science, Utrecht University (2002). (preprint)

    Google Scholar 

  19. Zhou, X., Huang, T.: Relevance feedback in image retrieval: a comprehensive review. Multimedia Syst. 8(6), 536–544 (2003)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Helsinki Institute for Information Technology, Espoo, Finland

    Ksenia Konyushkova & Dorota Głowacka

  2. Department of Computer Science, University of Helsinki, Helsinki, Finland

    Ksenia Konyushkova & Dorota Głowacka

Authors
  1. Ksenia Konyushkova
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dorota Głowacka
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ksenia Konyushkova .

Editor information

Editors and Affiliations

  1. Ural Federal University, Yekaterinburg, Russia

    Pavel Braslavski

  2. National Research University Higher School of Economics, Nizhniy Novgorod, Russia

    Nikolay Karpov

  3. Intelligent Systems Laboratory, University of Amsterdam, Amsterdam, The Netherlands

    Marcel Worring

  4. Barcelona Media Research Foundation, Barcelona, Spain

    Yana Volkovich

  5. National Research University Higher School of Economics, Moscow, Russia

    Dmitry I. Ignatov

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Konyushkova, K., Głowacka, D. (2015). ImSe: Exploratory Time-Efficient Image Retrieval System. In: Braslavski, P., Karpov, N., Worring, M., Volkovich, Y., Ignatov, D.I. (eds) Information Retrieval. RuSSIR 2014. Communications in Computer and Information Science, vol 505. Springer, Cham. https://doi.org/10.1007/978-3-319-25485-2_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-25485-2_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-25484-5

  • Online ISBN: 978-3-319-25485-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation