Skip to main content
SpringerLink
Log in
Book cover

International Conference on Similarity Search and Applications

SISAP 2019: Similarity Search and Applications pp 340–347Cite as

Towards Automatic Configuration of Interactive Known-Item Search Systems

  • Conference paper
  • First Online:

  • 1033 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11807))

Abstract

Searching for one particular scene in a large annotation-free video archive becomes a common task in the multimedia age. Since the task is inherently difficult without knowledge of the scene location, multimedia management systems utilize various notions of similarity and provide both effective retrieval models and interactive interfaces. In this paper, we propose a vision of a simulation framework for automatic configuration of interactive known-item search video retrieval systems. We believe that such framework could help with early, resource-inexpensive evaluations and therefore automatic parameters tuning, detection of effective search strategies and effective configuration of client prototypes.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Note that the interactive systems usually comprise a wide set of available retrieval components and practically unbound list of possible interaction sequences with unknown rewards varying for individual tasks.

  2. 2.

    Note that we adopted several concepts, e.g., user, system, action, interface card, interaction sequence and interaction cost/reward, defined in [19].

  3. 3.

    C(I) could be defined as a simple sum of all interactions costs, but could also perform some non-linear transformation of them, e.g., impose a threshold on the maximal allowed costs. Nonetheless, C(I) should maintain the non-increasing property for the prefixes of I.

  4. 4.

    Optionally, it could also consider the cost of created interaction sequence C(I).

  5. 5.

    Note that due to the size of action space in some components, posteriori optimal model cannot be effectively evaluated and some approximations may be necessary.

References

  1. Barraza-Urbina, A.: The exploration-exploitation trade-off in interactive recommender systems. In: Eleventh ACM Conference on Recommender Systems, RecSys 2017 (2017)

    Google Scholar 

  2. Barthel, K.U., Hezel, N., Jung, K.: Visually browsing millions of images using image graphs. In: 2017 ACM on International Conference on Multimedia Retrieval, ICMR 2017, pp. 475–479 (2017)

    Google Scholar 

  3. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)

    MATH  Google Scholar 

  4. Brodén, B., Hammar, M., Nilsson, B.J., Paraschakis, D.: Ensemble recommendations via thompson sampling: an experimental study within e-commerce. In: 23rd International Conference on Intelligent User Interfaces, IUI 2018, pp. 19–29. ACM (2018)

    Google Scholar 

  5. Ferecatu, M., Geman, D.: A statistical framework for image category search from a mental picture. IEEE Trans. Pattern Anal. Mach. Intell. 31(6), 1087–1101 (2009)

    Article  Google Scholar 

  6. Gordo, A., Almazán, J., Revaud, J., Larlus, D.: Deep image retrieval: learning global representations for image search. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9910, pp. 241–257. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46466-4_15

    Chapter  Google Scholar 

  7. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2016)

    Google Scholar 

  8. Keskustalo, H., Järvelin, K., Pirkola, A.: Evaluating the effectiveness of relevance feedback based on a user simulation model: effects of a user scenario on cumulated gain value. Inf. Retrieval 11(3), 209–228 (2008)

    Article  Google Scholar 

  9. Lokoč, J., Bailer, W., Schoeffmann, K., Muenzer, B., Awad, G.: On influential trends in interactive video retrieval: video browser showdown 2015–2017. IEEE Trans. Multimedia 20(12), 3361–3376 (2018)

    Article  Google Scholar 

  10. Lokoč, J., et al.: Interactive search or sequential browsing? A detailed analysis of the video browser showdown 2018. ACM Trans. Multimedia Comput. Commun. Appl. (TOMM) 15(1), 29 (2018)

    Google Scholar 

  11. Lokoč, J., Phuong, A.N., Vomlelová, M., Ngo, C.-W.: Color-sketch simulator: a guide for color-based visual known-item search. In: Cong, G., Peng, W.-C., Zhang, W.E., Li, C., Sun, A. (eds.) ADMA 2017. LNCS (LNAI), vol. 10604, pp. 754–763. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-69179-4_53

    Chapter  Google Scholar 

  12. Noia, T.D., Rosati, J., Tomeo, P., Sciascio, E.D.: Adaptive multi-attribute diversity for recommender systems. Inf. Sci. 382, 234–253 (2017)

    Article  Google Scholar 

  13. Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Neural Information Processing Systems (NIPS) (2015)

    Google Scholar 

  14. Rossetto, L., Giangreco, I., Gasser, R., Schuldt, H.: Competitive video retrieval with vitrivr. In: Schoeffmann, K., et al. (eds.) MMM 2018. LNCS, vol. 10705, pp. 403–406. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-73600-6_41

    Chapter  Google Scholar 

  15. Shelhamer, E., Long, J., Darrell, T.: Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(4), 640–651 (2017)

    Article  Google Scholar 

  16. Steck, H.: Calibrated recommendations. In: 12th ACM Conference on Recommender Systems, RecSys 2018, pp. 154–162 (2018)

    Google Scholar 

  17. Vinyals, O., Toshev, A., Bengio, S., Erhan, D.: Show and tell: lessons learned from the 2015 MSCOCO image captioning challenge. IEEE Trans. Pattern Anal. Mach. Intell. 39(4), 652–663 (2017)

    Article  Google Scholar 

  18. Zezula, P., Amato, G., Dohnal, V., Batko, M.: Similarity Search - The Metric Space Approach. Advances in Database Systems, vol. 32. Kluwer (2006)

    Google Scholar 

  19. Zhang, Y., Liu, X., Zhai, C.: Information retrieval evaluation as search simulation: a general formal framework for IR evaluation. In: ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2017, pp. 193–200 (2017)

    Google Scholar 

  20. Zhao, Q., Willemsen, M.C., Adomavicius, G., Harper, F.M., Konstan, J.A.: Interpreting user inaction in recommender systems. In: 12th ACM Conference on Recommender Systems, RecSys 2018, pp. 40–48 (2018)

    Google Scholar 

  21. Zoph, B., Vasudevan, V., Shlens, J., Le, Q.V.: Learning transferable architectures for scalable image recognition. CoRR abs/1707.07012 (2017)

    Google Scholar 

Download references

Acknowledgements

This paper has been supported by Czech Science Foundation (GAČR) projects Nr. 19-22071Y and 17-22224S.

Author information

Authors and Affiliations

  1. SIRET Research Group, Department of Software Engineering, Faculty of Mathematics and Physics, Charles University, Prague, Czech Republic

    Ladislav Peška, Gregor Kovalčík & Jakub Lokoč

Authors
  1. Ladislav Peška
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gregor Kovalčík
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jakub Lokoč
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ladislav Peška .

Editor information

Editors and Affiliations

  1. ISTI-CNR, Pisa, Italy

    Giuseppe Amato

  2. ISTI-CNR, Pisa, Italy

    Claudio Gennaro

  3. New Jersey Institute of Technology, Newark, NJ, USA

    Vincent Oria

  4. University of Novi Sad, Novi Sad, Serbia

    Miloš Radovanović

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Peška, L., Kovalčík, G., Lokoč, J. (2019). Towards Automatic Configuration of Interactive Known-Item Search Systems. In: Amato, G., Gennaro, C., Oria, V., Radovanović , M. (eds) Similarity Search and Applications. SISAP 2019. Lecture Notes in Computer Science(), vol 11807. Springer, Cham. https://doi.org/10.1007/978-3-030-32047-8_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32047-8_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32046-1

  • Online ISBN: 978-3-030-32047-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation