Abstract
Searching for one particular scene in a large annotation-free video archive becomes a common task in the multimedia age. Since the task is inherently difficult without knowledge of the scene location, multimedia management systems utilize various notions of similarity and provide both effective retrieval models and interactive interfaces. In this paper, we propose a vision of a simulation framework for automatic configuration of interactive known-item search video retrieval systems. We believe that such framework could help with early, resource-inexpensive evaluations and therefore automatic parameters tuning, detection of effective search strategies and effective configuration of client prototypes.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Note that the interactive systems usually comprise a wide set of available retrieval components and practically unbound list of possible interaction sequences with unknown rewards varying for individual tasks.
- 2.
Note that we adopted several concepts, e.g., user, system, action, interface card, interaction sequence and interaction cost/reward, defined in [19].
- 3.
C(I) could be defined as a simple sum of all interactions costs, but could also perform some non-linear transformation of them, e.g., impose a threshold on the maximal allowed costs. Nonetheless, C(I) should maintain the non-increasing property for the prefixes of I.
- 4.
Optionally, it could also consider the cost of created interaction sequence C(I).
- 5.
Note that due to the size of action space in some components, posteriori optimal model cannot be effectively evaluated and some approximations may be necessary.
References
Barraza-Urbina, A.: The exploration-exploitation trade-off in interactive recommender systems. In: Eleventh ACM Conference on Recommender Systems, RecSys 2017 (2017)
Barthel, K.U., Hezel, N., Jung, K.: Visually browsing millions of images using image graphs. In: 2017 ACM on International Conference on Multimedia Retrieval, ICMR 2017, pp. 475–479 (2017)
Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)
Brodén, B., Hammar, M., Nilsson, B.J., Paraschakis, D.: Ensemble recommendations via thompson sampling: an experimental study within e-commerce. In: 23rd International Conference on Intelligent User Interfaces, IUI 2018, pp. 19–29. ACM (2018)
Ferecatu, M., Geman, D.: A statistical framework for image category search from a mental picture. IEEE Trans. Pattern Anal. Mach. Intell. 31(6), 1087–1101 (2009)
Gordo, A., Almazán, J., Revaud, J., Larlus, D.: Deep image retrieval: learning global representations for image search. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9910, pp. 241–257. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46466-4_15
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2016)
Keskustalo, H., Järvelin, K., Pirkola, A.: Evaluating the effectiveness of relevance feedback based on a user simulation model: effects of a user scenario on cumulated gain value. Inf. Retrieval 11(3), 209–228 (2008)
Lokoč, J., Bailer, W., Schoeffmann, K., Muenzer, B., Awad, G.: On influential trends in interactive video retrieval: video browser showdown 2015–2017. IEEE Trans. Multimedia 20(12), 3361–3376 (2018)
Lokoč, J., et al.: Interactive search or sequential browsing? A detailed analysis of the video browser showdown 2018. ACM Trans. Multimedia Comput. Commun. Appl. (TOMM) 15(1), 29 (2018)
Lokoč, J., Phuong, A.N., Vomlelová, M., Ngo, C.-W.: Color-sketch simulator: a guide for color-based visual known-item search. In: Cong, G., Peng, W.-C., Zhang, W.E., Li, C., Sun, A. (eds.) ADMA 2017. LNCS (LNAI), vol. 10604, pp. 754–763. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-69179-4_53
Noia, T.D., Rosati, J., Tomeo, P., Sciascio, E.D.: Adaptive multi-attribute diversity for recommender systems. Inf. Sci. 382, 234–253 (2017)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Neural Information Processing Systems (NIPS) (2015)
Rossetto, L., Giangreco, I., Gasser, R., Schuldt, H.: Competitive video retrieval with vitrivr. In: Schoeffmann, K., et al. (eds.) MMM 2018. LNCS, vol. 10705, pp. 403–406. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-73600-6_41
Shelhamer, E., Long, J., Darrell, T.: Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(4), 640–651 (2017)
Steck, H.: Calibrated recommendations. In: 12th ACM Conference on Recommender Systems, RecSys 2018, pp. 154–162 (2018)
Vinyals, O., Toshev, A., Bengio, S., Erhan, D.: Show and tell: lessons learned from the 2015 MSCOCO image captioning challenge. IEEE Trans. Pattern Anal. Mach. Intell. 39(4), 652–663 (2017)
Zezula, P., Amato, G., Dohnal, V., Batko, M.: Similarity Search - The Metric Space Approach. Advances in Database Systems, vol. 32. Kluwer (2006)
Zhang, Y., Liu, X., Zhai, C.: Information retrieval evaluation as search simulation: a general formal framework for IR evaluation. In: ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2017, pp. 193–200 (2017)
Zhao, Q., Willemsen, M.C., Adomavicius, G., Harper, F.M., Konstan, J.A.: Interpreting user inaction in recommender systems. In: 12th ACM Conference on Recommender Systems, RecSys 2018, pp. 40–48 (2018)
Zoph, B., Vasudevan, V., Shlens, J., Le, Q.V.: Learning transferable architectures for scalable image recognition. CoRR abs/1707.07012 (2017)
Acknowledgements
This paper has been supported by Czech Science Foundation (GAČR) projects Nr. 19-22071Y and 17-22224S.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Peška, L., Kovalčík, G., Lokoč, J. (2019). Towards Automatic Configuration of Interactive Known-Item Search Systems. In: Amato, G., Gennaro, C., Oria, V., Radovanović , M. (eds) Similarity Search and Applications. SISAP 2019. Lecture Notes in Computer Science(), vol 11807. Springer, Cham. https://doi.org/10.1007/978-3-030-32047-8_30
Download citation
DOI: https://doi.org/10.1007/978-3-030-32047-8_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32046-1
Online ISBN: 978-3-030-32047-8
eBook Packages: Computer ScienceComputer Science (R0)