Abstract
Improving users’ interactions with a video retrieval system requires the examination of the search behavior of real users. This paper presents a study that examines and compares the video search behavior of professional archivists and novice users. The comparison focuses on the use and effectiveness of different state-of-the-art video search methods offered by the VITALAS retrieval system, and also on the behavior of the two user groups during their interactions with the retrieval results. We conducted our experiments in the context of TRECVID’s 2009 interactive search task, using the provided collection and topics for our evaluation. The findings are based on a qualitative questionnaire analysis and a quantitative examination of the logged user actions on the search interface. The experimental results indicate that today’s visual search techniques have improved in effectiveness, confirming a trend found in previous user studies. To our surprise, professional archivists used visual concept search in many of their searches. Queries containing visual concepts were more effective, resulting in more relevant shots found than the alternative methods. Overall, we conclude that professional archivists are more focused on recall when carrying out their search tasks and are better at reflecting on their own search performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Boujemaa, N., Fauqueur, J., Ferecatu, M., Fleuret, F., Gouet, V., Le Saux, B., Sahbi, H.: Ikona: Interactive generic and specific image retrieval. In: Proceedings of the International Workshop on Multimedia Content-Based Indexing and Retrieval, MMCBIR 2001 (2001)
Christel, M.G.: Establishing the utility of non-text search for news video retrieval with real world users. In: Lienhart, R., Prasad, A.R., Hanjalic, A., Choi, S., Bailey, B.P., Sebe, N. (eds.) Proceedings of the 15th ACM International Conference on Multimedia, pp. 707–716. ACM, New York (2007)
Christel, M.G., Conescu, R.M.: Addressing the challenge of visual information access from digital image and video libraries. In: Marlino, M., Sumner, T., Shipman III, F.M. (eds.) Proceedings of the ACM/IEEE Joint Conference on Digital Libraries (JCDL 2005), pp. 69–78. ACM, New York (2005)
Christel, M.G., Conescu, R.M.: Mining Novice User Activity with TRECVID Interactive Retrieval Tasks. In: Sundaram, H., Naphade, M.R., Smith, J.R., Rui, Y. (eds.) CIVR 2006. LNCS, vol. 4071, pp. 21–30. Springer, Heidelberg (2006)
Christel, M.G., Moraveji, N.: Finding the right shots: assessing usability and performance of a digital video library interface. In: Schulzrinne, et al. (eds.) [12], pp. 732–739
Christel, M.G., Yan, R.: Merging storyboard strategies and automatic retrieval for improving interactive video search. In: Sebe, N., Worring, M. (eds.) Proceedings of the 6th ACM International Conference on Image and Video Retrieval (CIVR 2007), pp. 486–493. ACM, New York (2007)
Diou, C., Stephanopoulos, G., Dimitriou, N., Panagiotopoulos, P., Papachristou, C., Delopoulos, A., Rode, H., Tsikrika, T., de Vries, A.P., Schneider, D., Schwenninger, J., Viaud, M.-L., Saulnier, A., Altendorf, P., Schröter, B., Elser, M., Rego, A., Rodriguez, A., Martínez, C., Etxaniz, I., Dupont, G., Grilhères, B., Martin, N., Boujemaa, N., Joly, A., Enficiaud, R., Verroust, A., Selmi, S., Khadhraoui, M.: VITALAS at TRECVID-2009. In: Proceedings of the 7th TREC Video Retrieval Evaluation Workshop, TRECVID 2009 (2009)
Gauvain, J.-L., Lamel, L., Adda, G.: The LIMSI broadcast news transcription system. Speech Communication 37(1-2), 89–108 (2002)
Hauptmann, A.G., Christel, M.G.: Successful approaches in the TREC video retrieval evaluations. In: Schulzrinne, et al. (eds.) [12], pp. 668–675
Hiemstra, D., Rode, H., van Os, R., Flokstra, J.: PFTijah: text search in an XML database system. In: Proceedings of the 2nd International Workshop on Open Source Information Retrieval (OSIR 2006), pp. 12–17 (2006)
Hollink, L., Nguyen, G., Koelma, D., Schreiber, A., Worring, M.: Assessing user behaviour in news video retrieval. In: IEE Proceedings on Vision, Image and Signal Processing, pp. 911–918 (2005)
Schulzrinne, H., Dimitrova, N., Sasse, M.A., Moon, S.B., Lienhart, R. (eds.) Proceedings of the 12th ACM International Conference on Multimedia. ACM, New York (2004)
Snoek, C.G.M., van de Sande, K.E.A., de Rooij, O., Huurnink, B., Uijlings, J.R.R., van Liempt, M., Bugalho, M., Trancoso, I., Yan, F., Tahir, M.A., Mikolajczyk, K., Kittler, J., de Rijke, M., Geusebroek, J.-M., Gevers, T., Worring, M., Koelma, D.C., Smeulders, A.W.M.: The MediaMill TRECVID 2009 semantic video search engine. In: Proceedings of the 7th TREC Video Retrieval Evaluation Workshop, TRECVID 2009 (2009)
Snoek, C.G.M., van de Sande, K.E.A., de Rooij, O., Huurnink, B., van Gemert, J.C., Uijlings, J.R.R., He, J., Li, X., Everts, I., Nedovic, V., van Liempt, M., van Balen, R., Yan, F., Tahir, M.A., Mikolajczyk, K., Kittler, J., de Rijke, M., Geusebroek, J.-M., Gevers, T., Worring, M., Smeulders, A.W.M., Koelma, D.C.: The MediaMill TRECVID 2008 semantic video search engine. In: Proceedings of the 6th TREC Video Retrieval Evaluation Workshop (TRECVID 2008) (2008)
Westman, S., Lustila, A., Oittinen, P.: Search strategies in multimodal image retrieval. In: Lalmas, M., Tombros, A., Borlund, P., Schneider, J.W., Kelly, D., Feather, J., de Vries, A.P. (eds.) Proceedings of the 2nd International Conference on Information Interaction in Context (IIiX 2008), pp. 13–20. ACM, New York (2008)
Wilkins, P., Troncy, R., Halvey, M., Byrne, D., Amin, A., Punitha, P., Smeaton, A.F., Villa, R.: User variance and its impact on video retrieval benchmarking. In: Marchand-Maillet, S., Kompatsiaris, Y. (eds.) Proceedings of the 8th International Conference on Content-based Image and Video Retrieval (CIVR 2009), pp. 1–8. ACM, New York (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rode, H., Tsikrika, T., de Vries, A.P. (2011). Differences in Video Search Behavior between Novices and Archivists. In: Detyniecki, M., Knees, P., Nürnberger, A., Schedl, M., Stober, S. (eds) Adaptive Multimedia Retrieval. Context, Exploration, and Fusion. AMR 2010. Lecture Notes in Computer Science, vol 6817. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-27169-4_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-27169-4_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-27168-7
Online ISBN: 978-3-642-27169-4
eBook Packages: Computer ScienceComputer Science (R0)