Abstract
Studying and analyzing system performance is one of the fundamental factors for the related technological advancement in image retrieval. In this paper, we report the construction of a large scale test collection for facilitating robust performance evaluation of mobile landmark image search. Totally, the test collection consists of (1) 355,141 images about 128 landmarks in five cities over 3 continents from Flickr; (2) different kinds of textual features for each image, including surrounding text (e.g. tags), contextual data (e.g. geo-location and upload time), and metadata (e.g. uploader and EXIF); and (3) six types of low-level visual features. For the task of landmark image retrieval evaluation, we also conduct a series of baseline experimental studies on the search performance over different visual queries, which represent different views of a landmark.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Avrithis, Y., Kalantidis, Y., Tolias, G., Spyrou, E.: Retrieving landmark and non-landmark images from community photo collections. In: ACM MM (2010)
Chen, D.M.: City-scale landmark identification on mobile devices. In: CVPR (2011)
Chen, W.-C., Battestini, A., Gelfand, N., Setlur, V.: Visual summaries of popular landmarks from community photo collections. In: ACM MM (2009)
Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image retrieval: Ideas, influences, and trends of the new age. ACM Comput. Surv. 40(2) (2008)
Gao, Y., Wang, M., Zha, Z., Shen, J., Li, X., Wu, X.: Visual-textual joint relevance learning for tag-based social image search. IEEE Transactions on Image Processing (inprint)
Huang, J., Kumar, S., Mitra, M., Zhu, W.-J., Zabih, R.: Image indexing using color correlogram. In: CVPR (1997)
Ji, R., Duan, L.-Y., Chen, J., Yao, H., Yuan, J., Rui, Y., Gao, W.: Location discriminative vocabulary coding for mobile landmark search. International Journal of Computer Vision 96(3) (2012)
Kennedy, L., Naaman, M.: Generating diverse and representative image search results for landmarks. In: WWW (2008)
Li, Y.P., Crandall, D.J., Huttenlocher, D.P.: Landmark classification in large-scale image collections. In: ICCV (2009)
Lowe, D.: Distinctive image features from scale-invariant keypoints. Computer Vision 2(60), 91–110 (2004)
Manjunath, B.S., Ma, W.Y.: Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Mach. Intell. 18(8), 837–842 (1996)
Park, D.K., Jeon, Y.S., Won, C.S.: Efficient use of local edge histogram descriptor. In: ACM MM (2000)
Ren, Y.H., Yu, M., Wang, X.J., Zhang, L., Ma, W.Y.: Diversifying landmark image search results by learning interested views from community photos. In: WWW (2010)
Shapiro, L.G., Stockman, G.C.: Computer Vision. Prentic Hall (2003)
Simon, I., Snavely, N., Seitz, S.M.: Scene summarization for online image collections. In: ICCV (2007)
Wang, M., Ni, B., Hua, X.-S., Chua, T.-S.: Assistive tagging: A survey of multimedia tagging with human-computer joint exploration. ACM Comput. Surv. 44(4), 25 (2012)
Wang, M., Yang, K., Hua, X.-S., Zhang, H.: Towards a relevant and diverse search of social images. IEEE Transactions on Multimedia 12(8), 829–842 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cheng, Z., Ren, J., Shen, J., Miao, H. (2013). Building a Large Scale Test Collection for Effective Benchmarking of Mobile Landmark Search. In: Li, S., et al. Advances in Multimedia Modeling. Lecture Notes in Computer Science, vol 7733. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35728-2_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-35728-2_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35727-5
Online ISBN: 978-3-642-35728-2
eBook Packages: Computer ScienceComputer Science (R0)