Pascal Kelm
ABSTRACT
We present three approaches for placing videos in Flickr on the world map. The toponym extraction and geo lookup approach makes use of external resources to identify toponyms in the metadata and associate them with geo-coordinates. The metadata-based region model approach uses a k-nearest-neighbour classifier trained over geographical regions. Videos are represented using their metadata in a text space with reduced dimensionality. The visual region model approach uses a support vector machine also trained over geographical regions. Videos are represented using low-level feature vectors from multiple key frames. Voting methods are used to form a single decision for each video. We compare the approaches experimentally, highlighting the importance of using appropriate metadata features and suitable regions as the basis of the region model. The best performance is achieved by the geo-lookup approach used with fallback to the visual region model when the video metadata contains no toponym.
- http://www.wikipedia.org.Google Scholar
- http://www.geonames.org.Google Scholar
- http://translate.google.com.Google Scholar
- J. Baldridge. The OpenNLP Project. http://www.opennlp.com, 2005.Google Scholar
- C. Cortes and V. Vapnik. Support-Vector Networks. Machine Learning, 20(3):273--297, 1995. Google ScholarDigital Library
- D. Crandall, L. Backstrom, D. Huttenlocher, and J. Kleinberg. Mapping the World's Photos. In Proceedings of the 18th international conference on World wide web, pages 761--770. ACM, 2009. Google ScholarDigital Library
- A. Dempster, N. Laird, and D. Rubin. Maximum Likelihood from Incomplete Data via the EM Algorithm. J. Roy. Statist. Soc. B, 39:1--38, 1977.Google ScholarCross Ref
- I. Densham and J. Reid. A geo-coding service encompassing a geo-parsing tool and integrated digital gazetteer service. In Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references - Volume 1, pages 79--80, Morristown, NJ, USA, 2003. Association for Computational Linguistics. Google ScholarDigital Library
- S. Gammeter, L. Bossard, T. Quack, and L. V. Gool. I know what you did last summer: object-level auto-annotation of holiday snaps. In Computer Vision, 2009 IEEE 12th International Conference on, 29 2009.Google ScholarCross Ref
- J. Hays and A. Efros. IM2GPS: estimating geographic information from a single image. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pages 1--8, 2008.Google ScholarCross Ref
- T. Hofmann. Unsupervised Learning by Probabilistic Latent Semantic Analysis. Machine Learning, 2001. Google ScholarDigital Library
- M. Larson, M. Soleymani, P. Serdyukov, S. Rudinac, C. Wartena, V. Murdock, G. Friedland, R. Ordelman, and G. J. F. Jones. Automatic tagging and geotagging in video collections and communities. ACM International Conference on Multimedia Retrieval (ICMR 2011), 2011. Google ScholarDigital Library
- M. Lux and S. Chatzichristofis. LIRe: Lucene Image Retrieval - An Extensible Java CBIR Library. In Proceeding of the 16th ACM international conference on Multimedia, pages 1085--1088. ACM, http://www.semanticmetadata.net/lire/, 2008. Google ScholarDigital Library
- B. Manjunath, P. Salembier, and T. Sikora, editors. Introduction to MPEG-7: Multimedia Content Description Interface. John Wiley LTD, 2002. Google ScholarDigital Library
- T. Quack, B. Leibe, and L. Van Gool. World-scale Mining of Objects and Events from Community Photo Collections. In Proceedings of the 2008 international conference on Content-based image and video retrieval, CIVR '08, pages 47--56, 2008. Google ScholarDigital Library
- P. Serdyukov, V. Murdock, and R. van Zwol. Placing Flickr Photos on a Map. In Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval, pages 484--491, Boston, MA, USA, 2009. ACM, ACM. Google ScholarDigital Library
- J. Witmer and J. Kalita. Extracting Geospatial Entities from Wikipedia. In Proceedings of the 2009 IEEE International Conference on Semantic Computing, ICSC '09, pages 450--457, Washington, DC, USA, 2009. IEEE Computer Society. Google ScholarDigital Library
Index Terms
- Multi-modal, multi-resource methods for placing Flickr videos on the map
Recommendations
A hierarchical, multi-modal approach for placing videos on the map using millions of Flickr photographs
SBNMA '11: Proceedings of the 2011 ACM workshop on Social and behavioural networked media accessWe present a hierarchical, multi-modal approach for placing Flickr videos on the map. Our approach makes use of external resources to identify toponyms in the metadata and of visual and textual features to identify similar content. First, the ...
A spatially-aware algorithm for location extraction from structured documents
AbstractPlace names facilitate locating and distinguishing geographic space where human activities and natural phenomena occur. Extracting place names at multiple spatial resolutions from text is beneficial in several tasks such as identifying the ...
Multi-scale region perpendicular local binary pattern: an effective feature for interest region description
This paper proposes the perpendicular local binary pattern (PLBP) for efficiently describing textures in an interest region. Its novelty is two-fold: (1) the candidate generation scheme provides a set of patterns for each pixel, instead of ...
Comments