ABSTRACT
We propose a novel algorithm for uncovering the colloquial boundaries of locally characterizing regions present in collections of labeled geospatial data. We address the problem by first modeling the data using scale-space theory, allowing us to represent it simultaneously across different scales as a family of increasingly smoothed density distributions. We then derive region boundaries by applying localized label weighting and image processing techniques to the scale-space representation of each label. Important insights into the data can be acquired by visualizing the shape and size of the resulting boundaries for each label at multiple scales. We demonstrate our technique operating at scale by discovering the boundaries of the most geospatially salient tags associated with a large collection of georeferenced photos from Flickr and compare our characterizing regions that emerge from the data with those produced by a recent technique from the research literature.
- S. Ahern, M. Naaman, R. Nair, and J. Yang. World explorer: visualizing aggregate data from unstructured text in geo-referenced collections. JDCL, pp. 1--10, 2007. Google ScholarDigital Library
- T. Ai and J. Li. The lifespan model of GIS data representation over scale space. GEOINFORMATICS, pp. 1--6, 2009.Google Scholar
- Y. Baba, F. Ishikawa, and S. Honiden. Extraction of places related to Flickr tags. ECAI, pp. 523--528, 2010. Google ScholarDigital Library
- T. Barkowsky, L. J. Latecki, and K.-F. Richter. Schematizing maps: simplification of geographic shape by discrete curve evolution. Spatial Cognition II, pp. 41--53, 2000. Google ScholarDigital Library
- H. Bay, A. Ess, T. Tuytelaars, and L. van Gool. Speeded-Up Robust Features (SURF). CVIU, 110(3):346--359, 2008. Google ScholarDigital Library
- F. Chang, C.-J. Chen, and C.-J. Lu. A linear-time component-labeling algorithm using contour tracing technique. CVIU, 93:206--220, 2004. Google ScholarDigital Library
- W.-C. Chen, A. Battestini, N. Gelfand, and V. Setlur. Visual summaries of popular landmarks from community photo collections. ICMR, pp. 789--782, 2009.Google Scholar
- M. Cristani, A. Perina, U. Castellani, and V. Murino. Content visualization and management of geo-located image databases. CHI, pp. 2823--2828, 2008. Google ScholarDigital Library
- D.-P. Deng, T.-R. Chuang, and R. Lemmens. Conceptualization of place via spatial clustering and co-occurrence analysis. LBSN, pp. 49--56, 2009. Google ScholarDigital Library
- V. Estivill-Castro and I. Lee. AUTOCLUST: automatic clustering via boundary extraction for mining massive point-data sets. GeoComputation, 2001.Google Scholar
- P. F. Felzenszwalb and D. P. Huttenlocher. Distance transforms of sampled functions. Theory of Computing, 8(1):415--428, 2012.Google Scholar
- J. Gall. Use of cylindrical projections for geographical, astronomical, and scientific purposes. Scottish Geographical Magazine, 1(4):119--123, 1885.Google Scholar
- W. W. Hargrove and F. M. Ho man. Using multivariate clustering to characterize ecoregion borders. CiSE, 1(4):18--25, 1999. Google ScholarDigital Library
- C. Hau and G.-J. Houben. Geo-location estimation of Flickr images: social web based enrichment. ECIR, pp. 85--96, 2012. Google ScholarDigital Library
- J. Hays and A. A. Efros. IM2GPS: estimating geographic information from a single image. CVPR, pp. 1--8, 2008.Google ScholarCross Ref
- H. Hotta and M. Hagiwara. A neural-network-based geographic tendency visualization. WI-IAT, pp. 817--823, 2008. Google ScholarDigital Library
- H. Hotta and M. Hagiwara. Online geovisualization with fast kernel density estimator. WI-IAT, pp. 622--625, 2009. Google ScholarDigital Library
- S. Intagorn and K. Lerman. Learning boundaries of vague places from noisy annotations. SIGSPATIAL, pp. 425--428, 2011. Google ScholarDigital Library
- A. Jaffe, M. Naaman, T. Tassa, and M. Davis. Generating summaries and visualization for large collections of geo-referenced photographs. MIR, pp. 89--98, 2006. Google ScholarDigital Library
- R. Jain. Experiential computing. CACM, 46(7):48--54, 2003. Google ScholarDigital Library
- C. B. Jones, R. S. Purves, P. D. Clough, and H. Joho. Modelling vague places with knowledge from the Web. IJGIS, 22(10):1045--1065, 2008. Google ScholarDigital Library
- D. Jung, H. Park, R. Maeng, and S. Han. A geometric pattern-based method to build hierarchies of geo-referenced tags. SocialCom, pp. 546--551, 2010. Google ScholarDigital Library
- L. S. Kennedy and M. Naaman. Generating diverse and representative image search results for landmarks. WWW, pp. 297--306, 2008. Google ScholarDigital Library
- L. S. Kennedy, M. Naaman, S. Ahern, R. Nair, and T. Rattenbury. How Flickr helps us make sense of the world: context and content in community-contributed media collections. MM, pp. 631--640, 2007. Google ScholarDigital Library
- C. Kessler, P. Maue, J. T. Heuer, and T. Bartoschek. Bottom-up gazetteers: learning from the implicit semantics of geotags. GeoS, pp. 83--102, 2009. Google ScholarDigital Library
- J. Kleban, E. Moxley, J. Xu, and B. S. Manjunath. Global annotation on georeferenced photographs. CIVR, 2009. Google ScholarDigital Library
- J. J. Koenderink. The structure of images. Biological Cybernetics, 50:363--370, 1984.Google Scholar
- I. Laptev, H. Mayer, T. Lindeberg, W. Eckstein, C. Steger, and A. Baumgartner. Automatic extraction of roads from aerial images based on scale space and snakes. Machine Vision and Applications, 12:23--31, 2000. Google ScholarDigital Library
- M. S. Lew, N. Sebe, C. Djeraba, and R. Jain. Content-based multimedia information retrieval: state of the art and challenges. TOMCCAP, 2(1):1--19, 2006. Google ScholarDigital Library
- O. Linde and T. Lindeberg. Composed complex-cue histograms: An investigation of the information content in receptive field based image descriptors for object recognition. CVIU, 116(4):538--560, 2012. Google ScholarDigital Library
- T. Lindeberg. Detecting salient blob-like image structures and their scales with a scale-space primal sketch: a method for focus of attention. IJCV, 11(3):283--318, 1993. Google ScholarDigital Library
- D. G. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 60(2):91--110, 2004. Google ScholarDigital Library
- C.-A. Lu, C.-H. Chen, and P.-J. Cheng. Clustering and visualizing geographic data using geo-tree. WI-IAT, pp. 479--482, 2011. Google ScholarDigital Library
- R. Raguram, C. Wu, J.-M. Frahm, and S. Lazebnik. Modeling and recognition of landmark image collections using iconic scene graphs. IJCV, 95(3):213--239, 2011. Google ScholarDigital Library
- U. Ramer. An iterative procedure for the polygonal approximation of plane curves. Computer Graphics and Image Processing, 1(3):244--256, 1972.Google Scholar
- T. Rattenbury, N. Good, and M. Naaman. Towards automatic extraction of event and place semantics from Flickr tags. SIGIR, pp. 103--110, 2007. Google ScholarDigital Library
- T. Rattenbury and M. Naaman. Methods for extracting place semantics from Flickr tags. TWEB, 3(1):1, 2009. Google ScholarDigital Library
- S. Robertson and H. Zaragoza. The probabilistic relevance framework: BM25 and beyond. FTIR, 3(4):333--389, 2009. Google ScholarDigital Library
- S. Rudinac, A. Hanjalic, and M. Larson. Finding representative and diverse community contributed images to create visual summaries of geographic areas. ICMR, pp. 1109--1112, 2011. Google ScholarDigital Library
- P. Serdyukov, V. Murdock, and R. van Zwol. Placing Flickr photos on a map. SIGIR, pp. 484--491, 2009. Google ScholarDigital Library
- B. Sigurbjornsson and R. v. Zwol. Flickr Tag Recommendation based on Collective Knowledge. WWW, pp. 327--336, 2008. Google ScholarDigital Library
- M. Taylor, H. Zaragoza, N. Craswell, S. Robertson, and C. Burges. Optimisation methods for ranking functions with multiple parameters. CIKM, pp. 585--593, 2006. Google ScholarDigital Library
- B. Thomee and A. Rae. Exploring and Browsing Photos through Characteristic Geographic Tag Regions. MM, pp. 1273--1274, 2012. Google ScholarDigital Library
- O. Van Laere, S. Schockaert, and B. Dhoedt. Finding locations of Flickr resources using language models and similarity search. ICMR, article 48, 2011. Google ScholarDigital Library
- F. Wang. Job access and homicide patterns in Chicago: an analysis at multiple geographic levels based on scale-space theory. JQC, 21(2):195--217, 2005.Google Scholar
- K. Q. Weinberger, M. Slaney, and R. van Zwol. Resolving tag ambiguity. MM, pp. 111--120, 2008. Google ScholarDigital Library
- A. Witkin. Scale-space filtering: a new approach to multi-scale description. ICASSP, 9:150--153, 1984.Google ScholarCross Ref
- K. Yanai, H. Kawakubo, and B. Qiu. A visual analysis of the relationship between word concepts and geographical locations. CIVR, article 13, 2009. Google ScholarDigital Library
Index Terms
- Uncovering locally characterizing regions within geotagged data
Recommendations
Exploring and browsing photos through characteristic geographic tag regions
MM '12: Proceedings of the 20th ACM international conference on MultimediaWe present a system that supports zoomable browsing and exploration of photos taken across the globe. Our system is based on a novel algorithm that automatically uncovers the colloquial boundaries of regions that are characteristic for individual tags ...
Scale- and rotation-invariant texture description with improved local binary pattern features
Local Binary Pattern (LBP) is an effective image descriptor based on joint distribution of signed gray level differences. Simplicity, discriminative power, computational efficiency and robustness to illumination changes are main properties of LBP. ...
Cognitive Visualization of Popular Regions Discovered From Geo-Tagged Social Media Data
This article focuses on the cognitive exploration of photo sharing data which contain information about the location where the photo was taken and potentially some description about the photo. Therefore, the features of photo-spots can be deduced. Spots ...
Comments