Jitao Sang
Quan Fang
Abstract
With a smart phone at hand, it becomes easy now to snap pictures and publish them online with few lines of texts. The GPS coordinates and User-Generated Content (UGC) data embedded in the shared photos provide opportunities to exploit important knowledge to tackle interesting tasks like geographically organizing photos and location visualization. In this work, we propose to organize photos both geographically and semantically, and investigate the problem of location visualization from multiple semantic themes. The novel visualization scheme provides a rich display landscape for geographical exploration from versatile views. A two-level solution is presented, where we first identify the highly photographed places of interest (POI) and discover their focused themes, and then aggregate the lower-level POI themes to generate the higher-level city themes for location visualization. We have conducted experiments on crawled Flickr and Instagram data and exhibited the visualization for the cities of Singapore and Sydney. The experimental results have validated the proposed method and demonstrated the potentials of location visualization from multiple themes.
- Muhammad Salman Asif and Justin K. Romberg. 2009. Dynamic updating for L1 minimization. CoRR abs/0903.1443 (2009).Google Scholar
- S. P. Boyd and L. Vandenberghe. 2004. Convex Optimization. Cambridge University Press. Google ScholarCross Ref
- Jonathan Chang, Sean Gerrish, Chong Wang, Jordan L. Boyd-Graber, and David M. Blei. 2009. Reading tea leaves: How humans interpret topic models. In Advances in Neural Information Processing Systems. 288--296.Google ScholarDigital Library
- David J. Crandall, Lars Backstrom, Daniel P. Huttenlocher, and Jon M. Kleinberg. 2009. Mapping the world’s photos. In WWW. 761--770.Google Scholar
- Alberto Del Bimbo, K. Selcuk Candan, Jiebo Luo, Tao Mei, Nicu Sebe, Heng Tao Shen, Cees GM Snoek, Rong Yan, and others. 2014. Guest editorial special section on socio-mobile media analysis and retrieval. IEEE Trans. Multimedia 3, 16 (2014), 586--587.Google ScholarDigital Library
- Quan Fang, Jitao Sang, and Changsheng Xu. 2013a. Giant: Geo-informative attributes for location recognition and exploration. In Proceedings of the 21st ACM International Conference on Multimedia. ACM, 13--22. Google ScholarDigital Library
- Quan Fang, Jitao Sang, Changsheng Xu, and Ke Lu. 2013b. Paint the city colorfully: Location visualization from multiple themes. In MMM. 92--105.Google Scholar
- Brendan J. Frey and Delbert Dueck. 2007. Clustering by passing messages between data points. Science 315 (2007), 972--976. Google ScholarCross Ref
- Yue Gao, Jinhui Tang, Richang Hong, Qionghai Dai, Tat-Seng Chua, and Ramesh Jain. 2010. W2Go: A travel guidance system by automatic landmark ranking. In Proceedings of the 18th ACM International Conference on Multimedia. ACM, 123--132. Google ScholarDigital Library
- Qiang Hao, Rui Cai, Changhu Wang, Rong Xiao, Jiang-Ming Yang, Yanwei Pang, and Lei Zhang. 2010. Equip tourists with knowledge mined from travelogues. In WWW. 401--410.Google Scholar
- Claudia Hauff and Geert-Jan Houben. 2012a. Geo-location estimation of Flickr images: Social web based enrichment. In ECIR. 85--96.Google Scholar
- Claudia Hauff and Geert-Jan Houben. 2012b. Placing images on the world map: A microblog-based enrichment approach. In SIGIR. 691--700. Google ScholarDigital Library
- James Hays and Alexei A. Efros. 2008. im2gps: Estimating geographic information from a single image. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Google ScholarCross Ref
- Alexander Jaffe, Mor Naaman, Tamir Tassa, and Marc Davis. 2006. Generating summaries and visualization for large collections of geo-referenced photographs. In Multimedia Information Retrieval. 89--98. Google ScholarDigital Library
- Rongrong Ji, Ling-Yu Duan, Jie Chen, Hongxun Yao, Junsong Yuan, Yong Rui, and Wen Gao. 2012. Location discriminative vocabulary coding for mobile landmark search. Int. J. Comput. Vision 96, 3 (2012), 290--314. Google ScholarDigital Library
- Rongrong Ji, Yue Gao, Bineng Zhong, Hongxun Yao, and Qi Tian. 2011. Mining Flickr landmarks by modeling reconstruction sparsity. TOMCCAP 7, Supplement (2011), 31. Google ScholarDigital Library
- Lyndon S. Kennedy and Mor Naaman. 2008. Generating diverse and representative image search results for landmarks. In WWW. 297--306.Google Scholar
- Lyndon S. Kennedy, Mor Naaman, Shane Ahern, Rahul Nair, and Tye Rattenbury. 2007. How Flickr helps us make sense of the world: Context and content in community-contributed media collections. In ACM Multimedia. 631--640.Google Scholar
- Jey Han Lau, Karl Grieser, David Newman, and Timothy Baldwin. 2011. Automatic labelling of topic models. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1. 1536--1545.Google Scholar
- Heng Liu, Tao Mei, Jiebo Luo, Houqiang Li, and Shipeng Li. 2012b. Finding perfect rendezvous on the go: Accurate mobile visual localization and its applications to routing. In ACM Multimedia. 9--18.Google Scholar
- Jiajun Liu, Zi Huang, Lei Chen, Heng Tao Shen, and Zhixian Yan. 2012a. Discovering areas of interest with geo-tagged images and check-ins. In ACM Multimedia. 589--598. Google ScholarDigital Library
- Jiebo Luo, Dhiraj Joshi, Jie Yu, and Andrew C. Gallagher. 2011. Geotagging in multimedia and computer vision - A survey. Multimedia Tools Appl. 51, 1 (2011), 187--211. Google ScholarDigital Library
- Mor Naaman, Yee Jiun Song, Andreas Paepcke, and Hector Garcia Molina. 2004. Automatic organization for digital photographs with geographic coordinates. In Proceedings of the Fourth ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2004) (June 2004). http://ilpubs.stanford.edu:8090/766/.Google ScholarDigital Library
- Symeon Papadopoulos, Christos Zigkolis, Stefanos Kapiris, Yiannis Kompatsiaris, and Athena Vakali. 2010. ClustTour: City exploration by use of hybrid photo clustering. In ACM Multimedia. 1617--1620.Google Scholar
- Till Quack, Bastian Leibe, and Luc J. Van Gool. 2008. World-scale mining of objects and events from community photo collections. In CIVR. 47--56. Google ScholarDigital Library
- Daniel Ramage, Christopher D. Manning, and Susan Dumais. 2011. Partially labeled topic models for interpretable text mining. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 457--465. Google ScholarDigital Library
- Tye Rattenbury and Mor Naaman. 2009. Methods for extracting place semantics from Flickr tags. TWEB 3, 1 (2009), 1.Google ScholarDigital Library
- Pavel Serdyukov, Vanessa Murdock, and Roelof van Zwol. 2009. Placing Flickr photos on a map. In SIGIR. 484--491. Google ScholarDigital Library
- John Wright, Allen Y. Yang, Arvind Ganesh, Shankar S. Sastry, and Yi Ma. 2009. Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31, 2 (2009), 210--227. Google ScholarDigital Library
- Felix X. Yu, Rongrong Ji, and Shih-Fu Chang. 2011. Active query sensing for mobile location search. In ACM Multimedia. 3--12.Google Scholar
- Ying Zhao and George Karypis. 2001. Criterion functions for document clustering: Experiments and analysis. Machine Learning.Google Scholar
- Yan-Tao Zheng, Zheng-Jun Zha, and Tat-Seng Chua. 2011. Research and applications on georeferenced multimedia: A survey. Multimedia Tools Appl. 51, 1 (2011), 77--98. Google ScholarDigital Library
- Yan-Tao Zheng, Ming Zhao, Yang Song, Hartwig Adam, Ulrich Buddemeier, Alessandro Bissacco, Fernando Brucher, Tat-Seng Chua, and Hartmut Neven. June, 2009. Tour the world: Building a web-scale landmark recognition engine. In Proceedings of International Conference on Computer Vision and Pattern Recognition. DOI:http://dx.doi.org/10.1145/1291233.1291448 Google ScholarDigital Library
Index Terms
- Exploiting Social-Mobile Information for Location Visualization
Recommendations
Extract Knowledge About Geo-Location Using Context and Content Information of Geo-Tagged Social Media
Proceedings, Part I, of the 16th International Conference on Web Information Systems Engineering --- WISE 2015 - Volume 9418Recent years have witnessed a phenomenal growth of social sharing websites. These social sharing web sites host a large volume of geo-referenced and community contributed media resources. However, due to the size and inability of computers to understand ...
Topic based context-aware travel recommendation method exploiting geotagged photos
The popularity of camera phones and photo sharing websites, e.g. Flickr and Panoramio, has led to huge volumes of community-contributed geotagged photos (CCGPs) available on the Internet, which could be regarded as digital footprints of photo takers. In ...
Responsive geo-referenced content visualization based on a user interest model and level of detail
With steady growth in the deployment of sensor networks and widespread usage of mobile devices, the production of geo-referenced data is increasing exponentially, while analysis of the data typically uses a variety of application services on the ...
Comments