skip to main content
10.1145/2393347.2396301acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
poster

Geo-location inference on news articles via multimodal pLSA

Published: 29 October 2012 Publication History

Abstract

The fast evolution and adoption of social media creates an increasingly need for location based services. Location inference on news or events becomes an essential problem. This paper addresses the problem by extracting location involved topics (geo-topic) using both text content and visual content. This paper proposes a geo-topic extraction framework for geo-location inference, including location name entity recognition, location related image association and a multimodal location dependent pLSA geo-topic model. Experiments have shown that our fused model improves the f-score in geo-location inference by 10% compared with single modality based models.

References

[1]
E. Amitay, N. Har'El, R. Sivan, and A. Soffer. Web-a-where: geotagging web content. In Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, SIGIR'04, pages 273--280, New York, NY, USA, 2004. ACM.
[2]
R. F. Antonio Torralba and W. T. Freeman. Tiny images mit-csail-tr-2007-024. Technical report, MIT Computer Science and Artificial Intelligence Laboratory, 4 2007.
[3]
L. Cao, J. Yu, J. Luo, and T. S. Huang. Enhancing semantic and geographic annotation of web images via logistic canonical correlation regression. In Proceedings of the 17th ACM international conference on Multimedia, MM '09, pages 125--134, New York, NY, USA, 2009. ACM.
[4]
M. Cristani, A. Perina, U. Castellani, and V. Murino. Geo-located image analysis using latent representations. In Proc. IEEE Conf. Computer Vision and Pattern Recognition CVPR 2008, pages 1--8, 2008.
[5]
J. Ding, L. Gravano, and N. Shivakumar. Computing geographical scopes of web resources. In Proceedings of the 26th International Conference on Very Large Data Bases, VLDB '00, pages 545--556, San Francisco, CA, USA, 2000. Morgan Kaufmann Publishers Inc.
[6]
A. Gallagher, D. Joshi, J. Yu, and J. Luo. Geo-location inference from image content and user tags. In Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition Workshops CVPR Workshops 2009, pages 55--62, 2009.
[7]
J. Hays and A. A. Efros. IM2GPS: estimating geographic information from a single image. In Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2008.
[8]
T. Hofmann. Probabilistic latent semantic indexing. In Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, SIGIR '99, pages 50--57, New York, NY, USA, 1999. ACM.
[9]
D. Joshi, A. Gallagher, J. Yu, and J. Luo. Exploring user image tags for geo-location inference. In Proc. IEEE Int Acoustics Speech and Signal Processing (ICASSP) Conf, pages 5598--5601, 2010.
[10]
L. Kennedy, M. Naaman, S. Ahern, R. Nair, and T. Rattenbury. How flickr helps us make sense of the world: context and content in community-contributed media collections. In Proceedings of the 15th international conference on Multimedia, MULTIMEDIA '07, pages 631--640, New York, NY, USA, 2007. ACM.
[11]
J. D. Lafferty, A. McCallum, and F. C. N. Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the Eighteenth International Conference on Machine Learning, ICML '01, pages 282--289, San Francisco, CA, USA, 2001. Morgan Kaufmann Publishers Inc.
[12]
A. McCallum and W. Li. Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons. In Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - Volume 4, CONLL '03, pages 188--191, Stroudsburg, PA, USA, 2003. Association for Computational Linguistics.
[13]
A. Oliva and A. Torralba. Building the gist of a scene: the role of global image features in recognition. In Progress in Brain Research, page 2006, 2006.
[14]
Z. Yin, L. Cao, J. Han, C. Zhai, and T. Huang. Geographical topic discovery and comparison. In Proceedings of the 20th international conference on World wide web, WWW '11, pages 247--256, New York, NY, USA, 2011. ACM.

Cited By

View all
  • (2024)Geospatial Big Data: Survey and ChallengesIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing10.1109/JSTARS.2024.343837617(17007-17020)Online publication date: 2024
  • (2023)TopoBERT: a plug and play toponym recognition module harnessing fine-tuned BERTInternational Journal of Digital Earth10.1080/17538947.2023.223979416:1(3045-3063)Online publication date: 10-Aug-2023
  • (2019)Embedding Edge-attributed Relational HierarchiesProceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3331184.3331278(873-876)Online publication date: 18-Jul-2019
  • Show More Cited By

Index Terms

  1. Geo-location inference on news articles via multimodal pLSA

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '12: Proceedings of the 20th ACM international conference on Multimedia
    October 2012
    1584 pages
    ISBN:9781450310895
    DOI:10.1145/2393347
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 October 2012

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. feature fusion
    2. geo-location inference
    3. multimodal pLSA

    Qualifiers

    • Poster

    Conference

    MM '12
    Sponsor:
    MM '12: ACM Multimedia Conference
    October 29 - November 2, 2012
    Nara, Japan

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)5
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Geospatial Big Data: Survey and ChallengesIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing10.1109/JSTARS.2024.343837617(17007-17020)Online publication date: 2024
    • (2023)TopoBERT: a plug and play toponym recognition module harnessing fine-tuned BERTInternational Journal of Digital Earth10.1080/17538947.2023.223979416:1(3045-3063)Online publication date: 10-Aug-2023
    • (2019)Embedding Edge-attributed Relational HierarchiesProceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3331184.3331278(873-876)Online publication date: 18-Jul-2019
    • (2018)BreakingNews: Article Annotation by Image and Text ProcessingIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2017.272194540:5(1072-1085)Online publication date: 1-May-2018
    • (2017)Multimodal news article analysisProceedings of the 26th International Joint Conference on Artificial Intelligence10.5555/3171837.3172030(5136-5140)Online publication date: 19-Aug-2017
    • (2017)Joint Image-Text News Topic Detection and Tracking by Multimodal Topic And-Or GraphIEEE Transactions on Multimedia10.1109/TMM.2016.261627919:2(367-381)Online publication date: 1-Feb-2017
    • (2017)Location-Aware Personalized News Recommendation With Deep Semantic AnalysisIEEE Access10.1109/ACCESS.2017.26551505(1624-1638)Online publication date: 2017
    • (2017)Location-Aware News Recommendation Using Deep Localized Semantic AnalysisDatabase Systems for Advanced Applications10.1007/978-3-319-55753-3_32(507-524)Online publication date: 22-Mar-2017
    • (2014)LASOM: Location Aware Self-Organizing Map for discovering similar and unique visual features of geographical locations2014 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN.2014.6889972(263-270)Online publication date: Jul-2014
    • (2013)A location-based news article recommendation with explicit localized semantic analysisProceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval10.1145/2484028.2484064(293-302)Online publication date: 28-Jul-2013

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media