Skip to main content

Event Detection for Heterogeneous News Streams

  • Conference paper
  • First Online:
Natural Language Processing and Information Systems (NLDB 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10260))

Abstract

In this paper we tackle the problem of detecting events from multiple and heterogeneous streams of news. In particular, we focus on news which are heterogeneous in length and writing styles since they are published on different platforms (i.e., Twitter, RSS portals, and news websites). This heterogeneity makes the event detection task more challenging, hence we propose an approach able to cope with heterogeneous streams of news. Our technique combines topic modeling, named-entity recognition, and temporal analysis to effectively detect events from news streams. The experimental results confirmed that our approach is able to better detect events than other state-of-the-art techniques and to divide the news in high-precision clusters based on the events they describe.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The words channel and stream are used interchangeably in this paper, and we use the general term news to refer to a news article, an RSS feed, or a tweet.

  2. 2.

    https://www.crowdflower.com/.

References

  1. Allan, J., Papka, R., Lavrenko, V.: On-line new event detection and tracking. In: 21st International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 37–45. ACM, New York (1998)

    Google Scholar 

  2. Becker, H., Naaman, M., Gravano, L.: Beyond trending topics: real-world event identification on Twitter. In: International AAAI Conference on Web and Social Media (2011)

    Google Scholar 

  3. Ding, C., He, X.: K-means clustering via principal component analysis. In: 21st International Conference on Machine Learning, pp. 29–38. ACM, New York (2004)

    Google Scholar 

  4. Fung, G.P.C., Yu, J.X., Yu, P.S., Lu, H.: Parameter free bursty events detection in text streams. In: 31st International Conference on Very Large Data Bases, pp. 181–192. VLDB Endowment (2005)

    Google Scholar 

  5. Gwadera, R., Crestani, F.: Mining and ranking streams of news stories using cross-stream sequential patterns. In: 18th ACM Conference on Information and Knowledge Management, pp. 1709–1712. ACM, New York (2009)

    Google Scholar 

  6. He, Q., Chang, K., Lim, E.P.: Analyzing feature trajectories for event detection. In: 30th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 207–214. ACM, New York (2007)

    Google Scholar 

  7. Li, C., Sun, A., Datta, A.: Twevent: segment-based event detection from tweets. In: 21st ACM International Conference on Information and Knowledge Management, pp. 155–164. ACM, New York (2012)

    Google Scholar 

  8. Li, C., Weng, J., He, Q., Yao, Y., Datta, A., Sun, A., Lee, B.S.: TwiNER: named entity recognition in targeted Twitter stream. In: 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 721–730 ACM, New York (2012)

    Google Scholar 

  9. Lu, Y., Mei, Q., Zhai, C.: Investigating task performance of probabilistic topic models: an empirical study of PLSA and LDA. Inf. Retr. 14(2), 178–203 (2011)

    Article  Google Scholar 

  10. Phuvipadawat, S., Murata, T.: Breaking news detection and tracking in Twitter. In: 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, vol. 3, pp. 120–123. IEEE Computer Society, Washington, DC (2010)

    Google Scholar 

  11. Popescu, A.M., Pennacchiotti, M., Paranjpe, D.: Extracting events and event descriptions from Twitter. In: 20th International Conference Companion on World Wide Web, pp. 105–106. ACM, New York (2011)

    Google Scholar 

  12. Ritter, A., Clark, S., Mausam, Etzioni, O.: Named entity recognition in tweets: an experimental study. In: Conference on Empirical Methods in Natural Language Processing, pp. 1524–1534. Association for Computational Linguistics, Stroudsburg (2011)

    Google Scholar 

  13. Ritter, A., Mausam, Etzioni, O., Clark, S.: Open domain event extraction from Twitter. In: 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1104–1112. ACM, New York (2012)

    Google Scholar 

  14. Sakaki, T., Okazaki, M., Matsuo, Y.: Earthquake shakes Twitter users: real-time event detection by social sensors. In: 19th International Conference Companion on World Wide Web, pp. 851–860. ACM, New York (2010)

    Google Scholar 

  15. Weng, J., Lee, B.S.: Event detection in Twitter. In: International AAAI Conference on Web and Social Media (2011)

    Google Scholar 

  16. Yan, X., Guo, J., Lan, Y., Cheng, X.: A biterm topic model for short texts. In: 22nd International Conference Companion on World Wide Web, pp. 1445–1456. ACM, New York (2013)

    Google Scholar 

Download references

Acknowledgement

This research was partially funded by the Secrétariat d’Etat à la formation, à la recherche et à l’innovation (SEFRI) under the project AHTOM (Asynchronous and Heterogeneous TOpic Mining).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ida Mele .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Mele, I., Crestani, F. (2017). Event Detection for Heterogeneous News Streams. In: Frasincar, F., Ittoo, A., Nguyen, L., Métais, E. (eds) Natural Language Processing and Information Systems. NLDB 2017. Lecture Notes in Computer Science(), vol 10260. Springer, Cham. https://doi.org/10.1007/978-3-319-59569-6_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-59569-6_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-59568-9

  • Online ISBN: 978-3-319-59569-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics