Skip to main content

Bursty Event Detection Model for Twitter

  • Conference paper
  • First Online:
Distributed Computing and Intelligent Technology (ICDCIT 2024)

Abstract

Huge amount of diversified information in the form of multimedia data gets uploaded to Online Social Network platform every second. This eventually gets a sudden burst during high impact events. Twitter platform plays a very important role during these events in the process of diffusion of this information across the entire social network of users. The real challenge is in the analysis of tweet during these bursty events when data gets generated in large volume with high arrival rate. Under this circumstances, near real-time detection of bursty event should be implemented to match up the speed of the information diffusion which demands efficient algorithms. In this paper a bursty event detection algorithm is proposed which considers a dynamic set of tweets in every time window and generates optimal k topics per window of a bursty event. This research has also studied the goodness of the topics produced across the different time windows. Our proposed model is successful in creating better semantically coherent and contextual topics for bursty event as compared to the other state of the art techniques such as Latent Dirichlet Allocation Model, Gibbs Sampling Dirichlet Mixture Model and Gamma-Poisson Mixture Topic Model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Comito, C., Forestiero, A., Pizzuti, C.: Bursty event detection in Twitter streams. ACM Trans. Knowl. Disc. Data (TKDD) 13(4), 1–28 (2019)

    Article  Google Scholar 

  2. Imran, M., Castillo, C., Diaz, F., Vieweg, S.: Processing social media messages in mass emergency: a survey. ACM Comput. Surv. (CSUR) 47(4), 1–38 (2015)

    Article  Google Scholar 

  3. Fedoryszak, M., Frederick, B., Rajaram, V., Zhong, C.: Real-time event detection on social data streams. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 2774––2782 (2019)

    Google Scholar 

  4. Lee, P., Lakshmanan, L.V., Milios, E.E.: Incremental cluster evolution tracking from highly dynamic network data. In: 2014 IEEE 30th International Conference on Data Engineering, pp. 3–14. IEEE (2014)

    Google Scholar 

  5. Singh, T., Kumari, M.: Burst: real-time events burst detection in social text stream. J. Supercomput. 77, 1–29 (2021)

    Article  Google Scholar 

  6. Mathioudakis, M., Koudas, N.: Twittermonitor: trend detection over the twitter stream. In: Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, pp. 1155–1158 (2010)

    Google Scholar 

  7. Guzman, J., Poblete, B.: On-line relevant anomaly detection in the Twitter stream: an efficient bursty keyword detection model. In: Proceedings of the ACM SIGKDD Workshop on Outlier Detection and Description, pp. 31–39 (2013)

    Google Scholar 

  8. Sakaki, T., Okazaki, M., Matsuo, Y.: Earthquake shakes Twitter users: real-time event detection by social sensors. In: Proceedings of the 19th International Conference on World Wide Web, pp. 851–860 (2010)

    Google Scholar 

  9. Zhao, W.X., Chen, R., Fan, K., Yan, H., Li, X.: A novel burst-based text representation model for scalable event detection. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp. 43–47 (2012)

    Google Scholar 

  10. Rezaei, Z., Eslami, B., Amini, M.A., Eslami, M.: Event detection in Twitter by deep learning classification and multi label clustering virtual backbone formation. Evol. Intell. 16(3), 833–847 (2023)

    Article  Google Scholar 

  11. Singh, J., Pandey, D., Singh, A.K.: Event detection from real-time twitter streaming data using community detection algorithm. Multimed. Tools Appl., 1–28 (2023)

    Google Scholar 

  12. Yang, J., Wu, Y.: An approach of bursty event detection in social networks based on topological features. Appl. Intell., 1–19 (2022)

    Google Scholar 

  13. Kleinberg, J.: Bursty and hierarchical structure in streams. Data Min. Knowl. Disc. 7(4), 373–397 (2003)

    Article  MathSciNet  Google Scholar 

  14. Weng, J., Lee, B.S.: Event detection in Twitter. In: Proceedings of the International AAAI Conference on Web and Social Media, vol. 5, no. 1 (2011)

    Google Scholar 

  15. Naaman, M., Becker, H., Gravano, L.: Hip and trendy: characterizing emerging trends on Twitter. J. Am. Soc. Inform. Sci. Technol. 62(5), 902–918 (2011)

    Article  Google Scholar 

  16. Li, C., Sun, A., Datta, A.: Twevent: segment-based event detection from tweets. In: Proceedings of the 21st ACM International Conference on Information and Knowledge Management, pp. 155–164 (2012)

    Google Scholar 

  17. Xie, W., Zhu, F., Jiang, J., Lim, E.P., Wang, K.: Topicsketch: real-time bursty topic detection from Twitter. IEEE Trans. Knowl. Data Eng. 28(8), 2216–2229 (2016)

    Article  Google Scholar 

  18. Becker, H., Naaman, M., Gravano, L.: Beyond trending topics: real-world event identification on Twitter. In: Proceedings of the International AAAI Conference on Web and Social Media, vol. 5, no. 1 (2011)

    Google Scholar 

  19. Osborne, M., et al.: Real-time detection, tracking, and monitoring of automatically discovered events in social media. In: Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pp. 37–42 (2014)

    Google Scholar 

  20. Hasan, M., Orgun, M.A., Schwitter, R.: TwitterNews: real time event detection from the Twitter data stream. PeerJ PrePrints 4, e2297v1 (2016)

    Google Scholar 

  21. Li, J., Tai, Z., Zhang, R., Yu, W., Liu, L.: Online bursty event detection from microblog. In: 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing, pp. 865–870. IEEE (2014)

    Google Scholar 

  22. Zhang, C., et al.: Geoburst: real-time local event detection in geo-tagged tweet streams. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 513–522 (2016)

    Google Scholar 

  23. Bhuvaneswari, A., Valliyammai, C.: Identifying event bursts using log-normal distribution of tweet arrival rate in twitter stream. In: 2018 Tenth International Conference on Advanced Computing (ICoAC), pp. 339–343. IEEE (2018)

    Google Scholar 

  24. Ban, A., Zhang, Z., Gao, D., Zhou, Y., Gupta, B.B.: A novel burst event detection model based on cross social media influence (2022)

    Google Scholar 

  25. Sharma, S., Abulaish, M., Ahmad, T.: KEvent–A semantic-enriched graph-based approach capitalizing bursty keyphrases for event detection in OSN. In: 2022 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), pp. 588–595. IEEE (2022)

    Google Scholar 

  26. Mimno, D., Wallach, H., Talley, E., Leenders, M., McCallum, A.: Optimizing semantic coherence in topic models. In: Proceedings of the 2011 Conference on Empirical Methods in Natural Language (2011)

    Google Scholar 

  27. Zubiaga, A.: A longitudinal assessment of the persistence of Twitter datasets. J. Am. Soc. Inf. Sci. 69(8), 974–984 (2018)

    Google Scholar 

  28. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J, Mach. Learn. Res. 3, 993–1022 (2003)

    Google Scholar 

  29. Yin, J., Wang, J.: A dirichlet multinomial mixture model-based approach for short text clustering. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 233–242 (2014)

    Google Scholar 

  30. Mazarura, J., De Waal, A., de Villiers, P.: A gamma-poisson mixture topic model for short text. Math. Prob. Eng. 2020 (2020)

    Google Scholar 

  31. Röder, M., Both, A., Hinneburg, A.: Exploring the space of topic coherence measures. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, pp. 399–408 (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anuradha Goswami .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Goswami, A., Kumar, A., Pramod, D. (2024). Bursty Event Detection Model for Twitter. In: Devismes, S., Mandal, P.S., Saradhi, V.V., Prasad, B., Molla, A.R., Sharma, G. (eds) Distributed Computing and Intelligent Technology. ICDCIT 2024. Lecture Notes in Computer Science, vol 14501. Springer, Cham. https://doi.org/10.1007/978-3-031-50583-6_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-50583-6_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-50582-9

  • Online ISBN: 978-3-031-50583-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics