Abstract
Some events, such as terrorism attacks, earthquakes, and other events that represent tipping points, remain engraved in our memories. Today, through social media, researchers attempt to propose approaches for event detection. However, they are confronted to certain challenges owing to the noise of data propagated throughout social media. In this paper, a new mashup based method for event detection from social media is proposed using hadoop framework. The suggested approach aims at detecting real-world events by exploiting data collected from different social media sites. Indeed, the detected events are characterized by such descriptive dimensions as topic, time and location. Moreover, our approach assures a bilingual event detection. In fact, the proposed approach is able to detect events in English and French languages. In addition, our approach provides a mashup based multidimensional visualization by combining different multimedia components so as to add more details to the detected events. Furthermore, in order to overcome the problems occurring from the processing of big data, we integrated our approach into the hadoop distributed system.
Similar content being viewed by others
Notes
Wikimedia Foundation 2014
TDT 2004: Annotation manual, 2004 URL: http://catalog.ldc.upenn.edu/docs/LDC2006T19/TDT2004V1.2.pdf
References
Abdelhaq, H., Sengstock, C., Gertz, M. (2013). Eventweet: Online localized event detection from twitter. Proc. VLDB Endow. Aug, 6(12), 1326–1329. https://doi.org/10.14778/2536274.2536307.
Alqhtani, S.M., Luo, S., Regan, B. (2015). Fusing text and image for event detection in twitter. CoRR. arXiv:1503.03920:10.
Andrea, B.U., Hugo, H., Benjamin, H., Himasagar, T., Andrea, Y., Conor, H. (2016). Using social media for online television adaptation services at RT Ireland. Insight Centre for Data Analytics. Galway: National University of Ireland.
Beemer, B.A., & Gregg, D.G. (2009). Mashups: A literature review and classification framework. Future Internet, 1(1), 59–87. https://doi.org/10.3390/fi1010059.
Boyd, D., & Ellison, N.B. (2007). Social network sites: Definition, history, and scholarship. Journal Computer Mediated Communication, 13(1), 210–230. https://doi.org/10.1111/j.1083-6101.2007.00393.x.
Daniel, F., Weiss, M., Matera, M. (2011). Next in mashup development: User-created apps on the web. IT Professional, 13(undefined), 22–29. https://doi.org/doi.ieeecomputersociety.org/10.1109/MITP.2011.85.
Gadiraju, U., Naini, K.D., Ceroni, A., Georgescu, M., Pham, D.D., Dietze, S., Fisichella, M. (2014). Wikipevent: Temporal event data for the semantic web. In Proceedings of the 2014 International Conference on Posters 38; Demonstrations Track - Volume 1272, ISWC-PD’14, CEUR-WS.org: Aachen, Germany. http://dl.acm.org/citation.cfm?id=2878453.2878485 (pp. 125–128).
Guille, A., & Favre, C. (2015). Event detection, tracking, and visualization in twitter: a mention-anomaly-based approach. Social Network Analysis and Mining, 5(1), 18:1–18:18. https://doi.org/10.1007/s13278-015-0258-0.
Han, B., & Baldwin, T. (2011). Lexical normalisation of short text messages: Makn sens a twitter. In The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference, 19-24 June, 2011, Portland, Oregon, USA (pp. 368–378). http://www.aclweb.org/anthology/P11-1038
Hienert, D., & Luciano, F. (2012). Extraction of historical events from wikipedia. CoRR. arXiv:1205.4138.
Imran, M., Castillo, C., Diaz, F., Vieweg, S. (2015). Processing social media messages in mass emergency: A survey. ACM Computing Surveys Jun, 47(4), 67:1–67:38. https://doi.org/10.1145/2771588.
Lee, I. (2010). Encyclopedia of E-business Development and Management in the Global Economy. 1st edn. Hershey: IGI Global.
Lui, M., & Baldwin, T. (2011). Cross-domain feature selection for language identification. In 5th International Joint Conference on Natural Language Processing, IJCNLP 2011, Chiang Mai, Thailand, November 8-13 (pp. 553–561). http://aclweb.org/anthology/I/I11/I11-1062.pdf
Marujo, L., Ribeiro, R., Gershman, A., de Matos, D.M., Neto, J.P., Carbonell, J. (2017). Event-based summarization using a centrality-as-relevance model. Knowledge and Information Systems, 50(3), 945. https://doi.org/10.1007/s10115-016-0966-4.
Mezghani, M., On-at, S., Peninou, A., Canut, C.M., Zayani, C.A., Amous, I., S‘edes, F. (2015). A case study on the influence of the user profile enrichment on buzz propagation in social media: Experiments on delicious. In New Trends in Databases and Information Systems - ADBIS 2015 Short Papers and Workshops, BigDap, DCSA, GID, MEBIS, OAIS, SW4CH, WISARD, Poitiers, France, September 8-11, 2015. Proceedings (pp. 567–577). https://doi.org/10.1007/978-3-319-23201-057
Osborne, M., Moran, S., McCreadie, R., von Lu̇nen, A., Sykora, M.D., Cano, A.E., Ireson, N., Macdonald, C., Ounis, I., He, Y., et al. (2014). Real-time detection, tracking, and monitoring of automatically discovered events in social media. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, ACL 2014, June 22-27, 2014, Baltimore, MD, USA, System Demonstrations (pp. 37–42).
Quezada, M., Araya, V.P., Poblete, B. (2015). Location-aware model for news events in social media. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile, August 9-13. https://doi.org/10.1145/2766462.2767815 (pp. 935–938).
Rieder, B. (2013). Studying facebook via data extraction: The netvizz application. In Proceedings of the 5th Annual ACM Web Science Conference, WebSci ’13, ACM: New York, NY, USA (pp. 346–355). https://doi.org/10.1145/2464464.2464475
Roth, R., & Ross, K. (2009). Extending the google maps api for event animation mashups. Cartographic Perspectives.
Simmen, D.E., Altinel, M., Markl, V., Padmanabhan, S., Singh, A. (2008). Damia: Data mashups for intranet applications. In Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, SIGMOD ’08, ACM: New York, NY, USA (pp. 1171–1182). https://doi.org/10.1145/1376616.1376734
Tan, Y.S., Tan, J., Chng, E., Lee, B., Li, J., Date, S., Chak, H.P., Xiao, X., Narishige, A. (2013). Hadoop framework: impact of data organization on performance. Softw., Pract. Exper., 43(11), 1241–1260. https://doi.org/10.1002/spe.1082.
Troudi, A., Zayani, C.A., Jamoussi, S., Amous, I. (2016). A new social media mashup approach. In The International Conference on Intelligent Systems Design and Applications (ISDA).
Tsantarliotis, P., & Pitoura, E. (2015). Topic detection using a critical term graph on news-related tweets. In Proceedings of the Workshops of the EDBT/ICDT 2015 Joint Conference (EDBT/ICDT), Brussels, Belgium, March 27th, 2015. (pp. 177–182).
Wan, T., Liu, W., Liu, Z. (2014). A community discovering method based on event network for topic detection. In Advanced Communication Technology (ICACT), IEEE (pp. 1242–1246). https://doi.org/10.1109/ICACT.2014.6779157
Wurzer, D., Lavrenko, V., Osborne, M. (2015). Twitter-scale new event detection via k-term hashing. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP 2015, Lisbon, Portugal, September 17-21, 2015 (pp. 2584–2589). http://aclweb.org/anthology/D/D15/D15-1310.pdf
Zhang, Y., Szabo, C., Sheng, Q.Z. (2015). Sense and focus: Towards effective location inference and event detection on twitter. In Web Information Systems Engineering - WISE 2015 - 16th International Conference, Miami, FL, USA, November 1-3, 2015, Proceedings, Part I (pp. 463–477). https://doi.org/10.1007/978-3-319-26190-431
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Troudi, A., Zayani, C.A., Jamoussi, S. et al. A New Mashup Based Method for Event Detection from Social Media. Inf Syst Front 20, 981–992 (2018). https://doi.org/10.1007/s10796-018-9828-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10796-018-9828-9