Abstract
With the advancement of social sensing technologies, digital maps have recently witnessed a tremendous evolution with the aim of integrating enriched semantic layers from heterogeneous and diverse data sources. Current generations of digital maps are often crowd-sourced, allow interactive route planning, and may contain live updates, such as traffic congestion states. Within this context, we believe that the next generation of maps will introduce the concept of extracting Events of Interest (EoI) from crowdsourced data, and displaying them at different spatial scales based on their significance. This paper introduces Hadath1, a scalable and efficient system that extracts social events from unstructured data streams, e.g. Twitter. Hadath applies natural language processing and multi-dimensional clustering techniques to extract relevant events of interest at different map scales, and to infer the spatio-temporal scope of detected events. Hadath also implements a hierarchical in-memory spatio-temporal indexing scheme to allow efficient and scalable access to raw data, as well as to extracted clusters of events. Initially, data packets are processed to discover events at a local scale, then, the proper spatio-temporal scope and the significance of detected events at a global scale is determined. As a result, live events can be displayed at different spatio-temporal resolutions, thus allowing a smooth and unique browsing experience. Finally, to validate our proposed system, we conducted experiments on real-time and historical social media streams.
Similar content being viewed by others
Notes
Jaegwon Kim (1993) Supervenience and Mind, page 37, Cambridge University Press
References
MapD. http://www.mapd.com
Aiello LM, Petkos G, Martin C, Corney D, Papadopoulos S, Skraba R, Göker A, Kompatsiaris I, Jaimes A (2013) Sensing trending topics in twitter. IEEE Trans Multimed 15(6):1268–1282
Magdy A, et al. (2014) Taghreed: a system for querying, analyzing, and visualizing geotagged microblogs. In: Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, pp 163–172
Rehman FU et al (2014) Toward dynamic path recommender system based on social network data. In: Proceedings of the 7th ACM SIGSPATIAL International Workshop on Computational Transportation Science, IWCTS ’14. ACM, New York, pp 64–69
Samet H et al (2014) Reading news with maps by exploiting spatial synonyms. Commun ACM 57(10):64–77
Gimpel K et al (2011) Part-of-speech tagging for twitter: Annotation, features, and experiments. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: Short Papers - Volume 2, HLT ’11. Association for Computational Linguistics, Stroudsburg, pp 42–47
Atefeh F, Khreich W (2015) A survey of techniques for event detection in twitter. Comput Intell 31(1):132–164
Atta S, Sadiq B, Ahmad A, Saeed SN, Felemban E (2016) Spatial-crowd: a big data framework for efficient data visualization. In: 2016 IEEE international conference on Big data (big data). IEEE, pp 2130–2138
Avvenuti M, Cresci S, Marchetti A, Meletti C, Tesconi M (2014) Ears (earthquake alert and report system): a real time decision support system for earthquake crisis management. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’14. ACM, New York, pp 1749–1758
Benson E, Haghighi A, Barzilay R (2011) Event discovery in social media feeds. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, pp 389–398. Association for Computational Linguistics
Boettcher A, Lee D (2012) Eventradar: a real-time local event detection scheme using twitter stream. In: Proceedings of the 2012 IEEE International Conference on Green Computing and Communications, GREENCOM ’12. IEEE Computer Society, Washington, pp 358–367
Brassel KE, Weibel R (1988) A review and conceptual framework of automated map generalization. Int J Geograph Inf Syst 2(3):229–244
Dong X, Mavroeidis D, Calabrese F, Frossard P (2015) Multiscale event detection in social media. Data Min Knowl Discov 29(5):1374–1405
Fox A, Eichelberger C, Hughes J, Lyon S (2013) Spatio-temporal indexing in non-relational distributed databases. In: 2013 IEEE International conference on big data. IEEE, pp 291–299
Garofalakis M, Gehrke J, Rastogi R (2016) Data stream management: Processing High-Speed data streams. Springer, Berlin
Goodchild MF (2007) Citizens as sensors: the world of volunteered geography. GeoJournal 69(4):211–221
Gutierrez C, Figuerias P, Oliveira P, Costa R, Jardim-Goncalves R (2015) Twitter mining for traffic events detection. In: 2015 Science and information conference (SAI), pp 371–378. https://doi.org/10.1109/SAI.2015.7237170
Harley JB, Laxton P (2002) The new nature of maps: essays in the history of cartography. JHU Press
Hua T, Chen F, Zhao L, Lu CT, Ramakrishnan N (2016) Automatic targeted-domain spatiotemporal event detection in twitter. GeoInformatica 20(4):765–795
Kaleel SB, Abhari A (2015) Cluster-discovery of twitter messages for event detection and trending. J Comput Sci 6:47–57
Karun AK, Chitharanjan K (2013) A review on hadoop - hdfs infrastructure extensions. In: 2013 IEEE Conference on information communication technologies, pp 132–137. https://doi.org/10.1109/CICT.2013.6558077
Kraak MJ, Ormeling FJ (2013) Cartography: visualization of spatial data. Routledge
Krygier J, Wood D (2011) Making maps: a visual guide to map design for GIS. Guilford Press, New York
Li H, Ji H, Zhao L (2015) Social event extraction: Task, challenges and techniques. In: Proceedings of the 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2015, ASONAM ’15. ACM, New York, pp 526–532. https://doi.org/10.1145/2808797.2809413
Li Q, Nourbakhsh A, Shah S, Liu X (2017) Real-time novel event detection from social media. In: 2017 IEEE 33Rd international conference on data engineering (ICDE), pp 1129–1139. https://doi.org/10.1109/ICDE.2017.157
Li R, Lei KH, Khadiwala R, Chang KCC (2012) Tedas: a twitter-based event detection and analysis system. In: 2012 IEEE 28Th international conference on data engineering, pp 1273–1276. https://doi.org/10.1109/ICDE.2012.125
Liu J, Li H, Gao Y, Yu H, Jiang D (2014) A geohash-based index for spatial data management in distributed memory. In: 2014 22Nd international conference on geoinformatics, pp 1–4. https://doi.org/10.1109/GEOINFORMATICS.2014.6950819
McInnes L, Healy J, Astels S (2017) hdbscan: Hierarchical density based clustering. J Open Sourc Softw 2(11):205
Pan Y, Blevis E (2011) A survey of crowdsourcing as a means of collaboration and the implications of crowdsourcing for interaction design. In: 2011 international conference on Collaboration technologies and systems (CTS), pp 397–403. https://doi.org/10.1109/CTS.2011.5928716
Papadopoulos S, Kompatsiaris Y, Vakali A, Spyridonos P (2012) Community detection in social media. Data Min Knowl Disc 24(3):515–554
Petkos G, Papadopoulos S, Kompatsiaris Y (2012) Social event detection using multimodal clustering and integrating supervisory signals. In: Proceedings of the 2Nd ACM International Conference on Multimedia Retrieval, ICMR ’12. ACM, New York, pp 231–238. https://doi.org/10.1145/2324796.2324825
Rehman FU, Afyouni I, Lbath A, Basalamah S (2017) Understanding the spatio-temporal scope of multi-scale social events. In: Proceedings of the 1st ACM SIGSPATIAL Workshop on Analytics for Local Events and News. ACM, pp 1–7
Rehman FU, Afyouni I, Lbath A, Khan S, Basalamah S, Mokbel MF (2017) Building multi-resolution event-enriched maps from social data. In: Proceedings of the 20th International Conference on Extending Database Technology, EDBT 2017, Venice, pp 594–597
Rehman FU, Lbath A, Sadiq B, Rahman MA, Murad A, Afyouni I, Ahmad A, Basalamah S (2015) A constraint-aware optimized path recommender in a crowdsourced environment. In: 2015 IEEE/ACS 12Th international conference of computer systems and applications (AICCSA), pp 1–8
Robinson B, Power R, Cameron M (2013) A sensitive twitter earthquake detector. In: Proceedings of the 22nd international conference on world wide web. ACM, pp 999–1002
Sakaki T, Okazaki M, Matsuo Y (2010) Earthquake shakes twitter users: real-time event detection by social sensors. In: Proceedings of the 19th international conference on World wide web. ACM, pp 851–860
Samet H (1984) The quadtree and related hierarchical data structures. ACM Comput Surv (CSUR) 16(2):187–260
Sankaranarayanan J, Samet H, Teitler BE, Lieberman MD, Sperling J (2009) Twitterstand: News in tweets. In: Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, GIS ’09. ACM, New York, pp 42–51
Schinas M, Papadopoulos S, Petkos G, Kompatsiaris Y, Mitkas PA (2015) Multimodal graph-based event detection and summarization in social media streams. In: Proceedings of the 23rd ACM International Conference on Multimedia, MM ’15. ACM, New York, pp 189–192
Shi LL, Liu L, Wu Y, Jiang L, Hardy J (2017) Event detection and user interest discovering in social media data streams. IEEE Access 5:20,953–20,964
Teitler BE, Lieberman MD, Panozzo D, Sankaranarayanan J, Samet H, Sperling J (2008) Newsstand: a new view on news. In: Proceedings of the 16th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, GIS ’08. ACM, New York, pp 18:1–18:10
Walther M, Kaisser M (2013) Geo-spatial event detection in the twitter stream. In: European conference on information retrieval. Springer, pp 356–367
Whitby MA, Fecher R, Bennight C (2017) Geowave: Utilizing distributed key-value stores for multidimensional data. In: International symposium on spatial and temporal databases. Springer, pp 105–122
Yang Y, Pierce T, Carbonell JG (1998) A study on retrospective and on-line event detection
Yu J, Wu J, Sarwat M (2015) Geospark: a cluster computing framework for processing large-scale spatial data. In: Proceedings of the 23rd SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, pp 70
Zarrinkalam F, Bagheri E (2016) Event identification in social networks. CoRR arXiv:1606.08521
Zhang X, Chen X, Chen Y, Wang S, Li Z, Xia J (2015) Event detection and popularity prediction in microblogging. Neurocomputing 149:1469–1480
Zheng X, Han J, Sun A (2018) A survey of location prediction on twitter. IEEE Trans Knowl Data Eng 30(9):1652–1671
Acknowledgments
We kindly acknowledge Prof. Mohamed F. Mokbel from the University of Minnesota, for their useful suggestions. We would like to thank Shahbaz Atta for his development support in the big data processing. We extend our gratitude to King Abdul Aziz City for Science and Technology (KACST), Kingdom of Saudi Arabia for funding this research project through NSTIP grant number 14-INF2461-10.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Hadath is an arabic word for an event or an unusual happening within a specified time and space.
Rights and permissions
About this article
Cite this article
Rehman, F.U., Afyouni, I., Lbath, A. et al. Building socially-enabled event-enriched maps. Geoinformatica 24, 371–409 (2020). https://doi.org/10.1007/s10707-020-00394-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10707-020-00394-y