Skip to main content

Advertisement

Log in

Building socially-enabled event-enriched maps

  • Published:
GeoInformatica Aims and scope Submit manuscript

Abstract

With the advancement of social sensing technologies, digital maps have recently witnessed a tremendous evolution with the aim of integrating enriched semantic layers from heterogeneous and diverse data sources. Current generations of digital maps are often crowd-sourced, allow interactive route planning, and may contain live updates, such as traffic congestion states. Within this context, we believe that the next generation of maps will introduce the concept of extracting Events of Interest (EoI) from crowdsourced data, and displaying them at different spatial scales based on their significance. This paper introduces Hadath1, a scalable and efficient system that extracts social events from unstructured data streams, e.g. Twitter. Hadath applies natural language processing and multi-dimensional clustering techniques to extract relevant events of interest at different map scales, and to infer the spatio-temporal scope of detected events. Hadath also implements a hierarchical in-memory spatio-temporal indexing scheme to allow efficient and scalable access to raw data, as well as to extracted clusters of events. Initially, data packets are processed to discover events at a local scale, then, the proper spatio-temporal scope and the significance of detected events at a global scale is determined. As a result, live events can be displayed at different spatio-temporal resolutions, thus allowing a smooth and unique browsing experience. Finally, to validate our proposed system, we conducted experiments on real-time and historical social media streams.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

Notes

  1. http://www.4sqmap.com/checkins/map

  2. https://www.flickr.com/map

  3. https://www.mapd.com/demos/tweetmap/

  4. https://www.yelp.com/wordmap/

  5. https://cloud.google.com/dataflow/

  6. https://ibmstreams.github.io/

  7. https://aws.amazon.com/kinesis/

  8. https://spark.apache.org/streaming/

  9. https://storm.apache.org/

  10. https://www.elastic.co/

  11. https://kafka.apache.org/documentation/streams/

  12. https://flink.apache.org/

  13. Jaegwon Kim (1993) Supervenience and Mind, page 37, Cambridge University Press

  14. https://www.seleniumhq.org

  15. https://www.elastic.co/products/hadoop

References

  1. MapD. http://www.mapd.com

  2. Aiello LM, Petkos G, Martin C, Corney D, Papadopoulos S, Skraba R, Göker A, Kompatsiaris I, Jaimes A (2013) Sensing trending topics in twitter. IEEE Trans Multimed 15(6):1268–1282

    Article  Google Scholar 

  3. Magdy A, et al. (2014) Taghreed: a system for querying, analyzing, and visualizing geotagged microblogs. In: Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, pp 163–172

  4. Rehman FU et al (2014) Toward dynamic path recommender system based on social network data. In: Proceedings of the 7th ACM SIGSPATIAL International Workshop on Computational Transportation Science, IWCTS ’14. ACM, New York, pp 64–69

  5. Samet H et al (2014) Reading news with maps by exploiting spatial synonyms. Commun ACM 57(10):64–77

    Article  Google Scholar 

  6. Gimpel K et al (2011) Part-of-speech tagging for twitter: Annotation, features, and experiments. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: Short Papers - Volume 2, HLT ’11. Association for Computational Linguistics, Stroudsburg, pp 42–47

  7. Atefeh F, Khreich W (2015) A survey of techniques for event detection in twitter. Comput Intell 31(1):132–164

    Article  Google Scholar 

  8. Atta S, Sadiq B, Ahmad A, Saeed SN, Felemban E (2016) Spatial-crowd: a big data framework for efficient data visualization. In: 2016 IEEE international conference on Big data (big data). IEEE, pp 2130–2138

  9. Avvenuti M, Cresci S, Marchetti A, Meletti C, Tesconi M (2014) Ears (earthquake alert and report system): a real time decision support system for earthquake crisis management. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’14. ACM, New York, pp 1749–1758

  10. Benson E, Haghighi A, Barzilay R (2011) Event discovery in social media feeds. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, pp 389–398. Association for Computational Linguistics

  11. Boettcher A, Lee D (2012) Eventradar: a real-time local event detection scheme using twitter stream. In: Proceedings of the 2012 IEEE International Conference on Green Computing and Communications, GREENCOM ’12. IEEE Computer Society, Washington, pp 358–367

  12. Brassel KE, Weibel R (1988) A review and conceptual framework of automated map generalization. Int J Geograph Inf Syst 2(3):229–244

    Google Scholar 

  13. Dong X, Mavroeidis D, Calabrese F, Frossard P (2015) Multiscale event detection in social media. Data Min Knowl Discov 29(5):1374–1405

    Article  Google Scholar 

  14. Fox A, Eichelberger C, Hughes J, Lyon S (2013) Spatio-temporal indexing in non-relational distributed databases. In: 2013 IEEE International conference on big data. IEEE, pp 291–299

  15. Garofalakis M, Gehrke J, Rastogi R (2016) Data stream management: Processing High-Speed data streams. Springer, Berlin

  16. Goodchild MF (2007) Citizens as sensors: the world of volunteered geography. GeoJournal 69(4):211–221

    Article  Google Scholar 

  17. Gutierrez C, Figuerias P, Oliveira P, Costa R, Jardim-Goncalves R (2015) Twitter mining for traffic events detection. In: 2015 Science and information conference (SAI), pp 371–378. https://doi.org/10.1109/SAI.2015.7237170

  18. Harley JB, Laxton P (2002) The new nature of maps: essays in the history of cartography. JHU Press

  19. Hua T, Chen F, Zhao L, Lu CT, Ramakrishnan N (2016) Automatic targeted-domain spatiotemporal event detection in twitter. GeoInformatica 20(4):765–795

    Article  Google Scholar 

  20. Kaleel SB, Abhari A (2015) Cluster-discovery of twitter messages for event detection and trending. J Comput Sci 6:47–57

    Article  Google Scholar 

  21. Karun AK, Chitharanjan K (2013) A review on hadoop - hdfs infrastructure extensions. In: 2013 IEEE Conference on information communication technologies, pp 132–137. https://doi.org/10.1109/CICT.2013.6558077

  22. Kraak MJ, Ormeling FJ (2013) Cartography: visualization of spatial data. Routledge

  23. Krygier J, Wood D (2011) Making maps: a visual guide to map design for GIS. Guilford Press, New York

  24. Li H, Ji H, Zhao L (2015) Social event extraction: Task, challenges and techniques. In: Proceedings of the 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2015, ASONAM ’15. ACM, New York, pp 526–532. https://doi.org/10.1145/2808797.2809413

  25. Li Q, Nourbakhsh A, Shah S, Liu X (2017) Real-time novel event detection from social media. In: 2017 IEEE 33Rd international conference on data engineering (ICDE), pp 1129–1139. https://doi.org/10.1109/ICDE.2017.157

  26. Li R, Lei KH, Khadiwala R, Chang KCC (2012) Tedas: a twitter-based event detection and analysis system. In: 2012 IEEE 28Th international conference on data engineering, pp 1273–1276. https://doi.org/10.1109/ICDE.2012.125

  27. Liu J, Li H, Gao Y, Yu H, Jiang D (2014) A geohash-based index for spatial data management in distributed memory. In: 2014 22Nd international conference on geoinformatics, pp 1–4. https://doi.org/10.1109/GEOINFORMATICS.2014.6950819

  28. McInnes L, Healy J, Astels S (2017) hdbscan: Hierarchical density based clustering. J Open Sourc Softw 2(11):205

    Article  Google Scholar 

  29. Pan Y, Blevis E (2011) A survey of crowdsourcing as a means of collaboration and the implications of crowdsourcing for interaction design. In: 2011 international conference on Collaboration technologies and systems (CTS), pp 397–403. https://doi.org/10.1109/CTS.2011.5928716

  30. Papadopoulos S, Kompatsiaris Y, Vakali A, Spyridonos P (2012) Community detection in social media. Data Min Knowl Disc 24(3):515–554

    Article  Google Scholar 

  31. Petkos G, Papadopoulos S, Kompatsiaris Y (2012) Social event detection using multimodal clustering and integrating supervisory signals. In: Proceedings of the 2Nd ACM International Conference on Multimedia Retrieval, ICMR ’12. ACM, New York, pp 231–238. https://doi.org/10.1145/2324796.2324825

  32. Rehman FU, Afyouni I, Lbath A, Basalamah S (2017) Understanding the spatio-temporal scope of multi-scale social events. In: Proceedings of the 1st ACM SIGSPATIAL Workshop on Analytics for Local Events and News. ACM, pp 1–7

  33. Rehman FU, Afyouni I, Lbath A, Khan S, Basalamah S, Mokbel MF (2017) Building multi-resolution event-enriched maps from social data. In: Proceedings of the 20th International Conference on Extending Database Technology, EDBT 2017, Venice, pp 594–597

  34. Rehman FU, Lbath A, Sadiq B, Rahman MA, Murad A, Afyouni I, Ahmad A, Basalamah S (2015) A constraint-aware optimized path recommender in a crowdsourced environment. In: 2015 IEEE/ACS 12Th international conference of computer systems and applications (AICCSA), pp 1–8

  35. Robinson B, Power R, Cameron M (2013) A sensitive twitter earthquake detector. In: Proceedings of the 22nd international conference on world wide web. ACM, pp 999–1002

  36. Sakaki T, Okazaki M, Matsuo Y (2010) Earthquake shakes twitter users: real-time event detection by social sensors. In: Proceedings of the 19th international conference on World wide web. ACM, pp 851–860

  37. Samet H (1984) The quadtree and related hierarchical data structures. ACM Comput Surv (CSUR) 16(2):187–260

    Article  Google Scholar 

  38. Sankaranarayanan J, Samet H, Teitler BE, Lieberman MD, Sperling J (2009) Twitterstand: News in tweets. In: Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, GIS ’09. ACM, New York, pp 42–51

  39. Schinas M, Papadopoulos S, Petkos G, Kompatsiaris Y, Mitkas PA (2015) Multimodal graph-based event detection and summarization in social media streams. In: Proceedings of the 23rd ACM International Conference on Multimedia, MM ’15. ACM, New York, pp 189–192

  40. Shi LL, Liu L, Wu Y, Jiang L, Hardy J (2017) Event detection and user interest discovering in social media data streams. IEEE Access 5:20,953–20,964

    Article  Google Scholar 

  41. Teitler BE, Lieberman MD, Panozzo D, Sankaranarayanan J, Samet H, Sperling J (2008) Newsstand: a new view on news. In: Proceedings of the 16th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, GIS ’08. ACM, New York, pp 18:1–18:10

  42. Walther M, Kaisser M (2013) Geo-spatial event detection in the twitter stream. In: European conference on information retrieval. Springer, pp 356–367

  43. Whitby MA, Fecher R, Bennight C (2017) Geowave: Utilizing distributed key-value stores for multidimensional data. In: International symposium on spatial and temporal databases. Springer, pp 105–122

  44. Yang Y, Pierce T, Carbonell JG (1998) A study on retrospective and on-line event detection

  45. Yu J, Wu J, Sarwat M (2015) Geospark: a cluster computing framework for processing large-scale spatial data. In: Proceedings of the 23rd SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, pp 70

  46. Zarrinkalam F, Bagheri E (2016) Event identification in social networks. CoRR arXiv:1606.08521

  47. Zhang X, Chen X, Chen Y, Wang S, Li Z, Xia J (2015) Event detection and popularity prediction in microblogging. Neurocomputing 149:1469–1480

    Article  Google Scholar 

  48. Zheng X, Han J, Sun A (2018) A survey of location prediction on twitter. IEEE Trans Knowl Data Eng 30(9):1652–1671

    Article  Google Scholar 

Download references

Acknowledgments

We kindly acknowledge Prof. Mohamed F. Mokbel from the University of Minnesota, for their useful suggestions. We would like to thank Shahbaz Atta for his development support in the big data processing. We extend our gratitude to King Abdul Aziz City for Science and Technology (KACST), Kingdom of Saudi Arabia for funding this research project through NSTIP grant number 14-INF2461-10.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Faizan Ur Rehman.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Hadath is an arabic word for an event or an unusual happening within a specified time and space.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rehman, F.U., Afyouni, I., Lbath, A. et al. Building socially-enabled event-enriched maps. Geoinformatica 24, 371–409 (2020). https://doi.org/10.1007/s10707-020-00394-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10707-020-00394-y

Keywords

Navigation