Abstract
The objective of this paper is to propose and test a system analytics framework based on social sensing and text mining to detect topic evolution associated with the performance of infrastructure systems in disasters. Social media, like Twitter, as active channels of communication and information dissemination, provide insights into real-time information and first-hand experience from affected areas in mass emergencies. While the existing studies show the importance of social sensing in improving situational awareness and emergency response in disasters, the use of social sensing for detection and analysis of infrastructure systems and their resilience performance has been rather limited. This limitation is due to the lack of frameworks to model the events and topics (e.g., grid interruption and road closure) evolution associated with infrastructure systems (e.g., power, highway, airport, and oil) in times of disasters. The proposed framework detects infrastructure-related topics of the tweets posted in disasters and their evolutions by integrating searching relevant keywords, text lemmatization, Part-of-Speech (POS) tagging, TF-IDF vectorization, topic modeling by using Latent Dirichlet Allocation (LDA), and K-Means clustering. The application of the proposed framework was demonstrated in a study of infrastructure systems in Houston during Hurricane Harvey. In this case study, more than sixty thousand tweets were retrieved from 150-mile radius in Houston over 39 days. The analysis of topic detection and evolution from user-generated data were conducted, and the clusters of tweets pertaining to certain topics were mapped in networks over time. The results show that the proposed framework enables to summarize topics and track the movement of situations in different disaster phases. The analytics elements of the proposed framework can improve the recognition of infrastructure performance through text-based representation and provide evidence for decision-makers to take actionable measurements.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Tien, I., Musaev, A., Benas, D., Pu, C.: Detection of damage and failure events of critical public infrastructure using social sensor big data. In: Proceedings of International Conference on Internet of Things and Big Data, April 2016
Eusgeld, I., Nan, C., Dietz, S.: “System-of-systems” approach for interdependent critical infrastructures. Reliabil. Eng. Syst. Saf. 96(6), 679–686 (2011)
Wikipedia Contributors: Hurricane Harvey. Wikipedia, The Free Encyclopedia. https://en.wikipedia.org/wiki/Hurricane_Harvey. Accessed 10 Dec 2017
Wang, D., Abdelzaher, T., Kaplan, L.: Social Sensing: Building Reliable Systems on Unreliable Data. Morgan Kaufmann, Burlington (2015)
Olteanu, A., Castillo, C., Diaz, F., Vieweg, S.: CrisisLex: a lexicon for collecting and filtering microblogged communications in crises. In: ICWSM, June 2014
Lu, X., Brelsford, C.: Network structure and community evolution on twitter: human behavior change in response to the 2011 Japanese earthquake and tsunami. Sci. Rep. 4, 6773 (2014)
iRevolutions Contributors: What is Big (Crisis) Data? iResolutions. https://irevolutions.org/2013/06/27/what-is-big-crisis-data/. Accessed 10 Dec 2017
Imran, M., Castillo, C., Diaz, F., Vieweg, S.: Processing social media messages in mass emergency: a survey. ACM Comput. Surv. (CSUR) 47(4), 67 (2015)
Imran, M., Elbassuoni, S., Castillo, C., Diaz, F., Meier, P.: Extracting information nuggets from disaster-related messages in social media. In: ISCRAM, May 2013
Acar, A., Muraki, Y.: Twitter for crisis communication: lessons learned from Japan’s tsunami disaster. Int. J. Web Based Commun. 7(3), 392–402 (2011)
Ashktorab, Z., Brown, C., Nandi, M., Culotta, A.: Tweedr: mining twitter to inform disaster response. In: ISCRAM, May 2014
Yin, J., Lampert, A., Cameron, M., Robinson, B., Power, R.: Using social media to enhance emergency situation awareness. IEEE Intell. Syst. 27(6), 52–59 (2012)
Bala, M.M., Navya, K., Shruthilaya, P.: Text mining on real time Twitter data for disaster response. Int. J. Civ. Eng. Technol. 8(8), 20–29 (2017)
Prasetyo, P.K., Gao, M., Lim, E.P., Scollon, C.N.: Social sensing for urban crisis management: the case of Singapore haze. In: SocInfo, pp. 478–491, November 2013
Bruns, A., Liang, Y.E.: Tools and methods for capturing Twitter data during natural disasters. First Monday 17(4), 1–8 (2012)
Hardeniya, N.: NLTK Essentials. Packt Publishing Ltd., Birmingham (2015)
Sarkar, D.: Text Analytics with Python: A Practical Real-World Approach to Gaining Actionable Insights from Your Data. A Press, New York (2016)
BBC NEWS Contributor: In maps: Houston and Texas flooding. http://www.bbc.com/news/world-us-canada-41094872. Accessed 31 Dec
ENR Editors: How badly has hurricane Harvey damaged Texas infrastructure? In: Engineering News-Record, August 2017
Hernandez, A.R., Zezima, K., Achenbach, J.: Texas faces environmental concerns as wastewater, drinking water systems compromised. In: Washington Post, September 2017
Nix, K.: Hurricane Harvey brings record rains to Pearland, September 2017. http://www.chron.com/neighborhood/pearland/news/article/Hurricane-Harvey-brings-record-rains-to-Pearland-12169450.php. Accessed 14 Jan
KHOW Contributor: Sam Houston Tollway fully reopens after Harvey flooding, damage. http://www.khou.com/news/hctra-sam-houston-tollway-southbound-to-reopen-sunday-night/473114404. Accessed 19 Jan
Fortune Contributor: Hurricane Irma and Harvey damaged 1 million cars. What happens now? http://fortune.com/2017/09/20/hurricane-irma-harvey-damaged-cars/. Accessed 14 Jan
Scutti, S., CNN Contributor: Sewage, fecal bacteria in hurricane Harvey floodwaters, September 2017. http://www.cnn.com/2017/09/01/health/houston-flood-water-contamination/index.html. Accessed 19 Jan
Kobourov, S.G.: Spring embedders and force-directed graph drawing algorithms (2012). Freely accessible: arXiv:1201.3011
Whaley, K., Eyewitness NEWS Contributor: Check out Houston freeway conditions post-Harvey. http://abc13.com/traffic/check-out-houston-freeway-conditions-post-harvey/2358197/. Accessed 19 Jan
Gao, X., Yu, W., Rong, Y., Zhang, S.: Ontology-based social media analysis for urban planning. In: 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC), vol. 1, pp. 888–896. IEEE, July 2017
Kryvasheyeu, Y., Chen, H., Obradovich, N., Moro, E., Van Hentenryck, P., Fowler, J., Cebrian, M.: Rapid assessment of disaster damage using social media activity. Sci. Adv. 2(3), e1500779 (2016)
QUARTZ Contributor: One map shows just why the Texas flooding is so disastrous: it’s preventing people from escaping, August 2017. https://qz.com/1066033/hurricane-harvey-highways-closed-by-record-rainfall-are-trapping-texans-in-flooded-communities/. Accessed 31 Dec
Acknowledgement
This material is based in part upon work supported by the National Science Foundation under Grant Number IIS-1759537. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Fan, C., Mostafavi, A., Gupta, A., Zhang, C. (2018). A System Analytics Framework for Detecting Infrastructure-Related Topics in Disasters Using Social Sensing. In: Smith, I., Domer, B. (eds) Advanced Computing Strategies for Engineering. EG-ICE 2018. Lecture Notes in Computer Science(), vol 10864. Springer, Cham. https://doi.org/10.1007/978-3-319-91638-5_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-91638-5_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-91637-8
Online ISBN: 978-3-319-91638-5
eBook Packages: Computer ScienceComputer Science (R0)