Skip to main content
SpringerLink
Log in

A deep learning-based social media text analysis framework for disaster resource management

  • Original Article
  • Published:
Social Network Analysis and Mining Aims and scope Submit manuscript

Abstract

Social media has evolved itself as a significant tool used by people for information spread during emergencies like natural or man-made disasters. Real-time analysis of this huge collected data can play a vital role in crisis estimation, response and assistance exercises. We propose a novel prototype system that analyzes the emergency-related tweets to classify them as need or available tweets. The presented system also takes care of non-English tweets as there is no boundary of language for social media users. Several classifiers along with different learning methodologies are used to show their usefulness for an efficient solution. Here, a new supervised learning technique based on word embedding is incorporated in the novel hybrid model that comprises of LSTM and CNN. The system will further give a ranked list of tweets, along with a relevance score for each tweet with respect to the topic. Finally for each of the identified need tweets, its corresponding availability tweets are mapped. For the mapping task, a novel two-word sliding window approach is proposed to generate the combine embedding of two adjacent words. The experimental results show significant improvement in the performance. We evaluate our proposed system with FIRE-2016 and CrisisLex datasets to illustrate its effectiveness during mobilization of needful resources.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. https://en.wikipedia.org/wiki/Cohen’s_kappa.

  2. https://fasttext.cc/.

References

  • Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M, et al (2016) Tensorflow: a system for large-scale machine learning. In: 12th \(\{\)USENIX\(\}\) Symposium on Operating Systems Design and Implementation (\(\{\)OSDI\(\}\) 16), pp 265–283

  • Aivazoglou M, Roussos AO, Margaris D, Vassilakis C, Ioannidis S, Polakis J, Spiliotopoulos D (2020) A fine-grained social network recommender system. Soc Netw Anal Min 10(1):8

    Article  Google Scholar 

  • Aleidi S, Alsuhaibani D, Alrajebah N, Kurdi H (2019) A tweet-ranking system using sentiment scores and popularity measures. In: International Conference on Computing, Springer, pp 162–169

  • Andrews S, Gibson H, Domdouzis K, Akhgar B (2016) Creating corroborated crisis reports from social media data through formal concept analysis. J Intell Inf Syst 47(2):287–312

    Article  Google Scholar 

  • Arora M, Kansal V (2019) Character level embedding with deep convolutional neural network for text normalization of unstructured data for twitter sentiment analysis. Soc Netw Anal Min 9(1):12

    Article  Google Scholar 

  • Basu M, Shandilya A, Ghosh K, Ghosh S (2018) Automatic matching of resource needs and availabilities in microblogs for post-disaster relief. Companion Proc Web Conf 2018:25–26

    Google Scholar 

  • Bhoi A, Balabantaray RC (2017) Named entity recognition from social media text: A comparative study. Int J Control Theory Appl 10(19):9–15

    Google Scholar 

  • Butakov N, Petrov M, Mukhina K, Nasonov D, Kovalchuk S (2018) Unified domain-specific language for collecting and processing data of social media. J Intell Inf Syst 51(2):389–414

    Article  Google Scholar 

  • Ceccarelli D, Nidito F, Osborne M (2016) Ranking financial tweets. In: Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, pp 527–528

  • Chen G, Ye D, Xing Z, Chen J, Cambria E (2017) Ensemble application of convolutional and recurrent neural networks for multi-label text categorization. In: 2017 International Joint Conference on Neural Networks (IJCNN), IEEE, pp 2377–2383

  • Chen Y, Yuan J, You Q, Luo J (2018) Twitter sentiment analysis via bi-sense emoji embedding and attention-based lstm. In: Proceedings of the 26th ACM international conference on Multimedia, pp 117–125

  • Chouchani N, Abed M (2018) Online social network analysis: detection of communities of interest. J Intell Inf Syst pp 1–17

  • Cortes C, Vapnik V (1995) Support vector machine. Mach Learn 20(3):273–297

    MATH  Google Scholar 

  • Cover T, Hart P (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13(1):21–27

    Article  Google Scholar 

  • Crawford K, Finn M (2015) The limits of crisis data: analytical and ethical challenges of using social and mobile data to understand disasters. GeoJournal 80(4):491–502

    Article  Google Scholar 

  • De Maio C, Fenza G, Gallo M, Loia V, Parente M (2019) Time-aware adaptive tweets ranking through deep learning. Future Gener Comput Syst 93:924–932

    Article  Google Scholar 

  • Duan Y, Chen Z, Wei F, Zhou M, Shum HY (2012) Twitter topic summarization by ranking tweets using social influence and content quality. Proc COLING 2012:763–780

    Google Scholar 

  • Froehlich D, Rehm M, Rienties B (2020) Reviewing mixed methods approaches using social network analysis for learning and education. In: Educational Networking, Springer, pp 43–75

  • Gopnarayan A, Deshpande S (2019) Tweets analysis for disaster management: Preparedness, emergency response, impact, and recovery. In: International Conference on Innovative Data Communication Technologies and Application, Springer, pp 760–764

  • Goswami A, Kumar A (2016) A survey of event detection techniques in online social networks. Soc Netw Anal Min 6(1):107

    Article  Google Scholar 

  • Han B, Cook P, Baldwin T (2013) Lexical normalization for social media text. ACM Trans Intell Syst Technol (TIST) 4(1):5

    Google Scholar 

  • Han B, Cook P, Baldwin T (2012) Automatically constructing a normalisation dictionary for microblogs. In: Proceedings of the 2012 joint conference on empirical methods in natural language processing and computational natural language learning, Association for Computational Linguistics, pp 421–432

  • Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780

    Article  Google Scholar 

  • Kang J, Choi H, Lee H (2019) Deep recurrent convolutional networks for inferring user interests from social media. J Intell Inf Syst 52(1):191–209

    Article  Google Scholar 

  • Kim Y (2014) Convolutional neural networks for sentence classification. arXiv:14085882

  • Lai S, Xu L, Liu K, Zhao J (2015) Recurrent convolutional neural networks for text classification. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, AAAI Press, pp 2267–2273

  • Lee JY, Dernoncourt F (2016) Sequential short-text classification with recurrent and convolutional neural networks. arXiv:160303827

  • Lourentzou I, Manghnani K, Zhai C (2019) Adapting sequence to sequence models for text normalization in social media. Proc Int AAAI Confer Web Soc Media 13:335–345

    Google Scholar 

  • Luna S, Pennock MJ (2018) Social media applications and emergency management: a literature review and research agenda. Int J Disaster Risk Reduct 28:565–577

    Article  Google Scholar 

  • Madichetty S, Sridevi M (2019) Disaster damage assessment from the tweets using the combination of statistical features and informative words. Soc Netw Anal Min 9(1):42

    Article  Google Scholar 

  • Mohammed A, Kora R (2019) Deep learning approaches for arabic sentiment analysis. Soc Netw Anal Min 9(1):52

    Article  Google Scholar 

  • Moinuddin S (2019) Mapping political re/tweets in india. In: The Political Twittersphere in India, Springer, pp 61–80

  • Nagamanjula R, Pethalakshmi A (2020) A novel framework based on bi-objective optimization and lan2fis for twitter sentiment analysis. Soc Netw Anal Min 10(34):34

    Article  Google Scholar 

  • Oku K, Hattori F, Kawagoe K (2015) Tweet-mapping method for tourist spots based on now-tweets and spot-photos. Procedia Comput Sci 60:1318–1327

    Article  Google Scholar 

  • Olteanu A, Vieweg S, Castillo C (2015) What to expect when the unexpected happens: Social media communications across crises. In: Proceedings of the 18th ACM conference on computer supported cooperative work & social computing, ACM, pp 994–1009

  • Özyer T, Alhajj R (2018) Machine learning techniques for online social networks. Springer, Berlin

    Book  Google Scholar 

  • Page L, Brin S, Motwani R, Winograd T (1999) The pagerank citation ranking: Bringing order to the web. Tech. rep, Stanford InfoLab

  • Pasumarthi RK, Bruch S, Wang X, Li C, Bendersky M, Najork M, Pfeifer J, Golbandi N, Anil R, Wolf S (2019) Tf-ranking: Scalable tensorflow library for learning-to-rank. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp 2970–2978

  • Pennington J, Socher R, Manning CD (2014) Glove: Global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1532–1543

  • Philips L (2000) The double metaphone search algorithm. C/C++ users journal 18(6):38–43

  • Purohit H, Castillo C, Pandey R (2020) Ranking and grouping social media requests for emergency services using serviceability model. Soc Netw Anal Min 10(1):1–17

    Article  Google Scholar 

  • Quinlan JR (1993) C4. 5: Programming for machine learning. Morgan Kauffmann 38

  • Ragozini G (2020) Challenges in social network research: methods and applications. Springer, Berlin

    Book  Google Scholar 

  • Ratkiewicz J, Conover M, Meiss M, Gonļalves B, Patil S, Flammini A, Menczer F (2011) Truthy: mapping the spread of astroturf in microblog streams. In: Proceedings of the 20th international conference companion on World wide web, ACM, pp 249–252

  • Ravikumar S, Balakrishnan R, Kambhampati S (2012) Ranking tweets considering trust and relevance. In: Proceedings of the Ninth International Workshop on Information Integration on the Web, ACM, p 4

  • Ringland N, Dai X, Hachey B, Karimi S, Paris C, Curran JR (2019) Nne: A dataset for nested named entity recognition in english newswire. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp 5176–5181

  • Rumelhart DE, Hinton GE, Williams RJ et al (1988) Learning representations by back-propagating errors. Cognitive Model 5(3):1

    MATH  Google Scholar 

  • Şahin C, Rokne J, Alhajj R (2019) Emergency detection and evacuation planning using social media. In: Social networks and surveillance for society, Springer, pp 149–164

  • Sailunaz K, Alhajj R (2019) Emotion and sentiment analysis from twitter text. J Comput Sci 36(101):003

    Google Scholar 

  • Santos I, Nedjah N, de Macedo Mourelle L (2017) Sentiment analysis using convolutional neural network with fasttext embeddings. In: 2017 IEEE Latin American Conference on Computational Intelligence (LA-CCI), IEEE, pp 1–5

  • Schempp T, Zhang H, Schmidt A, Hong M, Akerkar R (2019) A framework to integrate social media and authoritative data for disaster relief detection and distribution optimization. Int J Disaster Risk Reduct 39(101):143

    Google Scholar 

  • Stowe K, Paul MJ, Palmer M, Palen L, Anderson K (2016) Identifying and categorizing disaster-related tweets. In: Proceedings of The Fourth International Workshop on Natural Language Processing for Social Media, pp 1–6

  • Sultana T, Badugu S (2020) A review on different question answering system approaches. Advances in Decision Sciences. Image Processing, Security and Computer Vision, Springer, pp 579–586

  • Sun S, Li Q, Yan P, Zeng DD (2017) Mapping users across social media platforms by integrating text and structure information. In: Intelligence and Security Informatics (ISI), 2017 IEEE International Conference on, IEEE, pp 113–118

  • To H, Agrawal S, Kim SH, Shahabi C (2017) On identifying disaster-related tweets: Matching-based or learning-based? arXiv:170502009

  • Wu B, Jin Q, Zhou X, Wang W, Lin F, Leung H (2013) Dynamically identifying roles in social media by mapping real world. In: Awareness Science and Technology and Ubi-Media Computing (iCAST-UMEDIA), 2013 International Joint Conference on, IEEE, pp 573–579

  • Zhu Y, Wang Z, Wu Y, Huang Z, Li M, Zeng R (2018) Tweets ranking considering dynamic social influence and personal interests. In: Proceedings of the 2018 10th International Conference on Machine Learning and Computing, pp 276–282

Download references

Acknowledgements

The authors wish to thank Forum for Information Retrieval Evaluation(FIRE) for presenting the Nepal earthquake tweet dataset. The authors also wish to thank Prof. Carlos A. Iglesias for his valuable comments and suggestions to further improve the paper.

Author information

Authors and Affiliations

  1. IIIT Bhubaneswar, Bhubaneswar, India

    Ashutosh Bhoi, Sthita Pragyan Pujari & Rakesh Chandra Balabantaray

Authors
  1. Ashutosh Bhoi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sthita Pragyan Pujari
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rakesh Chandra Balabantaray
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rakesh Chandra Balabantaray.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bhoi, A., Pujari, S.P. & Balabantaray, R.C. A deep learning-based social media text analysis framework for disaster resource management. Soc. Netw. Anal. Min. 10, 78 (2020). https://doi.org/10.1007/s13278-020-00692-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13278-020-00692-1

Keywords

Search

Navigation