Skip to main content
Log in

Embassies burning: toward a near-real-time assessment of social media using geo-temporal dynamic network analytics

  • Original Article
  • Published:
Social Network Analysis and Mining Aims and scope Submit manuscript

Abstract

Effective crisis response requires rapid assessment of a situation in order to form actionable plans. Social media and traditional media are critical to this assessment. This paper describes a rapid ethnographic approach for extracting information from Twitter and news media and then assessing that information using dynamic network analysis techniques. Text mining high-dimensional network analytics and visualization are combined to provide an integrated approach to assessing large dynamic networks. This approach was used as the Benghazi consulate and the Egyptian embassy were attacked in 2012. This near-real-time assessment was set against a backdrop of ongoing data collection associated with the Arab Spring countries. This ongoing collection provided a baseline for Libya and Egypt against which the new data could be assessed. Herein, the outcome of that near-real-time assessment, the tools used, the lessons learned, and the results discovered are described. The same approach was used in other crisis events including SuperStorm Sandy, the Kenyan elections, from which examples are also drawn. We find that to be effective such analytics require the use of multiple media, deep dives into specific secondary issues, and a high-level assessment of not just who is doing what, but who is providing what information. Finally, we show the criticality of baseline data for interpreting the behavior during a crisis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

Notes

  1. Additional results can be seen at www.pfeffer.at/sandy and www.casos.cs.cmu.edu/projects/kenya.

  2. For a demo of TweetTracker, see https://www.youtube.com/watch?v=1tZ4wnkEfaQ.

  3. Relevant keywords for the movie are as follows: basseley, bacile, the real life of Muhammad, innocence of Muslims, and Nakoula. The Arabic equivalents were also used.

  4. Relevant keywords for terrorism are as follows: terrorism, terrorist, al-qaeda, al qaeda, al-qaide, al qaide, alqaeda, zawahiri, and al-zawahiri. The Arabic equivalents were also used.

  5. To normalize the data, first the maximum number of articles for a day for every country was calculated. Then, the fraction of articles for every day by country relative to this maximum was calculated. Then, the values were added by day were added for all four countries, and the resulting value divided by 4 (the number of countries).

    This means that each country can have a value between 0 and 0.25 on any given day, e.g., Egypt has this day on February 1, 2011. If none of the other 3 countries has any coverage on this day, the sum stays around 0.25.On a day with lots of stuff in all country, this level goes up as the day is (relatively) important everywhere (maximum possible value would be 1.0 if there is a great deal of news coverage everywhere on the same day).

References

  • Arcenaux N, Weiss AS (2010) Seems stupid until you try it: press coverage of Twitter, 2006–9. New Media Soc 12:1262–1279. http://nms.sagepub.com/content/12/8/1262.full.pdf+html

  • Campbell DG (2011) Egypt unshackled: using social media to @#:) the system. Cambria Books, Amherst

    Google Scholar 

  • Carley KM (2003) Dynamic network analysis. In: Breiger R, Carley K, Pattison P (eds) Dynamic social network modeling and analysis: workshop summary and papers. Committee on Human Factors, National Research Council, National Research Council, Session 2, p 133–145

  • Carley KM (2013) ORA: a toolkit for dynamic network analysis and visualization. Encyclopedia of social network analysis and mining. Springer, Berlin

    Google Scholar 

  • Carley KM, Pfeffer J (2012) Dynamic network analysis (DNA) and ORA. In: Schmorrow DD, Nicholson DM (eds) Advances in design for cross-cultural activities part I. CRC Press, pp 265–274

  • Carley KM, Columbus D, Azoulay A (2012) AutoMap user’s guide 2012, Carnegie Mellon University, School of Computer Science, Institute for Software Research, Technical Report, CMU-ISR-12-106

  • Carley KM, Bigrigg MW, Diallo B (2012b) Data-to-model: a mixed initiative approach for rapid ethnographic assessment. Comput Math Organ Theory 18(3):300–327. doi:10.1007/s10588-012-9125-y

    Article  Google Scholar 

  • Carley KM, Reminga J, Storrick J, Columbus D (2013a) ORA user’s guide 2013. Carnegie Mellon University, School of Computer Science, Institute for Software Research, Pittsburgh, PA, Technical Report CMUISR-13-108

  • Carley KM, Columbus D, Landwehr P (2013b) AutoMap user’s guide 2013. Carnegie Mellon University, School of Computer Science, Institute for Software Research, Technical Report, CMU-ISR-13-105

  • Freeman LC (1979) Centrality in social networks: conceptual clarification. Soc Netw 1(3):215–239

    Article  Google Scholar 

  • Goolsby R (2009) Lifting elephants: Twitter and blogging in global perspective. Social computing and behavioral modeling. Springer, Berlin, pp 1–6

    Google Scholar 

  • Goolsby R (2010) Social media as crisis platform: the future of community maps/crisis maps. ACM Trans Intell Syst Technol 1(1):1–11

    Article  Google Scholar 

  • Harvard Humanitarian Initiative (2011) Disaster relief 2.0: the future of information sharing in humanitarian emergencies. Harvard Humanitarian Initiative, UN Office for the Coordination of Humanitarian Affairs, United Nations Foundation. http://www.unfoundation.org/news-and-media/publications-and-speeches/disaster-relief-2-report.html

  • Kirkpatrick DD (2012) Libya attack brings challenges for U.S. The New York Times, 12 Sept 2012

  • Kumar S, Barbier G, Abbasi MA, Liu H (2011) Relief, TweetTracker: an analysis tool for humanitarian and disaster relief. In: Fifth International AAAI Conference on Weblogs and Social Media, ICWSM, 2011, pp. 661–662

  • Kumar S, Morstatter F, Huan L (2013) Twitter data analytics. Springer, Berlin

    Google Scholar 

  • Landwehr P, Carley KM (2014) Social media in disaster relief. In: Chu WW (ed) Data mining and knowledge discovery for big data, vol 1. Springer, Berlin, pp 225–257 (forthcoming)

    Chapter  Google Scholar 

  • Lewis TG (2011) Network science: theory and applications. Wiley, New York

    Google Scholar 

  • L.S. (2011) What’s in a tweet. Retrieved 9 25, 2012, from The economist - digital verbosity: http://www.economist.com/node/21531066. 29 Sept 2011

  • Madrigal AC (2013) It wasn’t Sunil Tripathi: the anatomy of a misinformation disaster. The Atlantic. http://www.theatlantic.com/technology/archive/2013/04/it-wasnt-sunil-tripathi-the-anatomy-of-a-misinformation-disaster/275155/

  • Martin E (2013) Reflections on the recent Boston crisis. Reddit Blog. http://blog.reddit.com/2013/04/reflections-on-recent-boston-crisis.html

  • Morstatter F, Pfeffer J, Liu H, Carley KM (2013) Is the sample good enough? comparing data from twitter’s streaming api with twitter’s firehose. In: International AAAI Conference on Weblogs and Social Media (ICWSM), 2013

  • Munro R, Manning CD (2012) Short message communications: users, topics, and in-language processing. In: Proceedings of the 2nd ACM Symposium on Computing. Dev. ACM, Atlanta, Georgia, pp 1–10. http://delivery.acm.org/10.1145/2170000/2160607/a4-munro.pdf?ip=128.2.161.39&id=2160607&acc=ACTIVE%20SERVICE&key=C2716FEBFA981EF1D8ED4F16102DA82BADDD11EBB600FF97&CFID=253750387&CFTOKEN=15558566&__acm__=1381759522_7937ccf38c0da291923b6ec170b7c9c2

  • Pfeffer J, Carley KM (2012a) Rapid modeling and analyzing networks extracted from pre-structured news articles. Comput Math Organ Theory 18(3):280–299

    Article  Google Scholar 

  • Pfeffer J, Carley KM (2012b) Social networks, social media, social change. In: Schmorrow DD, Nicholson DM (eds) Advances in design for cross-cultural activities part II. CRC Press, Boca Raton, pp 273–282

    Google Scholar 

  • Shklovski I, Palen L, Sutton J (2008) Finding community through information and communication technology in disaster response. In Proceedings ACM 2008 Conference on Computer Supported Cooperative Work (CSCW), San Diego, CA, USA, pp 127–136. http://dl.acm.org/citation.cfm?id=1460563.1460584

  • Sinnappan S, Farrell C, Stewart E (2010) Priceless tweets! A study on Twitter messages posted during crisis: black saturday. In: Australasian conference on information systems

  • Thelwall Michael Arijan (2004) Link analysis: an information science approach. Elsevier, UK

    Google Scholar 

  • Wasserman S, Faust K (1994) Social network analysis: methods and applications. Cambridge University Press, Cambridge, p 1994

    Book  Google Scholar 

  • Weinstein A (2013) Everybody named the wrong Boston suspects last night and promptly forgot. Gawker. http://gawker.com/5995058/how-the-fuck-did-everybody-focus-on-two-named-boston-suspects-last-night-then-forget-about-them-this-morning

Download references

Acknowledgments

This work was supported in part by the Office of Naval Research with support to CMU and ASU for social media exploitation, and social network based rapid ethnographic assessment, and to Netanomics for crisis mapping. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the Office of Naval Research or the US Government.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kathleen M. Carley.

Additional information

This paper is invited as an extended version of Kathleen. M. Carley, Jürgen Pfeffer, Huan Liu, Fred Morstatter, Rebecca Goolsby, 2013, “Near Real Time Assessment of Social Media Using Geo-Temporal Network Analytics,” In Proceedings of 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), August 25–28, 2013, Niagra Falls, Canada.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Carley, K.M., Pfeffer, J., Morstatter, F. et al. Embassies burning: toward a near-real-time assessment of social media using geo-temporal dynamic network analytics. Soc. Netw. Anal. Min. 4, 195 (2014). https://doi.org/10.1007/s13278-014-0195-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13278-014-0195-3

Keywords

Navigation