Skip to main content
SpringerLink
Log in

On effectiveness of wiretap programs in mapping social networks

  • Published:
Computational and Mathematical Organization Theory Aims and scope Submit manuscript

Abstract

Snowball sampling methods are known to be a biased toward highly connected actors and consequently produce core-periphery networks when these may not necessarily be present. This leads to a biased perception of the underlying network which can have negative policy consequences, as in the identification of terrorist networks. When snowball sampling is used, the potential overload of the information collection system is a distinct problem due to the exponential growth of the number of suspects to be monitored. In this paper, we focus on evaluating the effectiveness of a wiretapping program in terms of its ability to map the rapidly evolving networks within a covert organization. By running a series of simulation-based experiments, we are able to evaluate a broad spectrum of information gathering regimes based on a consistent set of criteria. We conclude by proposing a set of information gathering programs that achieve higher effectiveness then snowball sampling, and at a lower cost.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Al-Quaeda (2001) Al Quaeda Training Manual: Declaration of Jihad Against Unholy Tyrants. URL: http://www.usdoj.gov/ag/trainingmanual.htm

  • Alberts D, Garstka J, Stein F (1999) Network Centric Warfare: Developing and Leveraging Information Superiority. CCRP Publication Series

  • Ashworth M (2003) Identifying Key Contributors to Performance in Organizations: The Case for Knowledge-Based Measures. CASOS Working Paper

  • Ashworth M, Carley KM (2002) Identifying Critical Human Capital in Organizations. CASOS Working Paper

  • Barabási A-L, Albert R (1999) Emergence of Scaling in Random Networks. Sci 286(5439):509–512

    Article  Google Scholar 

  • Berry N (2001) The International Islamic Terrorist Network. CDI Terrorism Project

  • Biernacki P, Waldorf D (1981) Snowball samplong. Problems and techniques of chain referral sampling. Sociol Meth Res 10(2):141–163

    Google Scholar 

  • Borgatti S, Carley K, Krackhardt D (2004) On the Robust-ness of Centrality Measures under Conditions of Imperfect Data. http://www.casos.cs.cmu.edu/publications/papers/CentralityRobustness5b.pdf

  • Carley K, Lee J, Krackhardt D (2002) Destabilizing networks. Connections 24(3):79–92

    Google Scholar 

  • Carley KM (2002) Smart Agents and Organizations of the Future. In: Lievrouw L, Livingstone S (eds) The handbook of new media. Sage, Thousand Oaks, CA, Chapt. 12, pp 206–220

    Google Scholar 

  • Carley KM (2003a) Dynamic Network Analysis. Dynamic Social Network Modeling and Analysis: Workshop Summary and Papers. In: Breiger R, Carley KM, Pattison P (eds) Comittee on Human Factors and National Research Council edition, pp 133–145

  • Carley KM (2003b) Dynamic Network Analysis. In: Breiger KCR, Pattison P (eds) Dynamic social network modeling and analysis: workshop summary and papers. Committee on Human Factors, National Research Council, pp 361–370

  • Carley KM, Dombroski M, Tsvetovat M, Reminga J, Kamneva N (2003) Destabilizing Dynamic Covert Networks. In: Proceedings of the 8th international command and control research and technology symposium

  • Carley KM, Ren Y (2001) Tradeoffs Between Performance and Adaptability for C3I architectures. In: Proceedings of the 2000 International Symposium on Command and Control Research and Technology

  • Costenbader E, Valente T (2003) The stability of centrality measures when networks are sampled. Social Networks 25:283–307

    Article  Google Scholar 

  • Erdös Rényi (1960) On the evolution of random graphs. Public of Math Inst Hungian Acad Sci 5:1761

    Google Scholar 

  • Erickson BH (1981) Secret societies and social structure. Social Forces 60(1):188–210

    Google Scholar 

  • Lorrain F, White H (1971) Structural Equivalence of Individuals in Social Networks. J Math Sociol 1

  • Freeman LC (1979) Centrality in social networks: conceptual clarication. Social Networks 1:215–239

    Article  Google Scholar 

  • Goolsby R (2003) Combating Terrorist Networks: An Evolutionary Approach. In: Proceedings of the 8th international command and control research and technology symposium. Evidence Based Research Vienna VA

  • Granovetter M (1976) Network sampling: some first steps. Am J Sociology 81:1267–1303

    Article  Google Scholar 

  • Group IC (2002) Indonesia Backgrounder: how the Jemaah Islamiyaa Terrorist Network operates. Asia Paper (43)

  • Gunaratna R (2002) Inside Al Quaeda: Global Network of Terror. New York University Press, New York, NY

    Google Scholar 

  • Krebs VE (2001) Mapping Networks of Terrorist Cells. Connections 24(3):43–52

    Google Scholar 

  • Langton, C. (1989) Artificial Life, pp. 1–47, SFI Studies in the Sciences of Complexity. Addison-Wesley, Redwood City, CA

  • Lawrence P, Lorsch J (1967) Differentiation and Integration in Complex Organizations. Adm Sci Quart (12):1–47

    Article  Google Scholar 

  • Lightblau E, Risen J (2005) Spy Agency Mined Vast Data Trove, Officials Report. New York Times

  • Lin Z, Carley KM (2003) Designing Stress Resistant Organizations: Computational Theorizing and Crisis Applications. Kluwer Boston, MA

  • Minsky ML (1967) Computation: finite and infinite machines, Prentice-Hall Series in Automatic Computation. Prentice-Hall, Englewood Cliffs, NJ

    Google Scholar 

  • Risen J, Lichtblau E (2005) Bush lets U.S. spy on callers without courts. New York Times

  • Ronfeldt D, Arquilla J (2001) Networks, Netwars and the Fight for the Future. First Monday 6(10)

  • Rothenberg R (2002) From Whole Cloth: Making up the terrorist netwrok. Connections 24(3):36–42

    Google Scholar 

  • Sageman M (2004) Understanding Terror Networks. University of Pennsylvania Press

  • Sanfeliu A, Fu K (1983) A Distance Measure Between Attributed Relational Graphs for Pattern Recognition. IEEE Trans Syst Man, Cybern 13:353–362

    Google Scholar 

  • Senate U (2001) Joint Resolution 23: Authorization for Use of Military Force.?

  • Tsvetovat M, Carley K (2004) Modeling Complex Socio-technical Systems using Multi-Agent Simulation Methods. Kunstliche Intelligenz (Artificial Intelligence Journal) Special Issue on Applications of Intelligent Agents (2)

  • Tsvetovat M, Carley K (2005a) Generation of Realistic Social Network Datasets for Testing of Analysis and Simulation Tools. Technical Report CMU-ISRI-05–130, Carnegie Mellon University, School of Computer Science, Institute for Software Research International

  • Tsvetovat M, Carley KM (2005b) Structural Knowledge and Success of Anti- Terrorist Activity: The Downside of Structural Equivalence. J Soc Structure (www.joss.org) forthcoming

  • Tsvetovat M, Carley KM (2006) Simulation of Human Systems Requires Multiple Levels of Complexity. IEEE Proceedings on System, Man and Cybernetics to appear.

Download references

Author information

Authors and Affiliations

  1. George Mason University, Fairfax, USA

    Maksim Tsvetovat & Kathleen M. Carley

  2. Carnegie Mellon University, Pittsburgh, USA

    Maksim Tsvetovat & Kathleen M. Carley

Authors
  1. Maksim Tsvetovat
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kathleen M. Carley
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maksim Tsvetovat.

Additional information

Maksim Tsvetovat is an Assistant Professor at the Center for Social Complexity and department of Public and International Affairs at George Mason University, Fairfax, VA. He received his Ph.D. from the Computation, Organizations and Society program in the School of Computer Science, Carnegie Mellon University. His dissertation was centered on use of artificial intelligence techniques such as planning and semantic reasoning as a means of studying behavior and evolution of complex social networks, such as these of terrorist organizations. He received a Master of Science degree from University of Minnesota with a specialization in Artificial Intelligence and design of Multi-Agent Systems, and has also extensively studied organization theory and social science research methods. His research is centered on building high-fidelity simulations of social and organizational systems using concepts from distributed artificial intelligence and multi-agent systems. Other projects focus on social network analysis for mapping of internal corporate networks or study of covert and terrorist orgnaizations. Maksim’s vita and publications can be found on http://www.css.gmu.edu/maksim

Kathleen M. Carley is a professor in the School of Computer Science at Carnegie Mellon University and the director of the center for Compuational Analysis of Social and Organizational Systems (CASOS) which has over 25 members, both students and research staff. Her research combines cognitive science, social networks and computer science to address complex social and organizational problems. Her specific research areas are dynamic network analysis, computational social and organization theory, adaptation and evolution, text mining, and the impact of telecommunication technologies and policy on communication, information diffusion, disease contagion and response within and among groups particularly in disaster or crisis situations. She and her lab have developed infrastructure tools for analyzing large scale dynamic networks and various multi-agent simulation systems. The infrastructure tools include ORA, a statistical toolkit for analyzing and visualizing multi-dimensional networks. ORA results are organized into reports that meet various needs such as the management report, the mental model report, and the intelligence report. Another tool is AutoMap, a text-mining systems for extracting semantic networks from texts and then cross-classifying them using an organizational ontology into the underlying social, knowledge, resource and task networks. Her simulation models meld multi-agent technology with network dynamics and empirical data. Three of the large-scale multi-agent network models she and the CASOS group have developed in the counter-terrorism area are: BioWar a city-scale dynamic-network agent-based model for understanding the spread of disease and illness due to natural epidemics, chemical spills, and weaponized biological attacks; DyNet a model of the change in covert networks, naturally and in response to attacks, under varying levels of information uncertainty; and RTE a model for examining state failure and the escalation of conflict at the city, state, nation, and international as changes occur within and among red, blue, and green forces. She is the founding co-editor with Al. Wallace of the journal Computational Organization Theory and has co-edited several books and written over 100 articles in the computational organizations and dynamic network area. Her publications can be found at: http://www.casos.cs.cmu.edu/bios/carley/publications.php

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tsvetovat, M., Carley, K.M. On effectiveness of wiretap programs in mapping social networks. Comput Math Organiz Theor 13, 63–87 (2007). https://doi.org/10.1007/s10588-006-9009-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10588-006-9009-0

Keywords

Search

Navigation