Abstract
Snowball sampling methods are known to be a biased toward highly connected actors and consequently produce core-periphery networks when these may not necessarily be present. This leads to a biased perception of the underlying network which can have negative policy consequences, as in the identification of terrorist networks. When snowball sampling is used, the potential overload of the information collection system is a distinct problem due to the exponential growth of the number of suspects to be monitored. In this paper, we focus on evaluating the effectiveness of a wiretapping program in terms of its ability to map the rapidly evolving networks within a covert organization. By running a series of simulation-based experiments, we are able to evaluate a broad spectrum of information gathering regimes based on a consistent set of criteria. We conclude by proposing a set of information gathering programs that achieve higher effectiveness then snowball sampling, and at a lower cost.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Al-Quaeda (2001) Al Quaeda Training Manual: Declaration of Jihad Against Unholy Tyrants. URL: http://www.usdoj.gov/ag/trainingmanual.htm
Alberts D, Garstka J, Stein F (1999) Network Centric Warfare: Developing and Leveraging Information Superiority. CCRP Publication Series
Ashworth M (2003) Identifying Key Contributors to Performance in Organizations: The Case for Knowledge-Based Measures. CASOS Working Paper
Ashworth M, Carley KM (2002) Identifying Critical Human Capital in Organizations. CASOS Working Paper
Barabási A-L, Albert R (1999) Emergence of Scaling in Random Networks. Sci 286(5439):509–512
Berry N (2001) The International Islamic Terrorist Network. CDI Terrorism Project
Biernacki P, Waldorf D (1981) Snowball samplong. Problems and techniques of chain referral sampling. Sociol Meth Res 10(2):141–163
Borgatti S, Carley K, Krackhardt D (2004) On the Robust-ness of Centrality Measures under Conditions of Imperfect Data. http://www.casos.cs.cmu.edu/publications/papers/CentralityRobustness5b.pdf
Carley K, Lee J, Krackhardt D (2002) Destabilizing networks. Connections 24(3):79–92
Carley KM (2002) Smart Agents and Organizations of the Future. In: Lievrouw L, Livingstone S (eds) The handbook of new media. Sage, Thousand Oaks, CA, Chapt. 12, pp 206–220
Carley KM (2003a) Dynamic Network Analysis. Dynamic Social Network Modeling and Analysis: Workshop Summary and Papers. In: Breiger R, Carley KM, Pattison P (eds) Comittee on Human Factors and National Research Council edition, pp 133–145
Carley KM (2003b) Dynamic Network Analysis. In: Breiger KCR, Pattison P (eds) Dynamic social network modeling and analysis: workshop summary and papers. Committee on Human Factors, National Research Council, pp 361–370
Carley KM, Dombroski M, Tsvetovat M, Reminga J, Kamneva N (2003) Destabilizing Dynamic Covert Networks. In: Proceedings of the 8th international command and control research and technology symposium
Carley KM, Ren Y (2001) Tradeoffs Between Performance and Adaptability for C3I architectures. In: Proceedings of the 2000 International Symposium on Command and Control Research and Technology
Costenbader E, Valente T (2003) The stability of centrality measures when networks are sampled. Social Networks 25:283–307
Erdös Rényi (1960) On the evolution of random graphs. Public of Math Inst Hungian Acad Sci 5:1761
Erickson BH (1981) Secret societies and social structure. Social Forces 60(1):188–210
Lorrain F, White H (1971) Structural Equivalence of Individuals in Social Networks. J Math Sociol 1
Freeman LC (1979) Centrality in social networks: conceptual clarication. Social Networks 1:215–239
Goolsby R (2003) Combating Terrorist Networks: An Evolutionary Approach. In: Proceedings of the 8th international command and control research and technology symposium. Evidence Based Research Vienna VA
Granovetter M (1976) Network sampling: some first steps. Am J Sociology 81:1267–1303
Group IC (2002) Indonesia Backgrounder: how the Jemaah Islamiyaa Terrorist Network operates. Asia Paper (43)
Gunaratna R (2002) Inside Al Quaeda: Global Network of Terror. New York University Press, New York, NY
Krebs VE (2001) Mapping Networks of Terrorist Cells. Connections 24(3):43–52
Langton, C. (1989) Artificial Life, pp. 1–47, SFI Studies in the Sciences of Complexity. Addison-Wesley, Redwood City, CA
Lawrence P, Lorsch J (1967) Differentiation and Integration in Complex Organizations. Adm Sci Quart (12):1–47
Lightblau E, Risen J (2005) Spy Agency Mined Vast Data Trove, Officials Report. New York Times
Lin Z, Carley KM (2003) Designing Stress Resistant Organizations: Computational Theorizing and Crisis Applications. Kluwer Boston, MA
Minsky ML (1967) Computation: finite and infinite machines, Prentice-Hall Series in Automatic Computation. Prentice-Hall, Englewood Cliffs, NJ
Risen J, Lichtblau E (2005) Bush lets U.S. spy on callers without courts. New York Times
Ronfeldt D, Arquilla J (2001) Networks, Netwars and the Fight for the Future. First Monday 6(10)
Rothenberg R (2002) From Whole Cloth: Making up the terrorist netwrok. Connections 24(3):36–42
Sageman M (2004) Understanding Terror Networks. University of Pennsylvania Press
Sanfeliu A, Fu K (1983) A Distance Measure Between Attributed Relational Graphs for Pattern Recognition. IEEE Trans Syst Man, Cybern 13:353–362
Senate U (2001) Joint Resolution 23: Authorization for Use of Military Force.?
Tsvetovat M, Carley K (2004) Modeling Complex Socio-technical Systems using Multi-Agent Simulation Methods. Kunstliche Intelligenz (Artificial Intelligence Journal) Special Issue on Applications of Intelligent Agents (2)
Tsvetovat M, Carley K (2005a) Generation of Realistic Social Network Datasets for Testing of Analysis and Simulation Tools. Technical Report CMU-ISRI-05–130, Carnegie Mellon University, School of Computer Science, Institute for Software Research International
Tsvetovat M, Carley KM (2005b) Structural Knowledge and Success of Anti- Terrorist Activity: The Downside of Structural Equivalence. J Soc Structure (www.joss.org) forthcoming
Tsvetovat M, Carley KM (2006) Simulation of Human Systems Requires Multiple Levels of Complexity. IEEE Proceedings on System, Man and Cybernetics to appear.
Author information
Authors and Affiliations
Corresponding author
Additional information
Maksim Tsvetovat is an Assistant Professor at the Center for Social Complexity and department of Public and International Affairs at George Mason University, Fairfax, VA. He received his Ph.D. from the Computation, Organizations and Society program in the School of Computer Science, Carnegie Mellon University. His dissertation was centered on use of artificial intelligence techniques such as planning and semantic reasoning as a means of studying behavior and evolution of complex social networks, such as these of terrorist organizations. He received a Master of Science degree from University of Minnesota with a specialization in Artificial Intelligence and design of Multi-Agent Systems, and has also extensively studied organization theory and social science research methods. His research is centered on building high-fidelity simulations of social and organizational systems using concepts from distributed artificial intelligence and multi-agent systems. Other projects focus on social network analysis for mapping of internal corporate networks or study of covert and terrorist orgnaizations. Maksim’s vita and publications can be found on http://www.css.gmu.edu/maksim
Kathleen M. Carley is a professor in the School of Computer Science at Carnegie Mellon University and the director of the center for Compuational Analysis of Social and Organizational Systems (CASOS) which has over 25 members, both students and research staff. Her research combines cognitive science, social networks and computer science to address complex social and organizational problems. Her specific research areas are dynamic network analysis, computational social and organization theory, adaptation and evolution, text mining, and the impact of telecommunication technologies and policy on communication, information diffusion, disease contagion and response within and among groups particularly in disaster or crisis situations. She and her lab have developed infrastructure tools for analyzing large scale dynamic networks and various multi-agent simulation systems. The infrastructure tools include ORA, a statistical toolkit for analyzing and visualizing multi-dimensional networks. ORA results are organized into reports that meet various needs such as the management report, the mental model report, and the intelligence report. Another tool is AutoMap, a text-mining systems for extracting semantic networks from texts and then cross-classifying them using an organizational ontology into the underlying social, knowledge, resource and task networks. Her simulation models meld multi-agent technology with network dynamics and empirical data. Three of the large-scale multi-agent network models she and the CASOS group have developed in the counter-terrorism area are: BioWar a city-scale dynamic-network agent-based model for understanding the spread of disease and illness due to natural epidemics, chemical spills, and weaponized biological attacks; DyNet a model of the change in covert networks, naturally and in response to attacks, under varying levels of information uncertainty; and RTE a model for examining state failure and the escalation of conflict at the city, state, nation, and international as changes occur within and among red, blue, and green forces. She is the founding co-editor with Al. Wallace of the journal Computational Organization Theory and has co-edited several books and written over 100 articles in the computational organizations and dynamic network area. Her publications can be found at: http://www.casos.cs.cmu.edu/bios/carley/publications.php
Rights and permissions
About this article
Cite this article
Tsvetovat, M., Carley, K.M. On effectiveness of wiretap programs in mapping social networks. Comput Math Organiz Theor 13, 63–87 (2007). https://doi.org/10.1007/s10588-006-9009-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10588-006-9009-0