Abstract
In this paper, we utilize feature extraction and model-fitting techniques to process the rhetoric found in the web sites of 23 Indonesian Islamic religious organizations to profile their ideology and activity patterns along a hypothesized radical/counter-radical scale, and present an end-to-end system that is able to help researchers to visualize the data in an interactive fashion on a timeline. The subject data of this study is 37,000 articles downloaded from the web sites of these organizations dating from 2001 to 2011. We develop algorithms to rank these organizations by assigning them to probable positions on the scale. We show that the developed Rasch model fits the data using Andersen’s LR-test. We create a gold standard of the ranking of these organizations through an expertise elicitation tool. We compute expert-to-expert agreements, and we present experimental results comparing the performance of three baseline methods to show that the Rasch model not only outperforms the baseline methods, but it is also the only system that performs at expert-level accuracy.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
Oxford online dictionary.
Select the filter “Radical” from the search options and then in the Markers Menu select [Religious \(\rightarrow\) Radical Markers].
Select “Radical” and “FPI” from the filters, then select the time range 2002–2006 or 2006–2010, then select “radical” markers under “R/CR” menu.
Select “Hizb ut-Tahrir” and “radical” from filters. Select the time range 2007–2009. The markers can be seen by selecting the options of Markers Menu [Religious \(\rightarrow\) Religious Markers].
Select CounterRadical filter in the search option, then from the Markers Menu select [R/CR \(\rightarrow\) Counter Radical].
In the Markers Menu select [R/CR \(\rightarrow\) Radical].
References
Andrich D (1988) Rasch models for measurement. Sage, USA
Bayat A (2007) Making Islam Democratic: social movements and the post-Islamist turn. Stanford University Press, USA
Crelinsten R (2002) Analysing terrorism and counter-terrorism: a communication model. Terror Political Violence 14:77–122
Davulcu H, Ahmed ST, Gokalp S, Temkit MH, Taylor T, Woodward M, Amin A (2010) Analyzing sentiment markers describing radical and counter-radical elements in online news. In: Proceedings of the 2010 IEEE second international conference on social computing, IEEE Computer Society, SOCIALCOM’10, pp 335–340
Drehmer D, Belohlav J, Coye R (2000) An exploration of employee participation using a scaling approach. Group Org Manage 25(4):397
Durkheim E (2004) The cultural logic of collective representations: social theory the multicultural and classic readings. Wesleyan University: Westview Press
Frost F, Rann A, Chin A (2010) Terrorism in southeast asia. http://www.aph.gov.au/library/intguide/FAD/sea.html [Online accessed 21 Nov 2011]
Guttman L (1950) The basis for scalogram analysis. Meas Predict 4:60–90
Hasan N (2009) Islamic militancy, Sharia, and democratic consolidation in post-Suharto Indonesia. RSIS Working Papers. 143/07
Hessen D (2010) Likelihood ratio tests for special Rasch models. J Edu Behav Stat 35(6):611
Hunter D, Lange K (2004) A tutorial on mm algorithms. Am Stat 58(1):30–37
James AW, John LM (2002) Algebraic representations of beliefs and attitudes: partial order models for item responses. Sociol Methodol 29:113–146
Jolliffe I (2002) Principal component analysis: Springer series in statistics. Springer, Germany
Le Cam L (1990) Maximum likelihood an introduction. ISI Rev 58(2):153–171
Likert R (1932) A technique for the measurement of attitudes. Arch Psychol 140:1–55
Malang (2006) NU chairman deplores suicide bombing attempt. http://www.nu.or.id/page/en/dinamic_detil/15/28282/News/NU_chairman_deplores_suicide_bombing_attempt.html [Online accessed 22 Nov 2011]
McIver J, Carmines E (1981) Unidimensional scaling, vol 24. Sage Publications Inc, USA
McPhee RD, Corman S (1995) An activity-based theory of communication networks in organizations, applied to the case of a local church. Commun Monogr 62:1–20
Michael WB, Kogan J (2010) Text mining: applications and theory. Wiley, London
Mohamed Osman MN (2010) Reviving the Caliphate in the Nusantara: Hizbut Tahrir Indonesia’s mobilization strategy and its impact in Indonesia. Terror Political Violence 22(4):601–622. doi:10.1080/09546553.2010.496317. http://www.tandfonline.com/doi/abs/10.1080/09546553.2010.496317
Osman MNM (2011) Preparing for the caliphate. Asian Stud Assoc Aust E-Bull 80:14–16. ISSN:1449-4418
Pawitan Y (2001) In all likelihood: statistical modelling and inference using likelihood. Oxford University Press, USA
Rahmat Sihaloho M (2011) FPI vows to disband ahmadiyah ’whatever it takes’. http://www.thejakartaglobe.com/home/fpi-vows-to-disband-ahmadiyah-whatever-it-takes/423477 [Online accessed 21 Nov 2011]
Rasch G (1961) On general laws and the meaning of measurement in psychology. In: Proceedings of the fourth Berkeley symposium on mathematical statistics and psychology, 4, p 332
Rondonuwu O, Creagh S (2010) Opposition grows to indonesia’s hardline fpi islamists. http://www.in.reuters.com/article/2010/06/30/idINIndia-49777620100630 [Online accessed 21 Nov 2011]
Salton G, Buckley C (1988) Term-weighting approaches in automatic text retrieval. In: Information Processing and Management, vol 25, pp 513–523
Simmel G (2008) Sociological theory. McGraw-Hill, New York
Snow R, O’Connor B, Jurafsky D, Ng AY (2008) Cheap and fast—but is it good?: evaluating non-expert annotations for natural language tasks. In: Proceedings of the conference on empirical methods in natural language processing, EMNLP ’08, pp 254–263. Association for Computational Linguistics, Stroudsburg, PA, USA. http://www.portal.acm.org/citation.cfm?id=1613715.1613751
for the Study of Terrorism NC, to Terrorism R (2011) Terrorist organization profile: front for defenders of Islam. http://www.start.umd.edu/start/data_collections/tops/terrorist_organization_profile.asp?id=4026 [Online accessed 21 Nov 2011]
Thurstone LL (1928) Attitudes can be measured. Am J Sociol 33:529–554
Tikves S, Banerjee S, Temkit H, Gokalp S, Davulcu H, Sen A, Corman S, Woodward M, Rochmaniyah I, Amin A (2011) A system for ranking organizations using social scale analysis. In: EISIC. IEEE, pp 308–313. http://www.ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=6059524
Tilly C (2004) Social Movements. Paradigm Publishers, USA
Tunkelang D (2009) Faceted Search: synthesis lectures on information concepts, retrieval, and services. Morgan & Claypool Publishers, UK. doi:10.2200/S00190ED1V01Y200904ICR005
van Emde Boas P (1981) Another NP-complete partition problem and the complexity of computing short vectors in a lattice: Tech. Rep. 81-04. Mathematisch Instituut, Amsterdam
Wallace A (1956) Revitalization movements. Am Anthropol 58:264–281
Ward K (2009) Non-violent extremists? Hizbut Tahrir Indonesia. Aust J Intl Affairs 63(2):149–164 doi:10.1080/10357710902895103.http://www.tandfonline.com/doi/abs/10.1080/10357710902895103
Widhiarto H (2010) Radical groups urge Bekasi administration to implement Sharia law. http://www.thejakartapost.com/news/2010/06/27/radical-groups-urge-bekasi-administration-implement-sharia-law.html [Online accessed 21 Nov 2011]
Zakaria Y (2011) A Global Caliphate: reality or fantasy? http://www.usa.mediamonitors.net/content/view/full/91207 [Online accessed 21 Nov 2011]
Acknowledgments
This research was supported by US DoDs Minerva Research Initiative Grant N00014-09-1-0815, Project leader: Prof. Mark Woodward, Arizona State University, and the project title is “Finding Allies for the War of Words: Mapping the Diffusion and Influence of Counter-Radical Muslim Discourse”.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tikves, S., Banerjee, S., Temkit, H. et al. A system for ranking organizations using social scale analysis. Soc. Netw. Anal. Min. 3, 313–328 (2013). https://doi.org/10.1007/s13278-012-0072-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13278-012-0072-x