Skip to main content
SpringerLink
Log in
Book cover

International Conference on Big Data Analytics

BDA 2015: Big Data Analytics pp 21–37Cite as

Open Source Social Media Analytics for Intelligence and Security Informatics Applications

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9498))

Abstract

Open-Source Intelligence (OSINT) is intelligence collected and inferred from publicly available and overt sources of information. Open-Source social media intelligence is a sub-field within OSINT with a focus on extracting insights from publicly available data in Web 2.0 platforms like Twitter (micro-blogging website), YouTube (video-sharing website) and Facebook (social-networking website). In this paper, we present an overview of Intelligence and Security Informatics (ISI) applications in the domain of open-source social media intelligence. We present technical challenges and introduce basic Machine Learning based framework, tools and techniques within the context of open-source social media intelligence using two case-studies. The focus of the paper is on mining free-form textual content present in social media websites. In particular we describe two important application: online radicalization and civil unrest. In addition to covering basic concepts and applications, we discuss open research problem, important papers, publication venues, research results and future directions.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://about.twitter.com/company.

  2. 2.

    https://www.youtube.com/yt/press/statistics.html.

  3. 3.

    http://www.socialmediatoday.com/social-networks/kadie-regan/2015-08-10/10-amazing-social-media-growth-stats-2015.

  4. 4.

    http://www.terrorismanalysts.com/pt/index.php/pot/article/view/426/html.

  5. 5.

    http://jihadintel.meforum.org/identifier/149/shumukh-al-islam-forum.

  6. 6.

    http://middleeast.about.com/od/humanrightsdemocracy/tp/Arab-Spring-Uprisings.htm.

  7. 7.

    http://www.npr.org/2011/12/17/143897126/the-arab-spring-a-year-of-revolution.

  8. 8.

    https://wordnet.princeton.edu.

  9. 9.

    http://demo.patrickpantel.com/demos/verbocean/.

  10. 10.

    https://developers.google.com/youtube/getting_started.

  11. 11.

    http://jsoup.org/apidocs/.

  12. 12.

    http://www.casos.cs.cmu.edu/projects/ora/.

  13. 13.

    https://web-001.ecs.soton.ac.uk/wo/dataset.

  14. 14.

    http://bit.ly/1L3x4zV.

  15. 15.

    http://ieee-isi.org/.

  16. 16.

    http://www.eisic.eu/.

  17. 17.

    http://www.business.hku.hk/paisi/.

  18. 18.

    http://www.security-informatics.com/.

  19. 19.

    http://bit.ly/1L3x4zV.

References

  1. Agrawal, S., Sureka, A.: Copyright infringement detection of music videos on YouTube by mining video and uploader meta-data. In: Bhatnagar, V., Srinivasa, S. (eds.) BDA 2013. LNCS, vol. 8302, pp. 48–67. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  2. Agarwal, S., Sureka, A.: A focused crawler for mining hate and extremism promoting videos on YouTube. In: 25th ACM Conference on Hypertext and Social Media (HT), pp. 294–296 (2014)

    Google Scholar 

  3. Agarwal, S., Sureka, A.: Learning to classify hate and extremism promoting tweets. In: Intelligence and Security Informatics Conference (JISIC), pp. 320–320 (2014)

    Google Scholar 

  4. Agarwal, S., Sureka, A.: Topic-specific YouTube crawling to detect online radicalization. In: Chu, W., Kikuchi, S., Bhalla, S. (eds.) DNIS 2015. LNCS, vol. 8999, pp. 133–151. Springer, Heidelberg (2015)

    Google Scholar 

  5. Agarwal, S., Sureka, A.: A topical crawler for uncovering hidden communities of extremist micro-bloggers on tumblr. In: 5th Workshop on Making Sense of Microposts (MICROPOSTS) (2015)

    Google Scholar 

  6. Agarwal, S., Sureka, A.: Using common-sense knowledge-base for detecting word obfuscation in adversarial communication. In: Workshop on Future Information Security (FIS) (2015)

    Google Scholar 

  7. Agarwal, S., Sureka, A.: Using KNN and SVM based one-class classifier for detecting online radicalization on Twitter. In: Natarajan, R., Barua, G., Patra, M.R. (eds.) ICDCIT 2015. LNCS, vol. 8956, pp. 431–442. Springer, Heidelberg (2015)

    Google Scholar 

  8. Aggarwal, N., Agarwal, S., Sureka, A.: Mining YouTube metadata for detecting privacy invading harassment and misdemeanor videos. In: Privacy, Security and Trust (PST), pp. 84–93 (2014)

    Google Scholar 

  9. Budak, C., Georgiou, T., Agrawal, D., El Abbadi, A.: Geoscope: online detection of geo-correlated information trends in social networks. Proc. VLDB Endow. 7, 229–240 (2013)

    Article  Google Scholar 

  10. Compton, R., Lee, C.: Detecting future social unrest in unprocessed Twitter data: emerging phenomena and big data. In: Intelligence and Security Informatics (ISI), pp. 56–60 (2013)

    Google Scholar 

  11. Fu, T., Huang, C.N., Chen, H.: Identification of extremist videos in online video sharing sites. In: 2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009, pp. 179–181, June 2009

    Google Scholar 

  12. Hua, T., Lu, C.T., Ramakrishnan, N.: Analyzing civil unrest through social media. Computer 46(12), 80–84 (2013)

    Article  Google Scholar 

  13. Kwok, I., Wang, Y.: Locate the hate: detecting Tweets against blacks. In: AAAI (2013)

    Google Scholar 

  14. Qazvinian, V., Rosengren, E., Radev, D.R., Mei, Q.: Rumor has it: identifying misinformation in microblogs. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, Stroudsburg, PA, USA, pp. 1589–1599 (2011)

    Google Scholar 

  15. Ramakrishnan, N., Butler, P., Muthiah, S.: ‘Beating the news’ with embers: forecasting civil unrest using open source indicators. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2014, pp. 1799–1808. ACM, New York (2014)

    Google Scholar 

  16. Wang, M., Alan, C.G.: Intelligence and security informatics. In: Pacific Asia Workshop (PAISI) (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Indraprastha Institute of Information Technology, Delhi (IIITD), New Delhi, India

    Swati Agarwal & Vikram Goyal

  2. Software Analytics Research Lab (SARL), New Delhi, India

    Ashish Sureka

Authors
  1. Swati Agarwal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ashish Sureka
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vikram Goyal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ashish Sureka .

Editor information

Editors and Affiliations

  1. University of Delhi, Delhi, India

    Naveen Kumar

  2. University of Delhi, Delhi, India

    Vasudha Bhatnagar

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Agarwal, S., Sureka, A., Goyal, V. (2015). Open Source Social Media Analytics for Intelligence and Security Informatics Applications. In: Kumar, N., Bhatnagar, V. (eds) Big Data Analytics. BDA 2015. Lecture Notes in Computer Science(), vol 9498. Springer, Cham. https://doi.org/10.1007/978-3-319-27057-9_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-27057-9_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-27056-2

  • Online ISBN: 978-3-319-27057-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation