Skip to main content
Log in

Employing data generation for visual weapon identification using Convolutional Neural Networks

  • Original Research Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

The use of weapons nowadays is becoming a leading cause of severe crimes in our society, which reluctantly results in dreadful consequences. The weapons used typically varies from knife, iron-rod, dagger, sabre to firearms like guns and bombs. Due to the unavailability of any proactive mechanism for avoiding heinous crimes using such weapons, an active surveillance performing real time weapon identification is proposed here, as a boon to societal security requirement. As part of it, this paper presents a novel approach based on Convolutional Neural Network (CNN) for identifying visual weapons. This proposed CNN model is initialized with the pre-trained Visual Geometry Group-16 (VGG-16) network weights. These weights are further fine-tuned by training this CNN model with comprehensive weapons (knives and handguns only) and non-weapon images. Weapon category images correspond to further classified classes of “isolated” and “handheld” weapons. However, weapon identification is challenging because of unavailability of diverse databases containing images with variations in shape, texture, scale, occlusion of weapon, etc. This paper reduces this limitation by presenting an algorithm for generating new images and other algorithm for preprocessing the images for quality enhancement. The accuracy achieved is 98.07% with original isolated images and 98.36% with its preprocessed images, while 98.42% with original handheld images and 98.80% with its preprocessed images. The preprocessed algorithm’s applicability is confirmed by the higher accuracy achieved by this model using preprocessed images. The accuracy achieved is on an average of ~7% higher than those achieved by other researchers with similar work. The improved result of weapon identification in terms of accuracy proves the appropriateness of the proposed research in being used commercially.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. National Crime Records Bureau. Ministry of Home Affairs. New Delhi, India

  2. India third highest in gun-related deaths, firearm mortality rate beats China, Pakistan, Bangladesh: Us study. https://www.counterview.net/2018/09/india-third-highest-in-gun-related.html. Accessed 14 July 2020

  3. Velastin, S.A., Boghossian, B.A., Vicencio-Silva, M.A.: A motion-based image processing system for detecting potentially dangerous situations in underground railway stations. Transport. Res. Part C 14(2), 96–113 (2006)

    Article  Google Scholar 

  4. Ainsworth, T.: Buyer beware. Secur. Oz 19, 18–26 (2002)

    Google Scholar 

  5. Singh, D.K., Kushwaha, D.S.: Ilut based skin colour modelling for human detection. Indian J. Sci. Technol. (2016). https://doi.org/10.17485/ijst/2016/v9i32/92420,

    Article  Google Scholar 

  6. Singh, D.K., Kushwaha, D.S.: Tracking movements of humans in a real-time surveillance scene. In: Fifth International Conference on Soft Computing for Problem Solving, pp. 491–500 (2016)

  7. Jalal, A., Kamal, S.: Real-time life logging via a depth silhouettebased human activity recognition system for smart home services. In: Eleventh IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 74–80 (2014)

  8. Kumar, T., Kushwaha, D.S.: Traffic surveillance and speed limit violation detection system. J. Intell. Fuzzy Syst. 32(5), 3761–3773 (2017)

    Article  Google Scholar 

  9. Dixit, K.: UP: mela police bans licensed weapons during Kumbh, Times of India, 10 Jan 2019. Accessed 3 Aug 2021

  10. Kumar, K.: Text query based summarized event searching interface system using deep learning over cloud. Multimed. Tools. Appl. 80(7), 11079–11094 (2021)

    Article  Google Scholar 

  11. Kumar, K., Shrimankar, D.D.: Deep event learning boost-up approach: DELTA. Multimed. Tools Appl. 77(20), 26635–26655 (2018)

    Article  Google Scholar 

  12. Kumar, K., Shrimankar, D.D.: F-DES: fast and deep event summarization. IEEE Trans. Multimed. 20(2), 323–34 (2017)

    Article  Google Scholar 

  13. Kumar, K.: EVS-DK: event video skimming using deep keyframe. J. Vis. Commun. Image Represent. 58, 345–352 (2019)

    Article  Google Scholar 

  14. Olmos, R., Tabik, S., Herrera, F.: Automatic handgun detection alarm in videos using deep learning. Neurocomputing 275, 66–72 (2018)

    Article  Google Scholar 

  15. Tiwari, R.K., Verma, G.K.: A computer vision based framework for visual gun detection using Harris interest point detector. Procedia Comput. Sci. 54, 703–712 (2015)

    Article  Google Scholar 

  16. Simonyan, K., Zisserman, A.: Very deep convolutional networks for largescale image recognition. arXiv:1409.1556 (2014)

  17. Maksimova, A., Matiolanski, A., Wassermann, J.: Fuzzy classification method for knife detection problem. In: International Conference on Multimedia Communications, Services and Security, pp. 159–169 (2014)

  18. Glowacz, A., Kmieć, M., Dziech, A.: Visual detection of knives in security applications using Active Appearance Models. Multimed. Tools Appl. 74(12), 4253–4267 (2015)

    Article  Google Scholar 

  19. Cootes, T.F., Edwards, G.J., Taylor, C.J..: Active appearance models. In: European Conference on Computer Vision, pp. 484–498 (1998)

  20. Derpanis, K.G.: The Harris corner detector, York University, vol. 2 (2004)

  21. Glowacz, A., Kmieć, M., Dziech, A.: Towards robust visual knife detection in images: active appearance models initialised with shape-specific interest points. In: International Conference on Multimedia Communications, Services and Security, pp. 148–158 (2012)

  22. Kmiec, M., Glowacz, A.: Object detection in security applications using dominant edge directions. Pattern Recogn. Lett. 52, 72–79 (2015)

    Article  Google Scholar 

  23. Kmiec, M., Glowacz, A.: An approach to robust visual knife detection. Mach. Graph. Vis. 20(2), 215–227 (2011)

    Google Scholar 

  24. Buckchash, H.: Raman, B.: A robust object detector: application to detection of visual knives. In: International Conference on Multimedia and Expo Workshops (ICMEW), pp. 633–638 (2017)

  25. Grega, M., Matiolanski, A., Guzik, P, Leszczuk, M.: Automated detection of firearms and knives in a CCTV image. Sensors 16(1), 47 (2016)

    Article  Google Scholar 

  26. Susarla, P., Agrawal, U., Jayagopi, D.B.: Human weapon activity recognition in surveillance videos using structural-rnn. In: Second Mediterranean Conference on Pattern Recognition and Artificial Intelligence, pp. 101–107 (2018)

  27. Lai, J., Maples, S.: Developing a real-time gun detection classifier. Stanford University, World Academy of Science, Trieste (2017)

  28. Verma, G.K., Dhillon, A.: A handheld gun detection using faster r-cnn deep learning. In: Second International Conference on Computer and Communication Technology, pp. 84–88 (2017)

  29. Egiazarov, A. ., Mavroeidis, V., Zennaro, F.M.., Vishi, K.: Firearm detection and segmentation using an ensemble of semantic neural networks. arXiv:2003.00805, 2020

  30. Dwivedi, N. , Singh, D.K., Kushwaha, D.S.: Weapon classification using deep convolutional neural network. In: IEEE Conference on Information and Communication Technology, pp. 1–5 (2019)

  31. Marquez, E.S., Hare, J.S., Niranjan, M.: Deep cascade learning. IEEE Trans. Neural Netw. Learn. Syst. 29(11), 5475–5485 (2018)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Neelam Dwivedi.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dwivedi, N., Singh, D.K. & Kushwaha, D.S. Employing data generation for visual weapon identification using Convolutional Neural Networks. Multimedia Systems 28, 347–360 (2022). https://doi.org/10.1007/s00530-021-00848-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-021-00848-9

Keywords