Abstract
The use of weapons nowadays is becoming a leading cause of severe crimes in our society, which reluctantly results in dreadful consequences. The weapons used typically varies from knife, iron-rod, dagger, sabre to firearms like guns and bombs. Due to the unavailability of any proactive mechanism for avoiding heinous crimes using such weapons, an active surveillance performing real time weapon identification is proposed here, as a boon to societal security requirement. As part of it, this paper presents a novel approach based on Convolutional Neural Network (CNN) for identifying visual weapons. This proposed CNN model is initialized with the pre-trained Visual Geometry Group-16 (VGG-16) network weights. These weights are further fine-tuned by training this CNN model with comprehensive weapons (knives and handguns only) and non-weapon images. Weapon category images correspond to further classified classes of “isolated” and “handheld” weapons. However, weapon identification is challenging because of unavailability of diverse databases containing images with variations in shape, texture, scale, occlusion of weapon, etc. This paper reduces this limitation by presenting an algorithm for generating new images and other algorithm for preprocessing the images for quality enhancement. The accuracy achieved is 98.07% with original isolated images and 98.36% with its preprocessed images, while 98.42% with original handheld images and 98.80% with its preprocessed images. The preprocessed algorithm’s applicability is confirmed by the higher accuracy achieved by this model using preprocessed images. The accuracy achieved is on an average of ~7% higher than those achieved by other researchers with similar work. The improved result of weapon identification in terms of accuracy proves the appropriateness of the proposed research in being used commercially.







Similar content being viewed by others
References
National Crime Records Bureau. Ministry of Home Affairs. New Delhi, India
India third highest in gun-related deaths, firearm mortality rate beats China, Pakistan, Bangladesh: Us study. https://www.counterview.net/2018/09/india-third-highest-in-gun-related.html. Accessed 14 July 2020
Velastin, S.A., Boghossian, B.A., Vicencio-Silva, M.A.: A motion-based image processing system for detecting potentially dangerous situations in underground railway stations. Transport. Res. Part C 14(2), 96–113 (2006)
Ainsworth, T.: Buyer beware. Secur. Oz 19, 18–26 (2002)
Singh, D.K., Kushwaha, D.S.: Ilut based skin colour modelling for human detection. Indian J. Sci. Technol. (2016). https://doi.org/10.17485/ijst/2016/v9i32/92420,
Singh, D.K., Kushwaha, D.S.: Tracking movements of humans in a real-time surveillance scene. In: Fifth International Conference on Soft Computing for Problem Solving, pp. 491–500 (2016)
Jalal, A., Kamal, S.: Real-time life logging via a depth silhouettebased human activity recognition system for smart home services. In: Eleventh IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 74–80 (2014)
Kumar, T., Kushwaha, D.S.: Traffic surveillance and speed limit violation detection system. J. Intell. Fuzzy Syst. 32(5), 3761–3773 (2017)
Dixit, K.: UP: mela police bans licensed weapons during Kumbh, Times of India, 10 Jan 2019. Accessed 3 Aug 2021
Kumar, K.: Text query based summarized event searching interface system using deep learning over cloud. Multimed. Tools. Appl. 80(7), 11079–11094 (2021)
Kumar, K., Shrimankar, D.D.: Deep event learning boost-up approach: DELTA. Multimed. Tools Appl. 77(20), 26635–26655 (2018)
Kumar, K., Shrimankar, D.D.: F-DES: fast and deep event summarization. IEEE Trans. Multimed. 20(2), 323–34 (2017)
Kumar, K.: EVS-DK: event video skimming using deep keyframe. J. Vis. Commun. Image Represent. 58, 345–352 (2019)
Olmos, R., Tabik, S., Herrera, F.: Automatic handgun detection alarm in videos using deep learning. Neurocomputing 275, 66–72 (2018)
Tiwari, R.K., Verma, G.K.: A computer vision based framework for visual gun detection using Harris interest point detector. Procedia Comput. Sci. 54, 703–712 (2015)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for largescale image recognition. arXiv:1409.1556 (2014)
Maksimova, A., Matiolanski, A., Wassermann, J.: Fuzzy classification method for knife detection problem. In: International Conference on Multimedia Communications, Services and Security, pp. 159–169 (2014)
Glowacz, A., Kmieć, M., Dziech, A.: Visual detection of knives in security applications using Active Appearance Models. Multimed. Tools Appl. 74(12), 4253–4267 (2015)
Cootes, T.F., Edwards, G.J., Taylor, C.J..: Active appearance models. In: European Conference on Computer Vision, pp. 484–498 (1998)
Derpanis, K.G.: The Harris corner detector, York University, vol. 2 (2004)
Glowacz, A., Kmieć, M., Dziech, A.: Towards robust visual knife detection in images: active appearance models initialised with shape-specific interest points. In: International Conference on Multimedia Communications, Services and Security, pp. 148–158 (2012)
Kmiec, M., Glowacz, A.: Object detection in security applications using dominant edge directions. Pattern Recogn. Lett. 52, 72–79 (2015)
Kmiec, M., Glowacz, A.: An approach to robust visual knife detection. Mach. Graph. Vis. 20(2), 215–227 (2011)
Buckchash, H.: Raman, B.: A robust object detector: application to detection of visual knives. In: International Conference on Multimedia and Expo Workshops (ICMEW), pp. 633–638 (2017)
Grega, M., Matiolanski, A., Guzik, P, Leszczuk, M.: Automated detection of firearms and knives in a CCTV image. Sensors 16(1), 47 (2016)
Susarla, P., Agrawal, U., Jayagopi, D.B.: Human weapon activity recognition in surveillance videos using structural-rnn. In: Second Mediterranean Conference on Pattern Recognition and Artificial Intelligence, pp. 101–107 (2018)
Lai, J., Maples, S.: Developing a real-time gun detection classifier. Stanford University, World Academy of Science, Trieste (2017)
Verma, G.K., Dhillon, A.: A handheld gun detection using faster r-cnn deep learning. In: Second International Conference on Computer and Communication Technology, pp. 84–88 (2017)
Egiazarov, A. ., Mavroeidis, V., Zennaro, F.M.., Vishi, K.: Firearm detection and segmentation using an ensemble of semantic neural networks. arXiv:2003.00805, 2020
Dwivedi, N. , Singh, D.K., Kushwaha, D.S.: Weapon classification using deep convolutional neural network. In: IEEE Conference on Information and Communication Technology, pp. 1–5 (2019)
Marquez, E.S., Hare, J.S., Niranjan, M.: Deep cascade learning. IEEE Trans. Neural Netw. Learn. Syst. 29(11), 5475–5485 (2018)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Dwivedi, N., Singh, D.K. & Kushwaha, D.S. Employing data generation for visual weapon identification using Convolutional Neural Networks. Multimedia Systems 28, 347–360 (2022). https://doi.org/10.1007/s00530-021-00848-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00530-021-00848-9