Abstract
The trade of humans aimed at the intention of forced labor, sexual slavery, commercial sexual slavery, or else others is termed human trafficking (HT). It happens inside a nation or else trans-nationality. Victims of trafficking may be of whichever age and gender. Herein, the face recognition (FR) design to fight against HT is propounded centred on surveillance videos aimed at rescuing the victims. Initially, the missing persons’ image is gathered as of the police department and then undergoes pre-processing. In the pre-processing phase, filtering (Gaussian filter (GF)) is executed to eradicate the noise existent in the image, and contrast enhancement (IMF-CLAHE) is done to acquire the contrast-enhanced image (EI). Next, in the image, the face is identified utilizing Viola–Jones algorithm (VJA). Then, feature extraction (FE) occurs; after that dimensionality reduction utilizing P7SKLDA is executed. The dimensionality reduced features are then inputted into the MDBN classifier to recognize the person. After performing FR on the inputted data, FR is executed on the surveillance videos by transforming the videos to frames. Lastly, motion estimation utilizing the Horn–Schunck Optical flow (HSOF) methodology is utilized to enumerate the relative motion betwixt surveillance videos’ frames aimed at detecting the location of the missing one’s trafficking. Lastly, the proposed design’s performance is analogized with the existent methodologies to deduce this methodology’s superiority.







Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
Enquiries about data availability should be directed to the authors.
References
Abd El Meguid MK, Levine MD (2014) Fully automated recognition of spontaneous facial expressions in videos using random forest classifiers. IEEE Trans Affect Comput 5(2):141–154
Afra S, Alhajj R (2019) Early warning system from face recognition by surveillance cameras to social media analysis to detecting suspicious people. Physica A. https://doi.org/10.1016/j.physa.2019.123151
An L, Kafai M, Bhanu B (2013) Dynamic Bayesian network for unconstrained face recognition in surveillance camera networks. IEEE J Emerging Sel Top Circuits Syst 3(2):155–164
Awais M, Iqbal MJ, Ahmad I, Alassafi MO, AlGhamdi RA, Basheri M, Waqas M (2019) Real time surveillance through face recognition using HOG and feedforward neural networks. IEEE Access 7:121236–121244
Awais M, Iqbal MJ, Ahmad I, Alassafi MO, Alghamdi R, Basheri M, Waqas M (2019) Real-time surveillance through face recognition using HOG and feedforward neural networks. IEEE Access 7:121236–121244
Bhatt HS, Singh R, Vatsa M (2014) On recognizing faces in videos using clustering based reranking and fusion. IEEE Trans Inf Forensics Secur 9(7):1056–1068
Bindu H, Manjunathachary K (2020) Hybrid features and exponential moth-flame optimization based deep belief network for face recognition. Comput Methods Biomech Biomed Eng Imaging Visual 8(6):581–594
Biswas S, Aggarwal G, Flynn PJ and Bowyer KW, (2011) Pose robust recognition of low resolution face images. In: IEEE CVPR, pp. 20–25 June, Colorado Springs, CO, USA
Bruhn A, Weickert J (2005) Lucas/Kanade Meets Horn/Schunck: combining local and global optic flow methods. Int J Comput Vision 61(3):211–231
De la Torre M, Granger E, Sabourin R, Gorodnichy DO (2014) Adaptive skew-sensitive ensembles for face recognition in video surveillance. Inf Fusion 20:31–48
Deshpande NT, Ravishankar S (2017) Face detection and recognition using viola-jones algorithm and fusion of PCA and ANN. Adv Comput Sci Technol 10(5):1173–1189
Ding C, Tao D (2017) Trunk branch ensemble convolutional neural networks for video based face recognition. IEEE Trans Pattern Anal Mach Intell. https://doi.org/10.1109/tpami.2017.2700390
Ding C, Tao D (2018) Trunk-branch ensemble convolutional neural networks for video-based face recognition. IEEE Trans Pattern Anal Mach Intell 40(4):1002–1014
Gao G, Yi Yu, Yang J, Qi G-J, Yang M (2020) Hierarchical deep CNN feature set-based representation learning for robust cross-resolution face recognition. IEEE Trans Circuits Syst Video Technol. https://doi.org/10.1109/TCSVT.2020.3042178
Goswami G, Vatsa M, Singh R (2017) Face verification via learned representation on feature rich video frames. IEEE Trans Inf Forensics Secur 12(7):1686–1698
Gou G, Li Z, Xiong G, Guan Y, Shi J (2017) Video face recognition through multi-scale and optimization of margin distributions. Procedia Comput Sci 108:2458–2462
Kamgar-Parsi B, Lawson W, Kamgar-Parsi B (2011) Toward development of a face recognition system for watchlist surveillance. IEEE Trans Pattern Anal Mach Intell 33(10):1925–1937
Liu M, Liu J, Zhang P, Li Q (2020) Pagan a patch-attention based aggregation network for face recognition in surveillance. IEEE Access 8:152780–152789
Low CY, Teoh ABJ, Park J (2021) MIND-Net A deep mutual information distillation network for realistic low-resolution face recognition. IEEE Signal Process Lett 28:354–358
Manju D, Radha V (2020) A novel approach for pose invariant face recognition in surveillance videos. Procedia Comput Sci 167:890–899
Melin P, Sanchez D (2017) Multi-objective optimization for modular granular neural networks applied to pattern recognition. Inf Sci. https://doi.org/10.1016/j.ins.2017.09.031
Mokhayeri F, Granger E (2020) Video face recognition using Siamese networks with block sparsity matching. IEEE 2(2):133–144
Mokhayeri F, Granger E, Bilodeau GA (2019) Domain specific face synthesis for video face recognition from a single sample per person. IEEE Trans Inf Forensics Secur 14(3):757–752
Mutneja V, Singh S (2018) GPU accelerated face detection from low resolution surveillance videos using motion and skin color segmentation. Optik 157:1155–1165
Nasrollahi K, Moeslund TB (2011) Extracting a good quality frontal face image from a low-resolution video sequence. IEEE Trans Circuits Syst Video Technol 21(10):1353–1362
Nguyen DT, Pham TD, Lee MB, Park KR (2019) Visible-light camera sensor-based presentation attack detection for face recognition by combining spatial and temporal information. Sensors 19(2):1–27
Pagano C, Granger E, Sabourin R, Marcialis GL, Roli F (2014) Adaptive ensembles for face recognition in changing video surveillance environments. Inf Sci 286:75–101
Paul KC, Aslan S (2021) An improved real-time face recognition system at low resolution based on local binary pattern histogram algorithm and CLAHE. Opt Photon J 11(4):63–78
Prasad N, Rajpal B, Mangalore KKR, Shastri R, Pradeep N (2021) Frontal and non-frontal face detection using deep neural networks (DNN). Int J Res Ind Eng 10(1):9–21
Qi Y, Zhang S, Jiang F, Zhou H, Tao D, Li X (2020) Siamese local and global networks for robust face tracking. IEEE Trans Image Process 29:9152–9164
Radtke PVW, Granger E, Sabourin R, Gorodnichy DO (2014) Skew sensitive Boolean combination for adaptive ensembles an application to face recognition in video surveillance. Inf Fusion 20:31–48
Sanchez D, Melin P, Castillo O (2017) A grey wolf optimizer for modular granular neural networks for human recognition. Comput Intell Neurosci. https://doi.org/10.1155/2017/4180510
Seshaiah M, Math S, Nandini C, Rafi M (2021) A googlenet assisted cnn architecture combined with feature attention blocks and Gaussian distribution for video face recognition and verification. Int J Electr Eng Technol (IJEET) 12(1):30–42
Ta F, Ma J (2016) Spoof face recognition in video using KSVM. Procedia Technol 24:1285–1291
Tiong LCO, Kim ST, Ro YM (2020) Multimodal facial biometrics recognition dual stream convolutional neural networks with multi feature fusion layers. Image Vision Comput. https://doi.org/10.1016/j.imavis.2020.103977
Vinay A, Deshpandea AR, Pranathi BS, Jhaa H, Murthya KB, Natarajana S (2018) Effective descriptors based face recognition technique for robotic surveillance systems. Procedia Comput Sci 33:968–975
Vincent R, Vijitha A, Rajesh M (2018) An effective monitoring system for face recognition using principle component analysis and linear discriminant analysis. Int J Pure Appl Math 120(8):209–217
Wang G, Zheng F, Shi C, Xue JH, Liu C, He L (2015) Embedding metric learning into set-based face recognition for video surveillance. Neurocomputing 151:1500–1506
Yong Wu, Jiang Y, Zhou Y, Li W, Zongqing Lu, Liao Q (2014) Generalized weber-face for illumination-robust face recognition. Neurocomputing 136:262–267
Zheng J, Ranjan R, Chen CH, Chen JC, Castillo CD, Chellappa R (2020) An automatic system for unconstrained video based face recognition. IEEE Trans Biomet Beh Identity Sci 2(3):1–16
Funding
This study was not funded by any funding agency.
Author information
Authors and Affiliations
Contributions
Not applicable.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Informed consent
Not applicable.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Karpagam, M., Jeyavathana, R.B., Chinnappan, S.K. et al. A novel face recognition model for fighting against human trafficking in surveillance videos and rescuing victims. Soft Comput 27, 13165–13180 (2023). https://doi.org/10.1007/s00500-022-06931-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-022-06931-1