Skip to main content

Advertisement

Springer Nature Link
Log in

A novel face recognition model for fighting against human trafficking in surveillance videos and rescuing victims

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

The trade of humans aimed at the intention of forced labor, sexual slavery, commercial sexual slavery, or else others is termed human trafficking (HT). It happens inside a nation or else trans-nationality. Victims of trafficking may be of whichever age and gender. Herein, the face recognition (FR) design to fight against HT is propounded centred on surveillance videos aimed at rescuing the victims. Initially, the missing persons’ image is gathered as of the police department and then undergoes pre-processing. In the pre-processing phase, filtering (Gaussian filter (GF)) is executed to eradicate the noise existent in the image, and contrast enhancement (IMF-CLAHE) is done to acquire the contrast-enhanced image (EI). Next, in the image, the face is identified utilizing Viola–Jones algorithm (VJA). Then, feature extraction (FE) occurs; after that dimensionality reduction utilizing P7SKLDA is executed. The dimensionality reduced features are then inputted into the MDBN classifier to recognize the person. After performing FR on the inputted data, FR is executed on the surveillance videos by transforming the videos to frames. Lastly, motion estimation utilizing the Horn–Schunck Optical flow (HSOF) methodology is utilized to enumerate the relative motion betwixt surveillance videos’ frames aimed at detecting the location of the missing one’s trafficking. Lastly, the proposed design’s performance is analogized with the existent methodologies to deduce this methodology’s superiority.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

Enquiries about data availability should be directed to the authors.

References

  • Abd El Meguid MK, Levine MD (2014) Fully automated recognition of spontaneous facial expressions in videos using random forest classifiers. IEEE Trans Affect Comput 5(2):141–154

    Article  Google Scholar 

  • Afra S, Alhajj R (2019) Early warning system from face recognition by surveillance cameras to social media analysis to detecting suspicious people. Physica A. https://doi.org/10.1016/j.physa.2019.123151

    Article  Google Scholar 

  • An L, Kafai M, Bhanu B (2013) Dynamic Bayesian network for unconstrained face recognition in surveillance camera networks. IEEE J Emerging Sel Top Circuits Syst 3(2):155–164

    Article  Google Scholar 

  • Awais M, Iqbal MJ, Ahmad I, Alassafi MO, AlGhamdi RA, Basheri M, Waqas M (2019) Real time surveillance through face recognition using HOG and feedforward neural networks. IEEE Access 7:121236–121244

    Article  Google Scholar 

  • Awais M, Iqbal MJ, Ahmad I, Alassafi MO, Alghamdi R, Basheri M, Waqas M (2019) Real-time surveillance through face recognition using HOG and feedforward neural networks. IEEE Access 7:121236–121244

    Article  Google Scholar 

  • Bhatt HS, Singh R, Vatsa M (2014) On recognizing faces in videos using clustering based reranking and fusion. IEEE Trans Inf Forensics Secur 9(7):1056–1068

    Article  Google Scholar 

  • Bindu H, Manjunathachary K (2020) Hybrid features and exponential moth-flame optimization based deep belief network for face recognition. Comput Methods Biomech Biomed Eng Imaging Visual 8(6):581–594

    Article  Google Scholar 

  • Biswas S, Aggarwal G, Flynn PJ and Bowyer KW, (2011) Pose robust recognition of low resolution face images. In: IEEE CVPR, pp. 20–25 June, Colorado Springs, CO, USA

  • Bruhn A, Weickert J (2005) Lucas/Kanade Meets Horn/Schunck: combining local and global optic flow methods. Int J Comput Vision 61(3):211–231

    Article  MATH  Google Scholar 

  • De la Torre M, Granger E, Sabourin R, Gorodnichy DO (2014) Adaptive skew-sensitive ensembles for face recognition in video surveillance. Inf Fusion 20:31–48

    Article  Google Scholar 

  • Deshpande NT, Ravishankar S (2017) Face detection and recognition using viola-jones algorithm and fusion of PCA and ANN. Adv Comput Sci Technol 10(5):1173–1189

    Google Scholar 

  • Ding C, Tao D (2017) Trunk branch ensemble convolutional neural networks for video based face recognition. IEEE Trans Pattern Anal Mach Intell. https://doi.org/10.1109/tpami.2017.2700390

    Article  Google Scholar 

  • Ding C, Tao D (2018) Trunk-branch ensemble convolutional neural networks for video-based face recognition. IEEE Trans Pattern Anal Mach Intell 40(4):1002–1014

    Article  Google Scholar 

  • Gao G, Yi Yu, Yang J, Qi G-J, Yang M (2020) Hierarchical deep CNN feature set-based representation learning for robust cross-resolution face recognition. IEEE Trans Circuits Syst Video Technol. https://doi.org/10.1109/TCSVT.2020.3042178

    Article  Google Scholar 

  • Goswami G, Vatsa M, Singh R (2017) Face verification via learned representation on feature rich video frames. IEEE Trans Inf Forensics Secur 12(7):1686–1698

    Article  Google Scholar 

  • Gou G, Li Z, Xiong G, Guan Y, Shi J (2017) Video face recognition through multi-scale and optimization of margin distributions. Procedia Comput Sci 108:2458–2462

    Article  Google Scholar 

  • Kamgar-Parsi B, Lawson W, Kamgar-Parsi B (2011) Toward development of a face recognition system for watchlist surveillance. IEEE Trans Pattern Anal Mach Intell 33(10):1925–1937

    Article  Google Scholar 

  • Liu M, Liu J, Zhang P, Li Q (2020) Pagan a patch-attention based aggregation network for face recognition in surveillance. IEEE Access 8:152780–152789

    Article  Google Scholar 

  • Low CY, Teoh ABJ, Park J (2021) MIND-Net A deep mutual information distillation network for realistic low-resolution face recognition. IEEE Signal Process Lett 28:354–358

    Article  Google Scholar 

  • Manju D, Radha V (2020) A novel approach for pose invariant face recognition in surveillance videos. Procedia Comput Sci 167:890–899

    Article  Google Scholar 

  • Melin P, Sanchez D (2017) Multi-objective optimization for modular granular neural networks applied to pattern recognition. Inf Sci. https://doi.org/10.1016/j.ins.2017.09.031

    Article  Google Scholar 

  • Mokhayeri F, Granger E (2020) Video face recognition using Siamese networks with block sparsity matching. IEEE 2(2):133–144

    Google Scholar 

  • Mokhayeri F, Granger E, Bilodeau GA (2019) Domain specific face synthesis for video face recognition from a single sample per person. IEEE Trans Inf Forensics Secur 14(3):757–752

    Article  Google Scholar 

  • Mutneja V, Singh S (2018) GPU accelerated face detection from low resolution surveillance videos using motion and skin color segmentation. Optik 157:1155–1165

    Article  Google Scholar 

  • Nasrollahi K, Moeslund TB (2011) Extracting a good quality frontal face image from a low-resolution video sequence. IEEE Trans Circuits Syst Video Technol 21(10):1353–1362

    Article  Google Scholar 

  • Nguyen DT, Pham TD, Lee MB, Park KR (2019) Visible-light camera sensor-based presentation attack detection for face recognition by combining spatial and temporal information. Sensors 19(2):1–27

    Article  Google Scholar 

  • Pagano C, Granger E, Sabourin R, Marcialis GL, Roli F (2014) Adaptive ensembles for face recognition in changing video surveillance environments. Inf Sci 286:75–101

    Article  Google Scholar 

  • Paul KC, Aslan S (2021) An improved real-time face recognition system at low resolution based on local binary pattern histogram algorithm and CLAHE. Opt Photon J 11(4):63–78

    Article  Google Scholar 

  • Prasad N, Rajpal B, Mangalore KKR, Shastri R, Pradeep N (2021) Frontal and non-frontal face detection using deep neural networks (DNN). Int J Res Ind Eng 10(1):9–21

    Google Scholar 

  • Qi Y, Zhang S, Jiang F, Zhou H, Tao D, Li X (2020) Siamese local and global networks for robust face tracking. IEEE Trans Image Process 29:9152–9164

    Article  MATH  Google Scholar 

  • Radtke PVW, Granger E, Sabourin R, Gorodnichy DO (2014) Skew sensitive Boolean combination for adaptive ensembles an application to face recognition in video surveillance. Inf Fusion 20:31–48

    Article  Google Scholar 

  • Sanchez D, Melin P, Castillo O (2017) A grey wolf optimizer for modular granular neural networks for human recognition. Comput Intell Neurosci. https://doi.org/10.1155/2017/4180510

    Article  Google Scholar 

  • Seshaiah M, Math S, Nandini C, Rafi M (2021) A googlenet assisted cnn architecture combined with feature attention blocks and Gaussian distribution for video face recognition and verification. Int J Electr Eng Technol (IJEET) 12(1):30–42

    Google Scholar 

  • Ta F, Ma J (2016) Spoof face recognition in video using KSVM. Procedia Technol 24:1285–1291

    Article  Google Scholar 

  • Tiong LCO, Kim ST, Ro YM (2020) Multimodal facial biometrics recognition dual stream convolutional neural networks with multi feature fusion layers. Image Vision Comput. https://doi.org/10.1016/j.imavis.2020.103977

    Article  Google Scholar 

  • Vinay A, Deshpandea AR, Pranathi BS, Jhaa H, Murthya KB, Natarajana S (2018) Effective descriptors based face recognition technique for robotic surveillance systems. Procedia Comput Sci 33:968–975

    Google Scholar 

  • Vincent R, Vijitha A, Rajesh M (2018) An effective monitoring system for face recognition using principle component analysis and linear discriminant analysis. Int J Pure Appl Math 120(8):209–217

    Google Scholar 

  • Wang G, Zheng F, Shi C, Xue JH, Liu C, He L (2015) Embedding metric learning into set-based face recognition for video surveillance. Neurocomputing 151:1500–1506

    Article  Google Scholar 

  • Yong Wu, Jiang Y, Zhou Y, Li W, Zongqing Lu, Liao Q (2014) Generalized weber-face for illumination-robust face recognition. Neurocomputing 136:262–267

    Article  Google Scholar 

  • Zheng J, Ranjan R, Chen CH, Chen JC, Castillo CD, Chellappa R (2020) An automatic system for unconstrained video based face recognition. IEEE Trans Biomet Beh Identity Sci 2(3):1–16

    Google Scholar 

Download references

Funding

This study was not funded by any funding agency.

Author information

Authors and Affiliations

  1. Department of Computational Intelligence, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chennai, 603203, India

    M. Karpagam & R. Beaulah Jeyavathana

  2. Department of Computational Intelligence, School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, Chennai, 632014, India

    Sathiya Kumar Chinnappan

  3. Department of Computer Science and Engineering, Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Chennai, India

    K. V. Kanimozhi

  4. Department of CSE, Hindustan Institute of Technology and Science, Rajiv Gandhi Salai, Padur, Chennai, 603103, India

    M. Sambath

Authors
  1. M. Karpagam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. R. Beaulah Jeyavathana
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sathiya Kumar Chinnappan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. K. V. Kanimozhi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. M. Sambath
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Not applicable.

Corresponding author

Correspondence to M. Karpagam.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Informed consent

Not applicable.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Karpagam, M., Jeyavathana, R.B., Chinnappan, S.K. et al. A novel face recognition model for fighting against human trafficking in surveillance videos and rescuing victims. Soft Comput 27, 13165–13180 (2023). https://doi.org/10.1007/s00500-022-06931-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-022-06931-1

Keywords

Search

Navigation