Skip to main content
Log in

ConFERNet: a low trainable parameters based novel light-weight convolutive feature extraction recurrent network for high accuracy suspect identification

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

In suspect identification systems, facial features play a crucial role in recognising individuals. However, the challenge lies in sustaining the accuracy of the system over a long period of time, ensuring that it remains consistently high, reliable, and effective. This research introduces a novel lightweight model that requires low trainable parameters, a significantly smaller number than pre-trained models, which use millions of trainable parameters. The newly proposed Convolutive Feature Extraction Recurrent Network (ConFERNet) integrates a convolutional neural network and long short-term memory into a single structure to synthesise diverse images. This approach leverages computer graphics techniques to effectively extract facial features. Computer graphics play a pivotal role at various stages of this process, employing techniques such as adaptive histogram equalisation and illumination normalisation to enhance image quality under varying lighting conditions and create diverse training datasets. The LSTM-based convolutive feature-recurrent system demonstrates a notable improvement in accuracy when tested on the Augmented Reality Database (AR-DB), Extended Yale B (E-Yale B), Enhanced Extended Yale B (EE-Yale B), and Extended Cohn-Kanade (CK+) face datasets, achieving accuracy rates of 96.20%, 98.53%, 99.59%, and 99.60%, respectively. These accuracies outperform traditional baseline accuracies of 68.65% for AR-DB, 84.21% for E-Yale B, and 88.37% for CK+, suggesting the potential of this approach in enhancing suspect identification systems. This research contributes to the field by providing an innovative solution through advanced facial image feature extraction, which leads to improved accuracy rates.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data availability

Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.

References

  1. Kortli, Y., Jridi, M., Al Falou, A., Atri, M.: Face recognition systems: a survey. Sensors 20(2), 342 (2020)

    Google Scholar 

  2. Memon, N.: How biometric authentication poses new challenges to our security and privacy [in the spotlight]. IEEE Signal Process. Mag. 34(4), 194–196 (2017)

    MATH  Google Scholar 

  3. Wang, Z., Huang, B., Wang, G., Yi, P., Jiang, K.: Masked face recognition dataset and application. IEEE Trans. Biom. Behav. Identity Sci. 5(2), 298–304 (2023)

    MATH  Google Scholar 

  4. Kadhim, O.N., Abdulameer, M.H.: A multimodal biometric database and case study for face recognition based deep learning. Bull. Electr. Eng. Inf. 13(1), 677–85 (2024)

    MATH  Google Scholar 

  5. Madzou, L., Louradour, S.: Building a governance framework for facial recognition. Biom. Technol. Today 2020(6), 5–8 (2020)

    MATH  Google Scholar 

  6. Chengathir Selvi, M., Maruthupandi, J., Bhuvaneswari, T., Manonmani, T.: An adaptive gravitational search optimization (AGSO)-based convolutional neural network—long short-term memory (CNN-LSTM) approach for face recognition and classification. Concurr. Comput. Pract. Exp. 36(3), e7916 (2024)

    Google Scholar 

  7. Chaudhary, S., Singh, K.K.: Application of transfer learning & independent estimation on transformed facial recognition. Int. J. Intell. Syst. Appl. Eng. 12(3s), 151–160 (2024)

    MATH  Google Scholar 

  8. Singh, J., Bhushan, B.: Real time Indian license plate detection using deep neural networks and optical character recognition using LSTM tesseract. In 2019 international conference on computing, communication, and intelligent systems (ICCCIS) 2019 Oct 18 (pp. 347-352). IEEE

  9. Zhao, F., Feng, J., Zhao, J., Yang, W., Yan, S.: Robust LSTM-autoencoders for face de-occlusion in the wild. IEEE Trans. Image Process. 27(2), 778–90 (2017)

    MathSciNet  MATH  Google Scholar 

  10. An, F., Liu, Z.: Facial expression recognition algorithm based on parameter adaptive initialization of CNN and LSTM. Vis. Comput. 36(3), 483–98 (2020)

    MATH  Google Scholar 

  11. Bader, M., Shahin, I., Ahmed, A., Werghi, N.: Hybrid CNN-LSTM speaker identification framework for evaluating the impact of Face Masks. In 2022 International Conference on Electrical and Computing Technologies and Applications (ICECTA) 2022 Nov 23 (pp. 118-121). IEEE

  12. Castillo Camacho, I., Wang, K.: A comprehensive review of deep-learning-based methods for image forensics. J. Imaging 7(4), 69 (2021)

    MATH  Google Scholar 

  13. Hans, A.S., Rao, S.: A CNN-LSTM based deep neural networks for facial emotion detection in videos. Int. J. Adv. Signal Image Sci. 7(1), 11–20 (2021)

    MATH  Google Scholar 

  14. Hu, M., Wang, H., Wang, X., Yang, J., Wang, R.: Video facial emotion recognition based on local enhanced motion history image and CNN-CTSLSTM networks. J. Vis. Commun. Image Represent. 59, 176–85 (2019)

    MATH  Google Scholar 

  15. Kabir, M.M., Anik, T.A., Abid, M.S., Mridha, M.F., Hamid, M.A.: Facial expression recognition using CNN-LSTM approach. In 2021 international conference on science and contemporary technologies (ICSCT) 2021 Aug 5 (pp. 1-6). IEEE

  16. Karnati, M., Seal, A., Bhattacharjee, D., Yazidi, A., Krejcar, O.: Understanding deep learning techniques for recognition of human emotions using facial expressions: a comprehensive survey. IEEE Trans. Instrum. Meas. 72, 1–31 (2023)

    Google Scholar 

  17. Cheng, Z., Yang, Q., Sheng, B.: Deep colorization. In Proceedings of the IEEE international conference on computer vision, pp. 415-423 (2015)

  18. Vishwakarma, V.P., Dalal, S.: A novel non-linear modifier for adaptive illumination normalization for robust face recognition. Multimed. Tools Appl. 79, 11503–29 (2020)

    MATH  Google Scholar 

  19. Manushree: Manushree07/face-identification: v1.0.0 (image). Zenodo, (2024). https://doi.org/10.5281/zenodo.11421749

  20. Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., Alsaadi, F.E.: A survey of deep neural network architectures and their applications. Neurocomputing 234, 11–26 (2017)

    MATH  Google Scholar 

  21. Sumari, P., Syed, S.J., Abualigah, L.: A novel deep learning pipeline architecture based on CNN to detect Covid-19 in chest X-ray images. Turk. J. Comput. Math. Educ. (TURCOMAT). 12(6), 2001–11 (2021)

    Google Scholar 

  22. Morsi, A.Y., Chow-Wing-Bom, H.T., Schwarzkopf, D.S., Goffaux, V., Dekker, T.M., Greenwood, J.A.: Shared spatial selectivity in early visual cortex and face-selective brain regions (2024)

  23. Xie, Z., Li, J., Shi, H.: A face recognition method based on CNN. J. Phys. Conf. Ser. 1395(1), 012006 (2019)

    MATH  Google Scholar 

  24. Khan, S., Javed, M.H., Ahmed, E., Shah, S.A., Ali, S.U.: Facial recognition using convolutional neural networks and implementation on smart glasses. In 2019 international conference on information science and communication technology (ICISCT) 2019 Mar 9, pp. 1-6. IEEE

  25. Coşkun, M., Uçar, A., Yildirim, O., Demir, Y.: Face recognition based on convolutional neural network. In 2017 International Conference on Modern Electrical and Energy Systems (MEES), pages 376–379. IEEE, (2017)

  26. Ramachandran, P., Zoph, B., Le Quoc, V.: Searching for activation functions. arXiv preprint arXiv:1710.05941, (2017)

  27. Hang, S.T., Aono, M.: Open world plant image identification based on convolutional neural network. In2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA) 2016 Dec 13, pp. 1-4. IEEE

  28. Dubey, A.K., Jain, V.: Comparative study of convolution neural network’s relu and leaky-relu activation functions. In Applications of Computing, Automation and Wireless Systems in Electrical Engineering: Proceedings of MARC 2018 2019, pp. 873-880, Springer Singapore

  29. Roodschild, M., Gotay Sardiñas, J., Will, A.: A new approach for the vanishing gradient problem on sigmoid activation. Prog. Arti. Intell. 9(4), 351–360 (2020)

    MATH  Google Scholar 

  30. Hu, Y., Huber, A., Anumula, J., Liu, S.C.: Overcoming the vanishing gradient problem in plain recurrent networks. arXiv preprint arXiv:1801.06105, (2018)

  31. Li, Z., Liu, F., Yang, W., Peng, S., Zhou, J.: A survey of convolutional neural networks: analysis, applications, and prospects. IEEE transactions on neural networks and learning systems, (2021)

  32. Wang, D., Yu, H., Wang, D., Li, G.: Face recognition system based on cnn. In 2020 International Conference on Computer Information and Big Data Applications (CIBDA), pp. 470–473. IEEE, (2020)

  33. Shree, M., Dev, A., Mohapatra, A.K.: Review on facial recognition system: past, present, and future. In Proceedings of International Conference on Data Science and Applications: ICDSA 2022, Vol. 1, pp. 807–829. Springer, (2023)

  34. Elharrouss, O., Akbari, Y., Almaadeed, N., Al-Maadeed, S.: Backbones-review: feature extraction networks for deep learning and deep reinforcement learning approaches. arXiv preprint arXiv:2206.08016, (2022)

  35. Gudi, A.: Recognizing semantic features in faces using deep learning. arxiv. arXiv, (2015)

  36. Jain, N., Kumar, S., Kumar, A., Shamsolmoali, P., Zareapoor, M.: Hybrid deep neural networks for face emotion recognition. Pattern Recogn. Lett. 115, 101–106 (2018)

    MATH  Google Scholar 

  37. Yan, C., Meng, L., Li, L., Zhang, J., Wang, Z., Yin, J., Zhang, J., Sun, Y., Zheng, B.: Age-invariant face recognition by multi-feature fusionand decomposition with self-attention. ACM Trans. Multimed. Comput. Commun. Appl. (TOMM) 18(1), 1–18 (2022)

    MATH  Google Scholar 

  38. Petersen, N.C., Rodrigues, F., Pereira, F.C.: Multi-output bus travel time prediction with convolutional lstm neural network. Exp. Syst. Appl. 120, 426–435 (2019)

    MATH  Google Scholar 

  39. Liang, P., Liu, G., Xiong, Z., Fan, H., Zhu, H., Zhang, X.: A facial geometry-based detection model for face manipulation using cnn-lstm architecture. Inf. Sci. 633, 370–383 (2023)

    MATH  Google Scholar 

  40. Wang, M., Wang, Z., Jinming, L., Lin, J., Wang, Z.: E-lstm: An efficient hardware architecture for long short-term memory. IEEE J. Emerg. Selected Topics Circuits Syst. 9(2), 280–291 (2019)

    MATH  Google Scholar 

  41. Yadav, K.S., Singha, J.: Facial expression recognition using modified viola-john’s algorithm and knn classifier. Multimed. Tools Appl. 79, 13089–13107 (2020)

    MATH  Google Scholar 

  42. Roy, S.K., Krishna, G., Dubey, S.R., Chaudhuri, B.B.: Hybridsn: exploring 3-d-2-d cnn feature hierarchy for hyperspectral image classification. IEEE Geosci. Remote Sens. Lett. 17(2), 277–281 (2019)

    MATH  Google Scholar 

  43. Mohan, K., Seal, A., Krejcar, O., Yazidi, A.: Fer-net: Facial expression recognition using deep neural net. Neural Comput. Appl. 33(15), 9125–9136 (2021)

    Google Scholar 

  44. Ming, Y., Qian, H., Guangyuan, L., et al.: Cnn-lstm facial expression recognition method fused with two-layer attention mechanism. Computational Intelligence and Neuroscience, 2022, (2022)

  45. Bui Thanh, H., Le Minh, T.: Facial expression recognition with cnn-lstm. In Research in Intelligent and Computing in Engineering: Select Proceedings of RICE 2020, pages 549–560. Springer, (2021)

  46. Klare, B.F., Klum, S., Klontz, J.C., Taborsky, E., Akgul, T., Jain, A.K.: Suspect identification based on descriptive facial attributes. In IEEE International Joint Conference on Biometrics 2014 Sep 29, pp. 1-8. IEEE

  47. Elmahmudi, A., Ugail, H.: Deep face recognition using imperfect facial data. Futur. Gener. Comput. Syst. 99, 213–225 (2019)

    MATH  Google Scholar 

  48. Sun, L., Tang, T., Yuke, Q., Qin, W.: Bidirectional temporal feature for 3d human pose and shape estimation from a video. Comput. Anim. Virtual Worlds 34, e2187 (2023)

    Google Scholar 

  49. Andrejevic, M., Selwyn, Neil: Facial recognition technology in schools: critical questions and concerns. Learn. Media Technol. 45(2), 115–128 (2020)

    MATH  Google Scholar 

  50. Amirian, S., Rasheed, K., Taha, T.R., Arabnia, H.R.,: A short review on image caption generation with deep learning. In Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition (IPCV) (pp. 10-18). The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp) (2019)

  51. Guan, J., Wang, E.: Repeated review based image captioning for image evidence review. Signal Process. Image Commun. 63, 141–148 (2018)

    MATH  Google Scholar 

  52. Ikromovich, H.O., Mamatkulovich, B.B.: Facial recognition using transfer learning in the deep cnn. Open Access Repos. 4(3), 502–7 (2023)

    Google Scholar 

  53. Ni, R., Cao, H.: Sentiment analysis based on glove and lstm-gru. In 2020 39th Chinese control conference (CCC), pp. 7492–7497. IEEE, (2020)

  54. Huan, R.H., Shu, J., Bao, S.L., Liang, R.H., Chen, P., Chi, K.K.: Video multimodal emotion recognition based on bi-gru and attention fusion. Multimed. Tools Appl. 80, 8213–8240 (2021)

    Google Scholar 

  55. Wang, W., Cui, Z., Yan, Y., Feng, J., Yan, S., Shu, X., Sebe, N.: Recurrent face aging. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2378–2386, (2016)

  56. Montserrat, D.M., Hao, H., Yarlagadda, S.K., Baireddy, S., Shao, R., Horváth, J., Bartusiak, E., Yang, J., Guera, D., Zhu, F., et al.: Deepfakes detection with automatic face weighting. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp. 668–669, (2020)

  57. Georgopoulos, M., Panagakis, Y., Pantic, M.: Investigating bias in deep face analysis: the kanface dataset and empirical study. Image Vis. Comput. 102, 103954 (2020)

    MATH  Google Scholar 

  58. Kortli, Y., Jridi, M., Al Falou, A., Atri, M.: A comparative study of cfs, lbp, hog, sift, surf, and brief for security and face recognition. In Advanced Secure Optical Image Processing for Communications. IOP Publishing, (2018)

  59. Koklu, M., Cinar, I., Taspinar, Y.S.: Cnn-based bi-directional and directional long-short term memory network for determination of face mask. Biomed. Signal Process. Control 71, 103216 (2022)

    MATH  Google Scholar 

  60. Al-Qaisi, Aws, AlTarawneh, Mokhled S., ElSaid, AbdElRahman A., Alqadi, Ziad: A hybrid method of face feature extraction, classification based on mlbp and layered-recurrent network. Traitement du Signal 37(4), 555–561 (2020)

    Google Scholar 

  61. Çayir, A., Yenidoğan, I., Dağ, H.: Feature extraction based on deep learning for some traditional machine learning methods. In 2018 3rd International Conference on computer science and Engineering (UBMK), pp. 494–497. IEEE, (2018)

  62. Agaga, S.: Facial recognition in criminal investigation, (2018)

  63. Juefei-Xu, F., Luu, K., Savvides, M.: Spartans: single-sample periocular-based alignment-robust recognition technique applied to non-frontal scenarios. IEEE Trans. Image Process. 24(12), 4780–4795 (2015)

    MathSciNet  MATH  Google Scholar 

  64. Lee, E., Whalen, T., Sakalauskas, J., Baigent, G., Bisesar, C., McCarthy, A., Reid, G., Wotton, C.: Suspect identification by facial features. Ergonomics 47(7), 719–747 (2004)

    Google Scholar 

  65. Rangayya, V., Patil, N.: Improved face recognition method using SVM-MRF with KTBD based KCM segmentation approach. Int. J. Syst. Assur. Eng. Manag. 15(1), 1–2 (2024)

    Google Scholar 

  66. Mohan, K., Seal, A., Krejcar, O., Yazidi, A.: Facial expression recognition using local gravitational force descriptor-based deep convolution neural networks. IEEE Trans. Instrum. Meas. 70, 1–12 (2020)

    Google Scholar 

  67. Ilyas, B.R., Mohammed, B., Khaled, M., Miloud, K.: Enhanced face recognition system based on deep cnn. In 2019 6th International Conference on Image and Signal Processing and their Applications (ISPA), pp. 1–6. IEEE, (2019)

  68. Hosgurmath, S., Mallappa, V.V., Patil, N.B., Petli, V.: A face recognition system using convolutional feature extraction with linear collaborative discriminant regression classification. Int. J. Electr. Comput. Eng. 12(2), 1468 (2022)

    Google Scholar 

  69. Sing, J.K., Chowdhury, S., Basu, D.K., Nasipuri, M.: An improved hybrid approach to face recognition by fusing local and global discriminant features. Int. J. Biom. 4(2), 144–164 (2012)

    MATH  Google Scholar 

  70. Min, W., Wanjuan, S., Chen, L., Liu, Z., Cao, W., Hirota, K.: Weight-adapted convolution neural network for facial expression recognition in human-robot interaction. IEEE Trans. Syst. Man and Cybernet. Syst. 51(3), 1473–1484 (2019)

  71. Ahmed, T., Das, P., Ali, M.F., Mahmud, M.F.: A comparative study on convolutional neural network based face recognition. In 2020 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT), pp. 1–5. IEEE, (2020)

  72. Karnati, Mohan, Seal, Ayan, Yazidi, Anis, Krejcar, Ondrej: Flepnet: Feature level ensemble parallel network for facial expression recognition. IEEE Trans. Affect. Comput. 13(4), 2058–2070 (2022)

    Google Scholar 

  73. Mohana, M., Subashini, P., Krishnaveni, M.: Emotion recognition from facial expression using hybrid cnn-lstm network. Int. J. Pattern Recognit. Artif. Intell. 37(08), 2356008 (2023)

    Google Scholar 

  74. Rangayya, V., Patil, N.: Improved face recognition method using svm-mrf with ktbd based kcm segmentation approach. Int. J. Syst. Assur. Eng. Manag. 15(1), 1–12 (2024)

    Google Scholar 

  75. Tribuana, D., Hazriani, H., Arda, A.L.: Face recognition for smart door security access with convolutional neural network method. TELKOMNIKA (Telecommun. Comput. Electr. Control) 22(3), 702–710 (2024)

  76. Labiadh, I., Boubchir, L., Seddik, H.: Enhancing 2D–3D facial recognition accuracy of truncated-hiden faces using fused multi-model biometric deep features. Multimed. Tools Appl. 9, 1–28 (2024)

    MATH  Google Scholar 

  77. Mohan, K., Ayan, S., Joanna, J.K., Ondrej, K.: Facial expression recognition in-the-wild using blended feature attention network. IEEE Transactions on Instrumentation and Measurement (2023)

Download references

Acknowledgements

The author sincerely appreciates the assistance and cooperation from the Central Forensic Science Laboratory (CFSL) and the Ministry of Home Affairs (MHA) during our research endeavours. The expertise and resources offered by CFSL played a crucial role in conducting forensic analysis and investigations, significantly improving the overall quality of our findings. Our heartfelt gratitude goes to CFSL and MHA for their invaluable support throughout our research projects. Additionally, we would like to thank our research team members, advisers, and colleagues for their time, expertise, and commitment to the initiatives.

Funding

All authors declare that no funds, grants, or other support were received during the preparation of this manuscript.

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to the study conception and design. The model development and experiments were performed by Manu Shree. The first draft of the manuscript was written by Manu Shree, Amar Kumar Mohapatra, Virendra P. Vishwakarma, Hemmaphan Suwanwiwat and Ickjai Lee reviewed the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Manu Shree.

Ethics declarations

Conflict of interest

The authors declare no Conflict of interest.

Ethical approval

Ethics Approval This work does not contain any studies with human partici- pants or animals performed by any of the authors.

Consent to publish

All authors have read and agreed for publication of the manuscript. References

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file 1 (pdf 375 KB)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shree, M., Mohapatra, A.K., Suwanwiwat, H. et al. ConFERNet: a low trainable parameters based novel light-weight convolutive feature extraction recurrent network for high accuracy suspect identification. SIViP 19, 153 (2025). https://doi.org/10.1007/s11760-024-03603-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11760-024-03603-5

Keywords

Navigation