Abstract
In suspect identification systems, facial features play a crucial role in recognising individuals. However, the challenge lies in sustaining the accuracy of the system over a long period of time, ensuring that it remains consistently high, reliable, and effective. This research introduces a novel lightweight model that requires low trainable parameters, a significantly smaller number than pre-trained models, which use millions of trainable parameters. The newly proposed Convolutive Feature Extraction Recurrent Network (ConFERNet) integrates a convolutional neural network and long short-term memory into a single structure to synthesise diverse images. This approach leverages computer graphics techniques to effectively extract facial features. Computer graphics play a pivotal role at various stages of this process, employing techniques such as adaptive histogram equalisation and illumination normalisation to enhance image quality under varying lighting conditions and create diverse training datasets. The LSTM-based convolutive feature-recurrent system demonstrates a notable improvement in accuracy when tested on the Augmented Reality Database (AR-DB), Extended Yale B (E-Yale B), Enhanced Extended Yale B (EE-Yale B), and Extended Cohn-Kanade (CK+) face datasets, achieving accuracy rates of 96.20%, 98.53%, 99.59%, and 99.60%, respectively. These accuracies outperform traditional baseline accuracies of 68.65% for AR-DB, 84.21% for E-Yale B, and 88.37% for CK+, suggesting the potential of this approach in enhancing suspect identification systems. This research contributes to the field by providing an innovative solution through advanced facial image feature extraction, which leads to improved accuracy rates.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03603-5/MediaObjects/11760_2024_3603_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03603-5/MediaObjects/11760_2024_3603_Fig2_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03603-5/MediaObjects/11760_2024_3603_Fig3_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03603-5/MediaObjects/11760_2024_3603_Fig4_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03603-5/MediaObjects/11760_2024_3603_Fig5_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03603-5/MediaObjects/11760_2024_3603_Fig6_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03603-5/MediaObjects/11760_2024_3603_Fig7_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03603-5/MediaObjects/11760_2024_3603_Fig8_HTML.png)
Similar content being viewed by others
Data availability
Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.
References
Kortli, Y., Jridi, M., Al Falou, A., Atri, M.: Face recognition systems: a survey. Sensors 20(2), 342 (2020)
Memon, N.: How biometric authentication poses new challenges to our security and privacy [in the spotlight]. IEEE Signal Process. Mag. 34(4), 194–196 (2017)
Wang, Z., Huang, B., Wang, G., Yi, P., Jiang, K.: Masked face recognition dataset and application. IEEE Trans. Biom. Behav. Identity Sci. 5(2), 298–304 (2023)
Kadhim, O.N., Abdulameer, M.H.: A multimodal biometric database and case study for face recognition based deep learning. Bull. Electr. Eng. Inf. 13(1), 677–85 (2024)
Madzou, L., Louradour, S.: Building a governance framework for facial recognition. Biom. Technol. Today 2020(6), 5–8 (2020)
Chengathir Selvi, M., Maruthupandi, J., Bhuvaneswari, T., Manonmani, T.: An adaptive gravitational search optimization (AGSO)-based convolutional neural network—long short-term memory (CNN-LSTM) approach for face recognition and classification. Concurr. Comput. Pract. Exp. 36(3), e7916 (2024)
Chaudhary, S., Singh, K.K.: Application of transfer learning & independent estimation on transformed facial recognition. Int. J. Intell. Syst. Appl. Eng. 12(3s), 151–160 (2024)
Singh, J., Bhushan, B.: Real time Indian license plate detection using deep neural networks and optical character recognition using LSTM tesseract. In 2019 international conference on computing, communication, and intelligent systems (ICCCIS) 2019 Oct 18 (pp. 347-352). IEEE
Zhao, F., Feng, J., Zhao, J., Yang, W., Yan, S.: Robust LSTM-autoencoders for face de-occlusion in the wild. IEEE Trans. Image Process. 27(2), 778–90 (2017)
An, F., Liu, Z.: Facial expression recognition algorithm based on parameter adaptive initialization of CNN and LSTM. Vis. Comput. 36(3), 483–98 (2020)
Bader, M., Shahin, I., Ahmed, A., Werghi, N.: Hybrid CNN-LSTM speaker identification framework for evaluating the impact of Face Masks. In 2022 International Conference on Electrical and Computing Technologies and Applications (ICECTA) 2022 Nov 23 (pp. 118-121). IEEE
Castillo Camacho, I., Wang, K.: A comprehensive review of deep-learning-based methods for image forensics. J. Imaging 7(4), 69 (2021)
Hans, A.S., Rao, S.: A CNN-LSTM based deep neural networks for facial emotion detection in videos. Int. J. Adv. Signal Image Sci. 7(1), 11–20 (2021)
Hu, M., Wang, H., Wang, X., Yang, J., Wang, R.: Video facial emotion recognition based on local enhanced motion history image and CNN-CTSLSTM networks. J. Vis. Commun. Image Represent. 59, 176–85 (2019)
Kabir, M.M., Anik, T.A., Abid, M.S., Mridha, M.F., Hamid, M.A.: Facial expression recognition using CNN-LSTM approach. In 2021 international conference on science and contemporary technologies (ICSCT) 2021 Aug 5 (pp. 1-6). IEEE
Karnati, M., Seal, A., Bhattacharjee, D., Yazidi, A., Krejcar, O.: Understanding deep learning techniques for recognition of human emotions using facial expressions: a comprehensive survey. IEEE Trans. Instrum. Meas. 72, 1–31 (2023)
Cheng, Z., Yang, Q., Sheng, B.: Deep colorization. In Proceedings of the IEEE international conference on computer vision, pp. 415-423 (2015)
Vishwakarma, V.P., Dalal, S.: A novel non-linear modifier for adaptive illumination normalization for robust face recognition. Multimed. Tools Appl. 79, 11503–29 (2020)
Manushree: Manushree07/face-identification: v1.0.0 (image). Zenodo, (2024). https://doi.org/10.5281/zenodo.11421749
Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., Alsaadi, F.E.: A survey of deep neural network architectures and their applications. Neurocomputing 234, 11–26 (2017)
Sumari, P., Syed, S.J., Abualigah, L.: A novel deep learning pipeline architecture based on CNN to detect Covid-19 in chest X-ray images. Turk. J. Comput. Math. Educ. (TURCOMAT). 12(6), 2001–11 (2021)
Morsi, A.Y., Chow-Wing-Bom, H.T., Schwarzkopf, D.S., Goffaux, V., Dekker, T.M., Greenwood, J.A.: Shared spatial selectivity in early visual cortex and face-selective brain regions (2024)
Xie, Z., Li, J., Shi, H.: A face recognition method based on CNN. J. Phys. Conf. Ser. 1395(1), 012006 (2019)
Khan, S., Javed, M.H., Ahmed, E., Shah, S.A., Ali, S.U.: Facial recognition using convolutional neural networks and implementation on smart glasses. In 2019 international conference on information science and communication technology (ICISCT) 2019 Mar 9, pp. 1-6. IEEE
Coşkun, M., Uçar, A., Yildirim, O., Demir, Y.: Face recognition based on convolutional neural network. In 2017 International Conference on Modern Electrical and Energy Systems (MEES), pages 376–379. IEEE, (2017)
Ramachandran, P., Zoph, B., Le Quoc, V.: Searching for activation functions. arXiv preprint arXiv:1710.05941, (2017)
Hang, S.T., Aono, M.: Open world plant image identification based on convolutional neural network. In2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA) 2016 Dec 13, pp. 1-4. IEEE
Dubey, A.K., Jain, V.: Comparative study of convolution neural network’s relu and leaky-relu activation functions. In Applications of Computing, Automation and Wireless Systems in Electrical Engineering: Proceedings of MARC 2018 2019, pp. 873-880, Springer Singapore
Roodschild, M., Gotay Sardiñas, J., Will, A.: A new approach for the vanishing gradient problem on sigmoid activation. Prog. Arti. Intell. 9(4), 351–360 (2020)
Hu, Y., Huber, A., Anumula, J., Liu, S.C.: Overcoming the vanishing gradient problem in plain recurrent networks. arXiv preprint arXiv:1801.06105, (2018)
Li, Z., Liu, F., Yang, W., Peng, S., Zhou, J.: A survey of convolutional neural networks: analysis, applications, and prospects. IEEE transactions on neural networks and learning systems, (2021)
Wang, D., Yu, H., Wang, D., Li, G.: Face recognition system based on cnn. In 2020 International Conference on Computer Information and Big Data Applications (CIBDA), pp. 470–473. IEEE, (2020)
Shree, M., Dev, A., Mohapatra, A.K.: Review on facial recognition system: past, present, and future. In Proceedings of International Conference on Data Science and Applications: ICDSA 2022, Vol. 1, pp. 807–829. Springer, (2023)
Elharrouss, O., Akbari, Y., Almaadeed, N., Al-Maadeed, S.: Backbones-review: feature extraction networks for deep learning and deep reinforcement learning approaches. arXiv preprint arXiv:2206.08016, (2022)
Gudi, A.: Recognizing semantic features in faces using deep learning. arxiv. arXiv, (2015)
Jain, N., Kumar, S., Kumar, A., Shamsolmoali, P., Zareapoor, M.: Hybrid deep neural networks for face emotion recognition. Pattern Recogn. Lett. 115, 101–106 (2018)
Yan, C., Meng, L., Li, L., Zhang, J., Wang, Z., Yin, J., Zhang, J., Sun, Y., Zheng, B.: Age-invariant face recognition by multi-feature fusionand decomposition with self-attention. ACM Trans. Multimed. Comput. Commun. Appl. (TOMM) 18(1), 1–18 (2022)
Petersen, N.C., Rodrigues, F., Pereira, F.C.: Multi-output bus travel time prediction with convolutional lstm neural network. Exp. Syst. Appl. 120, 426–435 (2019)
Liang, P., Liu, G., Xiong, Z., Fan, H., Zhu, H., Zhang, X.: A facial geometry-based detection model for face manipulation using cnn-lstm architecture. Inf. Sci. 633, 370–383 (2023)
Wang, M., Wang, Z., Jinming, L., Lin, J., Wang, Z.: E-lstm: An efficient hardware architecture for long short-term memory. IEEE J. Emerg. Selected Topics Circuits Syst. 9(2), 280–291 (2019)
Yadav, K.S., Singha, J.: Facial expression recognition using modified viola-john’s algorithm and knn classifier. Multimed. Tools Appl. 79, 13089–13107 (2020)
Roy, S.K., Krishna, G., Dubey, S.R., Chaudhuri, B.B.: Hybridsn: exploring 3-d-2-d cnn feature hierarchy for hyperspectral image classification. IEEE Geosci. Remote Sens. Lett. 17(2), 277–281 (2019)
Mohan, K., Seal, A., Krejcar, O., Yazidi, A.: Fer-net: Facial expression recognition using deep neural net. Neural Comput. Appl. 33(15), 9125–9136 (2021)
Ming, Y., Qian, H., Guangyuan, L., et al.: Cnn-lstm facial expression recognition method fused with two-layer attention mechanism. Computational Intelligence and Neuroscience, 2022, (2022)
Bui Thanh, H., Le Minh, T.: Facial expression recognition with cnn-lstm. In Research in Intelligent and Computing in Engineering: Select Proceedings of RICE 2020, pages 549–560. Springer, (2021)
Klare, B.F., Klum, S., Klontz, J.C., Taborsky, E., Akgul, T., Jain, A.K.: Suspect identification based on descriptive facial attributes. In IEEE International Joint Conference on Biometrics 2014 Sep 29, pp. 1-8. IEEE
Elmahmudi, A., Ugail, H.: Deep face recognition using imperfect facial data. Futur. Gener. Comput. Syst. 99, 213–225 (2019)
Sun, L., Tang, T., Yuke, Q., Qin, W.: Bidirectional temporal feature for 3d human pose and shape estimation from a video. Comput. Anim. Virtual Worlds 34, e2187 (2023)
Andrejevic, M., Selwyn, Neil: Facial recognition technology in schools: critical questions and concerns. Learn. Media Technol. 45(2), 115–128 (2020)
Amirian, S., Rasheed, K., Taha, T.R., Arabnia, H.R.,: A short review on image caption generation with deep learning. In Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition (IPCV) (pp. 10-18). The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp) (2019)
Guan, J., Wang, E.: Repeated review based image captioning for image evidence review. Signal Process. Image Commun. 63, 141–148 (2018)
Ikromovich, H.O., Mamatkulovich, B.B.: Facial recognition using transfer learning in the deep cnn. Open Access Repos. 4(3), 502–7 (2023)
Ni, R., Cao, H.: Sentiment analysis based on glove and lstm-gru. In 2020 39th Chinese control conference (CCC), pp. 7492–7497. IEEE, (2020)
Huan, R.H., Shu, J., Bao, S.L., Liang, R.H., Chen, P., Chi, K.K.: Video multimodal emotion recognition based on bi-gru and attention fusion. Multimed. Tools Appl. 80, 8213–8240 (2021)
Wang, W., Cui, Z., Yan, Y., Feng, J., Yan, S., Shu, X., Sebe, N.: Recurrent face aging. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2378–2386, (2016)
Montserrat, D.M., Hao, H., Yarlagadda, S.K., Baireddy, S., Shao, R., Horváth, J., Bartusiak, E., Yang, J., Guera, D., Zhu, F., et al.: Deepfakes detection with automatic face weighting. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp. 668–669, (2020)
Georgopoulos, M., Panagakis, Y., Pantic, M.: Investigating bias in deep face analysis: the kanface dataset and empirical study. Image Vis. Comput. 102, 103954 (2020)
Kortli, Y., Jridi, M., Al Falou, A., Atri, M.: A comparative study of cfs, lbp, hog, sift, surf, and brief for security and face recognition. In Advanced Secure Optical Image Processing for Communications. IOP Publishing, (2018)
Koklu, M., Cinar, I., Taspinar, Y.S.: Cnn-based bi-directional and directional long-short term memory network for determination of face mask. Biomed. Signal Process. Control 71, 103216 (2022)
Al-Qaisi, Aws, AlTarawneh, Mokhled S., ElSaid, AbdElRahman A., Alqadi, Ziad: A hybrid method of face feature extraction, classification based on mlbp and layered-recurrent network. Traitement du Signal 37(4), 555–561 (2020)
Çayir, A., Yenidoğan, I., Dağ, H.: Feature extraction based on deep learning for some traditional machine learning methods. In 2018 3rd International Conference on computer science and Engineering (UBMK), pp. 494–497. IEEE, (2018)
Agaga, S.: Facial recognition in criminal investigation, (2018)
Juefei-Xu, F., Luu, K., Savvides, M.: Spartans: single-sample periocular-based alignment-robust recognition technique applied to non-frontal scenarios. IEEE Trans. Image Process. 24(12), 4780–4795 (2015)
Lee, E., Whalen, T., Sakalauskas, J., Baigent, G., Bisesar, C., McCarthy, A., Reid, G., Wotton, C.: Suspect identification by facial features. Ergonomics 47(7), 719–747 (2004)
Rangayya, V., Patil, N.: Improved face recognition method using SVM-MRF with KTBD based KCM segmentation approach. Int. J. Syst. Assur. Eng. Manag. 15(1), 1–2 (2024)
Mohan, K., Seal, A., Krejcar, O., Yazidi, A.: Facial expression recognition using local gravitational force descriptor-based deep convolution neural networks. IEEE Trans. Instrum. Meas. 70, 1–12 (2020)
Ilyas, B.R., Mohammed, B., Khaled, M., Miloud, K.: Enhanced face recognition system based on deep cnn. In 2019 6th International Conference on Image and Signal Processing and their Applications (ISPA), pp. 1–6. IEEE, (2019)
Hosgurmath, S., Mallappa, V.V., Patil, N.B., Petli, V.: A face recognition system using convolutional feature extraction with linear collaborative discriminant regression classification. Int. J. Electr. Comput. Eng. 12(2), 1468 (2022)
Sing, J.K., Chowdhury, S., Basu, D.K., Nasipuri, M.: An improved hybrid approach to face recognition by fusing local and global discriminant features. Int. J. Biom. 4(2), 144–164 (2012)
Min, W., Wanjuan, S., Chen, L., Liu, Z., Cao, W., Hirota, K.: Weight-adapted convolution neural network for facial expression recognition in human-robot interaction. IEEE Trans. Syst. Man and Cybernet. Syst. 51(3), 1473–1484 (2019)
Ahmed, T., Das, P., Ali, M.F., Mahmud, M.F.: A comparative study on convolutional neural network based face recognition. In 2020 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT), pp. 1–5. IEEE, (2020)
Karnati, Mohan, Seal, Ayan, Yazidi, Anis, Krejcar, Ondrej: Flepnet: Feature level ensemble parallel network for facial expression recognition. IEEE Trans. Affect. Comput. 13(4), 2058–2070 (2022)
Mohana, M., Subashini, P., Krishnaveni, M.: Emotion recognition from facial expression using hybrid cnn-lstm network. Int. J. Pattern Recognit. Artif. Intell. 37(08), 2356008 (2023)
Rangayya, V., Patil, N.: Improved face recognition method using svm-mrf with ktbd based kcm segmentation approach. Int. J. Syst. Assur. Eng. Manag. 15(1), 1–12 (2024)
Tribuana, D., Hazriani, H., Arda, A.L.: Face recognition for smart door security access with convolutional neural network method. TELKOMNIKA (Telecommun. Comput. Electr. Control) 22(3), 702–710 (2024)
Labiadh, I., Boubchir, L., Seddik, H.: Enhancing 2D–3D facial recognition accuracy of truncated-hiden faces using fused multi-model biometric deep features. Multimed. Tools Appl. 9, 1–28 (2024)
Mohan, K., Ayan, S., Joanna, J.K., Ondrej, K.: Facial expression recognition in-the-wild using blended feature attention network. IEEE Transactions on Instrumentation and Measurement (2023)
Acknowledgements
The author sincerely appreciates the assistance and cooperation from the Central Forensic Science Laboratory (CFSL) and the Ministry of Home Affairs (MHA) during our research endeavours. The expertise and resources offered by CFSL played a crucial role in conducting forensic analysis and investigations, significantly improving the overall quality of our findings. Our heartfelt gratitude goes to CFSL and MHA for their invaluable support throughout our research projects. Additionally, we would like to thank our research team members, advisers, and colleagues for their time, expertise, and commitment to the initiatives.
Funding
All authors declare that no funds, grants, or other support were received during the preparation of this manuscript.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. The model development and experiments were performed by Manu Shree. The first draft of the manuscript was written by Manu Shree, Amar Kumar Mohapatra, Virendra P. Vishwakarma, Hemmaphan Suwanwiwat and Ickjai Lee reviewed the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no Conflict of interest.
Ethical approval
Ethics Approval This work does not contain any studies with human partici- pants or animals performed by any of the authors.
Consent to publish
All authors have read and agreed for publication of the manuscript. References
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Shree, M., Mohapatra, A.K., Suwanwiwat, H. et al. ConFERNet: a low trainable parameters based novel light-weight convolutive feature extraction recurrent network for high accuracy suspect identification. SIViP 19, 153 (2025). https://doi.org/10.1007/s11760-024-03603-5
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11760-024-03603-5