Skip to main content

Advertisement

Log in

Improving the performance of the lip identification through the use of shape correction

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

This work presents automatic identification and verification approaches based on lip biometrics, using a static lip shape and applying a lip correction preprocessing, transforming data from Hidden Markov Model and being classified by Support Vector Machines. The classification system is conclusive for the identification of a person by the shape of the lips, even if the person presents soft facial emotions. Moreover the use of static lips shape has been revealed as a good option for security applications. The experiments have been carried out with two public datasets. One dataset was used to model and validate the approach, and the other dataset has been used to test the model blindly. The accuracy is up to 100% and 99.76% for GDPS-ULPGC and RaFD datasets respectively, using two training samples under a hold-out validation. Based on the results we can conclude that the system is very robust and stable with the highest classification capacity and minimal computation complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

References

  1. Travieso CM, Zhang J, Miller P, Alonso JB, Ferrer MA (2011) Bimodal biometric verification based on face and lips. Neurocomputing 74(14):2407–2410

    Article  Google Scholar 

  2. Wang SL, Liew AWC (2012) Physiological and behavioral lip biometrics: A comprehensive study of their discriminative power. Pattern Recogn 45(9):3328–3335

    Article  Google Scholar 

  3. Mehra A, Kumawat M, Ranjan R, Pandey B, Ranjan S, Shukla A, Tiwari R (2010) Expert system for speaker identification using lip features with PCA. In Intelligent Systems and Applications (ISA), 2010 2nd International Workshop on (pp. 1–4)

  4. Arsic I, Vilagut R, Thiran JP (2006) Automatic extraction of geometric lip features with application to multi-modal speaker identification. In Multimedia and Expo, 2006 IEEE International Conference on (pp. 161–164)

  5. Newman JL, Cox SJ (2009). Automatic visual-only language identification: A preliminary study. In Acoustics, Speech and Signal Processing, 2009. ICASSP 2009. IEEE International Conference on (pp. 4345–4348). IEEE

  6. Newman JL, Cox SJ (2010) Speaker independent visual-only language identification. In Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on (pp. 5026–5029). IEEE

  7. Chan CH, Goswami B, Kittler J, Christmas W (2012) Local ordinal contrast pattern histograms for spatiotemporal, lip-based speaker authentication. IEEE Transactions on Information Forensics and Security 7(2):602–612

    Article  Google Scholar 

  8. Briceño JC, Travieso CM, Alonso JB, Ferrer MA (2010) Robust identification of persons by lips contour using shape transformation. In Intelligent Engineering Systems (INES), 2010 14th International Conference on (pp. 203–207). IEEE

  9. Raheja JL, Shyam R, Gupta J, Kumar U, Prasad PB (2010) Facial gesture identification using lip contours. In Machine Learning and Computing (ICMLC), 2010 Second International Conference on (pp. 3–7). IEEE

  10. Rohani R, Alizadeh S, Sobhanmanesh F, Boostani R (2008) Lip segmentation in color images. In Innovations in Information Technology, 2008. IIT 2008. International Conference on (pp. 747–750). IEEE

  11. Shokhan MH, Khitam AM (2015) Biometric Identification System by Lip Shape. International Journal of Advanced Computer Research 5(18):19

    Google Scholar 

  12. Shen X, Wang Z, Wang Y, Chen H (2015) Dynamic Lip Identification Algorithm Based on Automatic Calibration of Feature Points. Journal of Information & Computational Science 12(15):5659–5665

    Article  Google Scholar 

  13. Kumaran M, Bastia BK, Kumar L, Patel SH (2017) Correlation between Fingerprint and Lip Print Pattern in Gujarati Population. Medico-Legal Update 17(1)

  14. Sharma R, Sharma K, Preethi N, Degra H, Rajmani H (2017) Cheiloscopy: A Study of Morphological patterns of Lip Prints in Rajasthani population. Journal of Research in Medical and Dental Science 3(1):35–38

    Article  Google Scholar 

  15. Thakur B, Ghosh B, Puri N, Bansal R, Yadav S, Sharma RK (2017) A comparative study of lip print patterns in monozygotic and dizygotic twins. International Journal of Research in Medical Sciences 5(5):2144–2149

    Article  Google Scholar 

  16. Alzapur A, Nagothu RS, Nalluri HB (2017) Lip prints-A study of its uniqueness among students of MediCiti Medical College. Indian Journal of Clinical Anatomy and Physiology 4(1):68

    Google Scholar 

  17. Travieso CM, Zhang J, Miller P, Alonso JB (2014) Using a Discrete Hidden Markov Model Kernel for lip-based biometric identification. Image Vis Comput 32(12):1080–1089

    Article  Google Scholar 

  18. Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154

    Article  Google Scholar 

  19. Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Transactions on Systems, Man, and Cybernetics 9(1):62–66

    Article  Google Scholar 

  20. Bishop CM (1995) Neural networks for pattern recognition. Oxford University Press, Oxford

    MATH  Google Scholar 

  21. Rabiner LR (1989) A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 77(2):257–286

    Article  Google Scholar 

  22. Cervantes J, Li X, Yu W, Li K (2008) Support vector machine classification for large data sets via minimum enclosing ball clustering. Neurocomputing 71(4):611–619

    Article  Google Scholar 

  23. Hernando J, Nadeu C, Mariño J (1997) Speech recognition in a noisy car environment based on LP of the one-sided autocorrelation sequence and robust similarity measuring techniques. Speech Comm 21(1–2):17–31

    Article  Google Scholar 

  24. Rabiner L, Juang B (1986) An introduction to hidden Markov models. IEEE ASSP Mag 3(1):4–16

    Article  Google Scholar 

  25. Ferrer MA, Alonso JB, Travieso CM (2005) Offline geometric parameters for automatic signature verification using fixed-point arithmetic. IEEE Trans Pattern Anal Mach Intell 27(6):993–997

    Article  Google Scholar 

  26. David S, Ferrer MA, Travieso CM, Alonso JB (2004) GPDSHMM: A hidden Markov model toolbox in the MATLAB environment. CSIMTA, Complex Systems Intelligence and Modern Technological Applications, 476–479

  27. Jaakkola T, Diekhans M, Haussler D (2000) A discriminative framework for detecting remote protein homologies. J Comput Biol 7(1–2):95–114

    Article  Google Scholar 

  28. Langner O, Dotsch R, Bijlstra G, Wigboldus DH, Hawk ST, Van Knippenberg AD (2010) Presentation and validation of the Radboud Faces Database. Cognit Emot 24(8):1377–1388

    Article  Google Scholar 

  29. Braga-Neto UM, Dougherty ER (2004) Is cross-validation valid for small-sample microarray classification? Bioinformatics 20(3):374–380

    Article  Google Scholar 

  30. Wrobel K, Doroz R, Porwik P, Naruniec J, Kowalsk M (2017) Using a probabilistic neural network for lip-based biometric verification. Eng Appl Artif Intell 64:112–127

    Article  Google Scholar 

  31. Wang S-L, Liew AW-C (2012) Physiological and behavioral lip biometrics: A comprehensive study of their discriminative power. Pattern Recogn 45:3328–3335

    Article  Google Scholar 

Download references

Acknowledgements

This work has been suported by Ministerio de Economía y Competitividad (TEC2016-77791-C4-1-R).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Antonio G. Ravelo-García.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Travieso, C.M., Ravelo-García, A.G., Alonso, J.B. et al. Improving the performance of the lip identification through the use of shape correction. Appl Intell 49, 1823–1840 (2019). https://doi.org/10.1007/s10489-018-1352-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-018-1352-6

Keywords

Navigation