Skip to main content
SpringerLink
Log in

Robust local oriented patterns for ear recognition

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Extraction and description of image features is an active research topic and important for several applications of computer vision field. This paper presents a new noise-tolerant and rotation-invariant local feature descriptor called robust local oriented patterns (RLOP). The proposed descriptor extracts local image structures utilizing edge directional information to provide rotation-invariant patterns and to be effective in noise and changing illumination situations. This is achieved by a non-linear amalgamation of two specific strategies; binarizing neighborhood pixels of a patch and assigning binomial weights in the same formula. In the encoding methodology, the neighboring pixels is binarized with respect to the mean value of pixels in an image patch of size 3 × 3 instead of the center pixel. Thus, the obtained codes are rotation-invariant and more robust against noise and other non-monotonic grayscale variations. Ear recognition is considered as the representative problem, where the ear involves localized patterns and textures. The proposed descriptor encodes all images’ pixels and the resulting RLOP-encoded image is divided into several regions. Histograms of the regions are constructed to estimate the distribution of features. Then, all histograms are concatenated together to form the final descriptor. The robustness and effectiveness of the proposed descriptor are evaluated through conducting several identification and verification experiments on four different ear databases: IIT Delhi-I, IIT Delhi-II, AMI, and AWE. It is observed that the proposed descriptor outperforms the state-of-the-art texture based approaches achieving a recognition rate of 98% on the average providing the best performance among the tested descriptors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Abaza A, Ross A, Hebert C, Harrison MAF, Nixon MS (2013) A survey on ear biometrics. ACM computing surveys 45(2):22

    Google Scholar 

  2. Al Rahhal MM, Mekhalfi ML, Ali TAM, Bazi Y, Al Zuair M, Rangarajan L (2018) Ear recognition via sparse coding of local features. Journal of Electronic Imaging 27(1):013007

    Google Scholar 

  3. Al Rahhal MM, Mekhalfi ML, Guermoui M, Othman E, Lei B, Mahmood A (2018) A dense phase descriptor for human ear recognition. IEEE Access 6:11883–11887

    Google Scholar 

  4. Alagarsamy SB, Murugan K (2019) Ear recognition system using adaptive approach Runge-Kutta (AARK) threshold segmentation with cart classifier. Multimedia Tools and Applications, 1–15

  5. Alshazly HA, Hassaballah M, Ahmed M, Ali AA (2018) Ear biometric recognition using gradient-based feature descriptors. In: International Conference on Advanced Intelligent Systems and Informatics. Springer, pp 435–445

  6. Awad AI (2016) Hassaballah M, Image feature detectors and descriptors: Foundations and applications. Springer

  7. Benzaoui A, Hadid A, Boukrouche A (2014) Ear biometric recognition using local texture descriptors. Journal of Electronic Imaging 23(5):053008

    Google Scholar 

  8. Cao K, Jain AK (2019) Automated latent fingerprint recognition. IEEE Trans Pattern Anal Mach Intell 41(4):788–800

    Google Scholar 

  9. Chakraborti T, McCane B, Mills S, Pal U (2018) LOOP descriptor: Local optimal oriented pattern. IEEE Signal Processing Letters 25(5):635–639

    Google Scholar 

  10. Chatterjee A, Singh P, Bhatia V, Prakash S (2019) Ear biometrics recognition using laser biospeckled fringe projection profilometry. Optics & Laser Technology 112:368–378

    Google Scholar 

  11. Chen J, Shan S, He C, Zhao G, Pietikainen M, Chen X, Gao W (2010) WLD: A robust local image descriptor. IEEE Trans Pattern Anal Mach Intell 32(9):1705–1720

    Google Scholar 

  12. Chowdhury DP, Bakshi S, Guo G, Sa PK (2018) On applicability of tunable filter bank based feature for ear biometrics: A study from constrained to unconstrained. J Med Syst 42(1):1–20

    Google Scholar 

  13. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Computer Vision and Pattern Recognition. IEEE, pp 886–893

  14. Damer N, Führer B (2012) Ear recognition using multi-scale histogram of oriented gradients. In: International Conference on Intelligent Information Hiding and Multimedia Signal Processing. IEEE, pp 21–24

  15. Das A, Pal U, Ferrer MA, Blumenstein M, Štepec D, Rot P, Emeršič V, Peer P, Štruc V, Kumar SA et al (2017) SSERBC 2017: Sclera segmentation and eye recognition benchmarking competition. In: IEEE International Joint Conference on Biometrics. IEEE, pp 742–747

  16. Dodge S, Mounsef J, Karam L (2018) Unconstrained ear recognition using deep neural networks. IET Biometrics 7(3):207–214

    Google Scholar 

  17. Doghmane H, Boukrouche A, Boubchir L (2019) A novel discriminant multiscale representation for ear recognition. International Journal of Biometrics 11 (1):50–66

    Google Scholar 

  18. Dubey SR, Mukherjee S (2020) LDOP: Local directional order pattern for robust face retrieval. Multimed Tools Appl 79:6363–6382

    Google Scholar 

  19. El Naggar S, Abaza A, Bourlai T (2016) On a taxonomy of ear features. In: IEEE Symposium on Technologies for Homeland Security. IEEE, pp 1–6

  20. Emersic Z, Meden B, Peer P, Struc V (2017) Covariate analysis of descriptor-based ear recognition techniques. In: International Conference and Workshop on Bioinspired Intelligence. IEEE, pp 1–9

  21. Emeršič ž, Meden B, Peer P, Štruc V (2019) Evaluation and analysis of ear recognition models: Performance, complexity and resource requirements. Neural Comput and Applic, 1–16

  22. Emeršič ž, Štruc V, Peer P (2017) Ear recognition: More than a survey. Neurocomputing 255:26–39

    Google Scholar 

  23. Fathi A, Naghsh-Nilchi AR (2012) Noise tolerant local binary pattern operator for efficient texture analysis. Pattern Recogn Lett 33(9):1093–1100

    Google Scholar 

  24. Galdámez P L, Raveane W, Arrieta AG (2017) A brief review of the ear recognition process using deep neural networks. J Appl Log 24:62–70

    MathSciNet  Google Scholar 

  25. Ghoualmi L, Draa A, Chikhi S (2016) An ear biometric system based on artificial bees and the scale invariant feature transform. Expert Syst Appl 57:49–61

    Google Scholar 

  26. Guei AC, Akhloufi MA (2018) Deep ear biometrics. In: Disruptive technologies in information sciences, international society for optics and photonics, vol 10652, p 106520Q

  27. Guo Y, Xu Z (2008) Ear recognition using a new local matching approach. In: IEEE International Conference on Image Processing. IEEE, pp 289–292

  28. Hansley EE, Segundo MP, Sarkar S (2018) Employing fusion of learned and handcrafted features for unconstrained ear recognition. IET Biometrics 7 (3):215–223

    Google Scholar 

  29. Hassaballah M, Aly S (2015) Face recognition: Challenges, achievements and future directions. IET Comput Vis 9(4):614–626

    Google Scholar 

  30. Hassaballah M, Awad AI (2016) Detection and description of image features: An introduction. In: Image feature detectors and descriptors: Foundations and applications. Springer, pp 1–8

  31. Hassaballah M, Hammam AA, Abdelmgeid AA (2019) Ear recognition using local binary patterns: A comparative experimental study. Expert Systems With Applications 118:182–200

    Google Scholar 

  32. Hassaballah M, Hosny KM (2019) Recent advances in computer vision: theories and applications. Springer

  33. Hezil N, Boukrouche A (2017) Multimodal biometric recognition using human ear and palmprint. IET Biometrics 6(5):351–359

    Google Scholar 

  34. Jabid T, Kabir MH, Chae O (2010) Robust facial expression recognition based on local directional pattern. ETRI J 32(5):784–794

    Google Scholar 

  35. Kumar A, Wu C (2012) Automated human identification using ear imaging. Pattern Recogn 45(3):956–968

    Google Scholar 

  36. Kyrki V, Kamarainen JK, Kälviäinen H (2004) Simple Gabor feature space for invariant object recognition. Pattern Recogn Lett 25(3):311–318

    Google Scholar 

  37. Larrain T, Bernhard JS, Mery D, Bowyer KW (2017) Face recognition using sparse fingerprint classification algorithm. IEEE Transactions on Information Forensics and Security 12(7):1646–1657

    Google Scholar 

  38. Liu L, Chen J, Fieguth P, Zhao G, Chellappa R, Pietikäinen M (2019) From BoW to CNN: Two decades of texture representation for texture classification. Int J Comput Vis 127(1):74–109

    Google Scholar 

  39. Liu L, Fieguth P, Guo Y, Wang X, Pietikäinen M (2017) Local binary features for texture classification: Taxonomy and experimental study. Pattern Recogn 62:135–160

    Google Scholar 

  40. Morales A, Ferrer MA, Diaz-Cabrera M, González E (2013)

  41. Nanni L, Ghidoni S, Brahnam S (2017) Handcrafted vs. non-handcrafted features for computer vision classification. Pattern Recogn 71:158–172

    Google Scholar 

  42. Nejati H, Zhang L, Sim T, Martinez-Marroquin E, Dong G (2012) Wonder ears: Identification of identical twins from ear images. In: International Conference on Pattern Recognition. IEEE, pp 1201–1204

  43. Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recogn 29(1):51–59

    Google Scholar 

  44. Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    MATH  Google Scholar 

  45. Ojansivu V, Rahtu E, Heikkila J (2008) Rotation invariant local phase quantization for blur insensitive texture analysis. In: International conference on pattern recognition. IEEE, pp 1–4

  46. Omara I, Hagag A, Zuo W (2018) Learning LogDet divergence for ear recognition. In: International Conference on Biometric Engineering and Applications. ACM, 69–73

  47. Omara I, Wu X, Zhang H, Du Y, Zuo W (2018) Learning pairwise SVM on hierarchical deep features for ear recognition. IET Biometrics 7 (6):557–566

    Google Scholar 

  48. Pan Z, Wu X, Li Z (2019) Central pixel selection strategy based on local gray-value distribution by using gradient information to enhance LBP for texture classification. Expert Syst Appl 120:319–334

    Google Scholar 

  49. Pflug A, Busch C (2012) Ear biometrics: A survey of detection, feature extraction and recognition methods. IET Biometrics 1(2):114–129

    Google Scholar 

  50. Pflug A, Busch C, Ross A (2014) 2D ear classification based on unsupervised clustering. In: IEEE International Joint Conference on Biometrics. IEEE, pp 1–8

  51. Pflug A, Paul PN, Busch C (2014) A comparative study on texture and surface descriptors for ear biometrics. In: International Carnahan Conference on Security Technology. IEEE, pp 1–6

  52. Pietikäinen M, Ojala T, Xu Z (2000) Rotation-invariant texture classification using feature distributions. Pattern Recogn 33(1):43–52

    Google Scholar 

  53. Rathgeb C, Pflug A, Wagner J, Busch C (2016) Effects of image compression on ear biometrics. IET Biometrics 5(3):252–261

    Google Scholar 

  54. Regouid M, Touahria M, Benouis M, Costen N (2019) Multimodal biometric system for ECG, ear and iris recognition based on local descriptors. Multimedia Tools and Applications, 1–27

  55. Sarangi PP, Mishra BSP, Dehuri S (2018) Fusion of PHOG and LDP local descriptors for kernel-based ear biometric recognition. Multimedia Tools and Applications, 1–29

  56. Sepas-Moghaddam A, Pereira F, Correia PL (2018) Ear recognition in a light field imaging framework: A new perspective. IET Biometrics 7(3):224–231

    Google Scholar 

  57. Tian L, Mu Z (2016) Ear recognition based on deep convolutional network. In: International congress on image and signal processing, biomedical engineering and informatics. IEEE, pp 437–441

  58. Unar J, Seng WC, Abbasi A (2014) A review of biometric technology along with trends and prospects. Pattern Recogn 47(8):2673–2688

    Google Scholar 

  59. Vu NS, Caplier A (2010) Face recognition with patterns of oriented edge magnitudes. In: European conference on computer vision. Springer, pp 313–326

  60. Wang Z, Yang J, Zhu Y (2019) Review of ear biometrics. Archives of Computational Methods in Engineering, 1–32

  61. Yan P, Bowyer KW (2007) Biometric recognition using 3D ear shape. IEEE Trans Pattern Anal Mach Intell 29(8):1297–1308

    Google Scholar 

  62. Youbi Z, Boubchir L, Boukrouche A (2018) Human ear recognition based on local multi-scale LBP features with city-block distance. Multimedia Tools and Applications, 1–17

  63. Yuan L, chun Mu Z (2012) Ear recognition based on local information fusion. Pattern Recogn Lett 33(2):182–190

    Google Scholar 

Download references

Acknowledgment

The authors would like to acknowledge the providers of all used datesets in the experiments of this paper (i.e., IIT Delhi-I, IIT Delhi-II, AMI, and AWE).

Author information

Authors and Affiliations

  1. Department of Computer Science, Faculty of Computers and Information, South Valley University, Qena, Egypt

    M. Hassaballah

  2. Department of Mathematics, Faculty of Science, South Valley University, Qena, 83523, Egypt

    H. A. Alshazly

  3. Department of Computer Science, Faculty of Science, Minia University, Al Minia, 61519, Egypt

    Abdelmgeid A. Ali

Authors
  1. M. Hassaballah
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. H. A. Alshazly
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abdelmgeid A. Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Hassaballah.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hassaballah, M., Alshazly, H.A. & Ali, A.A. Robust local oriented patterns for ear recognition. Multimed Tools Appl 79, 31183–31204 (2020). https://doi.org/10.1007/s11042-020-09456-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09456-7

Keywords

Search

Navigation