Skip to main content
SpringerLink
Log in

Discriminative local binary pattern

  • Special Issue Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Local binary pattern (LBP) is widely used to extract image features as well as motion features in various visual recognition tasks. LBP is formulated in quite a simple form and thus enables us to extract effective features with a low computational cost. There, however, are some limitations mainly regarding sensitivity to noise and loss of image contrast information. In this paper, we propose a novel LBP-based feature extraction method to remedy those drawbacks without degrading the simplicity of the original LBP formulation. LBP is built upon encoding local pixel intensities into binary patterns which can be regarded as separating them into two modes (clusters). We introduce Fisher discriminant criterion to optimize the LBP coding for exploiting binary patterns more stably and discriminatively with robustness to noise. Besides, image contrast information is incorporated in a unified way by leveraging the discriminant score as a weight on the binary pattern; therefore, the prominent patterns, such as around edges, are emphasized. The proposed method is applicable to extract not only image features but also motion features by both efficiently decomposing a XYT volume patch into 2-D patches and employing the effective thresholding strategy based on the volume patch. In the experiments on various visual recognition tasks, the proposed method exhibits superior performance compared to the ordinary LBP and the other methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. 58 patterns for \(N=8\) consist of 1 flat pattern for zero 0/1 transition, 56 moderate patterns for less than or equal to twice transitions and 1 messy pattern for greater than twice transitions. In \(N=9\), we consider 1 flat and 1 messy patterns no matter what the center pixel is, and \(112=56\times 2\) moderate patterns according to the center pixel state.

References

  1. Ahonen, T., Hadid, A., Pietikäinen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)

    Article  MATH  Google Scholar 

  2. Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, New York (2007)

    MATH  Google Scholar 

  3. Chan, C.H., Goswami, B., Kittler, J., Christmas, W.: Local ordinal contrast pattern histograms for spatiotemporal, lip-based speaker authentication. IEEE Trans. Inf. Forensics Secur. 7(2), 602–612 (2012)

    Article  Google Scholar 

  4. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. IEEE Conf. Comput. Vis. Pattern Recognit. 1, 886–893 (2005)

    Google Scholar 

  5. Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley, Hoboken (2001)

    MATH  Google Scholar 

  6. Fan, R.E., Chang, K.W., Hsieh, C.J., Wang, X.R., Lin, C.J.: Liblinear: a library for large linear classification. J. Mach. Learn. Res. 9, 1871–1874 (2008)

    MATH  Google Scholar 

  7. Guo, Z., Zhang, L., Zhang, D.: Rotation invariant texture classification using lbp variance (LBPV) with global matching. Pattern Recognit. 43(3), 706–719 (2010)

    Article  MATH  Google Scholar 

  8. Hafiane, A., Seetharaman, G., Zavidovique, B.: Median binary pattern for texture classification. In: International Conference on Image Analysis and Recognition, pp. 387–398 (2007)

  9. Jin, H., Liu, Q., Lu, H., Tong, X.: Face detection using improved lbp under bayesian framework. In: International Conference on Image and Graphics, pp. 306–309 (2004)

  10. Kläser, A., Marszałek, M., Schmid, C.: A spatio-temporal descriptor based on 3D-gradients. In: British Machine Vision Conference, pp. 995–1004 (2008)

  11. Kobayashi, T.: Higher-order co-occurrence features based on discriminative co-clusters for image classification. In: British Machine Vision Conference, pp. 64.1–64.11 (2012)

  12. Kobayashi, T.: Discriminative local binary pattern for image feature extraction. In: International Conference on Computer Analysis of Images and Patterns, pp. 594–605 (2015)

  13. Kobayashi, T.: Three viewpoints toward exemplar SVM. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2765–2773 (2015)

  14. Kobayashi, T., Otsu, N.: Image feature extraction using gradient local auto-correlations. In: European Conference on Computer Vision, pp. 346–358 (2008)

  15. Kobayashi, T., Otsu, N.: Motion recognition using local auto-correlation of space-time gradients. Pattern Recognit. Lett. 33(9), 1188–1195 (2012)

    Article  Google Scholar 

  16. Kobayashi, T., Ye, J.: Acoustic feature extraction by statistics based local binary pattern for environmental sound classification. In: International Conference on Acoustic, Speech and Signal Processing, pp. 3076–3080 (2014)

  17. Kuehne, H., Jhuang, H., Garrote, E., Poggio, T., Serre, T.: HMDB: a large video database for human motion recognition. In: International Conference on Computer Vision, pp. 2556–2563 (2011)

  18. Lei, Z., Li, S.Z., Chu, R., Zhu, X.: Face recognition with local gabor textons. In: International Conference on Biometrics, pp. 49–57 (2007)

  19. Lowe, D.: Distinctive image features from scale invariant features. Int. J. Comput. Vis. 60, 91–110 (2004)

    Article  Google Scholar 

  20. Maji, S., Berg, A.: Max-margin additive classifiers for detection. In: International Conference on Computer Vision, pp. 40–47 (2009)

  21. Malisiewicz, T., Gupta, A., Efros, A.: Ensemble of exemplar-svms for object detection and beyond. In: International Conference on Computer Vision, pp. 89–96 (2011)

  22. Mattivi, R., Shao, L.: Human action recognition ising LBP-TOP as sparse spatio-temporal feature descriptor. In: International Conference on Computer Analysis of Images and Patterns, pp. 740–747 (2009)

  23. Munder, S., Gavrila, D.M.: An experimental study on pedestrian classification. IEEE Trans. Pattern Anal. Mach. Intell. 28(11), 1863–1868 (2006)

    Article  Google Scholar 

  24. Nanni, L., Brahnam, S., Lumini, A.: Local ternary patterns from three orthogonal planes for human action classification. Expert Syst. Appl. 38(5), 5125–5128 (2011)

    Article  Google Scholar 

  25. Nanni, L., Lumini, A., Brahnam, S.: Local binary patterns variants as texture descriptors for medical image analysis. Artif. Intell. Med. 49(2), 117–125 (2010)

    Article  Google Scholar 

  26. Ojala, T., Pietikäinen, M., Harwood, D.: Performance evaluation of texture measures with classification based on kullback discrimination of distributions. In: International Conference on Pattern Recognition, pp. 582–585 (1994)

  27. Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on feature distributions. Pattern Recognit. 29(1), 51–59 (1998)

    Article  Google Scholar 

  28. Ojala, T., Pietikäinen, M., Mäenpää, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)

    Article  MATH  Google Scholar 

  29. Otsu, N.: Discriminant and least squares threshold selection. In: International Conference on Pattern Recognition, pp. 592–596 (1978)

  30. Phillips, P., Wechsler, H., Huang, J., Rauss, P.: The feret database and evaluation procedure for face recognition algorithms. Image Vis. Comput. 16(10), 295–306 (1998)

    Article  Google Scholar 

  31. Pietikäinen, M., Zhao, G., Hadid, A., Ahonen, T.: Computer Vision Using Local Binary Pattern. Springer, New York (2011)

    Book  Google Scholar 

  32. Sánchez, J., Perronnin, F., Mensink, T., Verbeek, J.: Image classification with the fisher vector: theory and practice. Int. J. Comput. Vis. 105(3), 222–245 (2013)

    Article  MATH  MathSciNet  Google Scholar 

  33. Scovanner, P., Ali, S., Shah, M.: A 3-dimensional sift descriptor and its application to action recognition. In: ACM Conference on Multimedia, pp. 357–360 (2007)

  34. Tan, X., Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans. Image Process. 19(6), 1635–1650 (2010)

    Article  MathSciNet  Google Scholar 

  35. Vedaldi, A., Zisserman, A.: Efficient additive kernels via explicit feature maps. In: IEEE Conference on Computer Vision and Pattern Recognition (2010)

  36. Wang, H., Kläser, A., Schmid, C., Liu, C.L.: Dense trajectories and motion boundary descriptors for action recognition. Int. J. Comput. Vision 103, 60–79 (2013)

    Article  MathSciNet  Google Scholar 

  37. Wang, X., Han, T.X., Yan, S.: An HOG-LBP human detector with partial occlusion handling. In: International Conference on Computer Vision, pp. 32–39 (2009)

  38. Wu, J., Rehg, J.M.: Centrist: a visual descriptor for scene categorization. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1489–1501 (2011)

    Article  Google Scholar 

  39. Xie, S., Shan, S., Chen, X., Meng, X., Gao, W.: Learned local gabor patterns for face representation and recognition. Sig. Process. 89(12), 2333–2344 (2009)

    Article  MATH  Google Scholar 

  40. Zabih, R., Woodfill, J.: Non-parametric local transforms for computing visual correspondence. In: European Conference on Computer Vision, pp. 151–158 (1994)

  41. Zhang, W., Shan, S., Gao, W., Zhang, H.: Local gabor binary pattern histogram sequence (lgbphs): a novel non-statistical model for face representation and recognition. In: International Conference on Computer Vision, pp. 786–791 (2005)

  42. Zhao, G., Ahonen, T., Matas, J., Pietikäinen, M.: Rotation-invariant image and video description with local binary pattern features. IEEE Trans. Image Process. 21(4), 1465–1477 (2012)

    Article  MathSciNet  Google Scholar 

  43. Zhao, G., Pietikäinen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 915–928 (2007)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National Institute of Advanced Industrial Science and Technology, 1-1-1 Umezono, Tsukuba, Japan

    Takumi Kobayashi

Authors
  1. Takumi Kobayashi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Takumi Kobayashi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kobayashi, T. Discriminative local binary pattern. Machine Vision and Applications 27, 1175–1186 (2016). https://doi.org/10.1007/s00138-016-0780-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-016-0780-8

Keywords

Search

Navigation