Skip to main content

Feature Fusion of Gradient Direction and LBP for Facial Expression Recognition

  • Conference paper
  • First Online:
Biometric Recognition (CCBR 2015)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9428))

Included in the following conference series:

Abstract

Feature extraction is an important step in facial expression recognition. A novel method is proposed based on feature fusion which combines gradient direction and LBP features. Firstly, eyes are located through the integration projection method. And the operation of image rotating, cropping and normalizing is conducted based on eyes’ position. Secondly, the image is partitioned into nine non-overlapping regions with different weight, then the gradient direction and LBP features are extracted and fused. The fused features generated from each of the regions are concatenated to form the feature vector which represents the facial expression. Finally, K-nearest neighbor algorithm is performed for classification. Experiments on JAFFE and Cohn-Kanade facial expression databases show that the proposed method achieves better performance for facial expression recognition.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Jabid, T., Kabir, M.H., Chae, O.: Robust facial expression recognition based on local directional pattern. ETRI Journal 32(5), 784–794 (2010)

    Article  Google Scholar 

  2. Wang, L., Li, R.F., Wang, K.: Multi-scale local binary pattern fourier histogram features for facial expression recognition. Journal of Computer Application 34(7), 2036–2039 (2014)

    Google Scholar 

  3. El-Hori, I.H., El-Momen, Z.K., Ganoun, A.: PCA facial expression recognition. In: Proceedings of Sixth International Conference on Machine Vision (ICMV 2013), International Society for Optics and Photonics, pp. 906712–906712–5 (2013)

    Google Scholar 

  4. Tang, F., Deng, B.: Facial expression recognition using AAM and local facial features. In: Proceedings of the Third IEEE International Conference on Natural Computation, Haikou, China, pp. 632–635 (2007)

    Google Scholar 

  5. Ahsan, T., Jabid, T., Chong, U.P.: Facial expression recognition using local transitional pattern on Gabor filtered facial images. IETE Technical Review 30(1), 47–52 (2013)

    Article  Google Scholar 

  6. Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recognition 29(1), 51–59 (1996)

    Article  Google Scholar 

  7. Liu, W., Wang, Y., Li, S.: LBP feature extraction for facial expression recognition. Journal of Information & Computational Science 8(3), 412–421 (2011)

    Google Scholar 

  8. Zhang, G., Huang, X., Li, S.Z., Wang, Y., Wu, X.: Boosting local binary pattern (LBP)-based face recognition. In: Li, S.Z., Lai, J.-H., Tan, T., Feng, G.-C., Wang, Y. (eds.) SINOBIOMETRICS 2004. LNCS, vol. 3338, pp. 179–186. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  9. Tan, X., Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Transactions on Image Processing 19(6), 1635–1650 (2010)

    Article  MathSciNet  Google Scholar 

  10. Guo, Z., Zhang, D.: A completed modeling of local binary pattern operator for texture classification. IEEE Transactions on Image Processing 19(6), 1657–1663 (2010)

    Article  MathSciNet  Google Scholar 

  11. Zhang, W., Shan, S., Gao, W.: Local gabor binary pattern histogram sequence (lgbphs): a novel non-statistical model for face representation and recognition. In: Proceedings of Tenth IEEE International Conference on Computer Vision-ICCV, vol. 1, pp.786–791 (2005)

    Google Scholar 

  12. Chen, J., Shan, S., He, C.: WLD: A robust local image descriptor. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(9), 1705–1720 (2010)

    Article  Google Scholar 

  13. Shan, C., Gong, S., McOwan, P.W.: Facial expression recognition based on local binary patterns: A comprehensive study. Image and Vision Computing 27(6), 803–816 (2009)

    Article  Google Scholar 

  14. Li, R., Zhao, X.: Fusing DCT and LBP features for expression recognition. Computer Engineering and Applications 49(15), 171–174 (2013)

    Article  Google Scholar 

  15. Zhang, Z., Fang, C., Ding, X.Q.: A hierarchical algorithm with multi-feature fusion for facial expression recognition. In: Proceedings of 21st International Conference on Pattern Recognition (ICPR 2012), pp. 2363–2366 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yu Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Li, Y., Zhang, L. (2015). Feature Fusion of Gradient Direction and LBP for Facial Expression Recognition. In: Yang, J., Yang, J., Sun, Z., Shan, S., Zheng, W., Feng, J. (eds) Biometric Recognition. CCBR 2015. Lecture Notes in Computer Science(), vol 9428. Springer, Cham. https://doi.org/10.1007/978-3-319-25417-3_50

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-25417-3_50

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-25416-6

  • Online ISBN: 978-3-319-25417-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics