Skip to main content

Robust Facial Expression Recognition Based on Local Tri-directional Coding Pattern

  • Conference paper
  • First Online:
Complex, Intelligent, and Software Intensive Systems (CISIS 2018)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 772))

Included in the following conference series:

Abstract

Automatic facial expression recognition system has broad applications prospect in the field of computer vision, and of which the precision of facial expression feature extraction is the crucial factor for improving recognition accuracy. Whereas the traditional Local Binary Pattern has the shortcomings of inaccurate feature description and large feature size, in this paper we propose a novel feature descriptor, namely local tri-directional coding pattern (LtriDCP), to overcome the above two flaws. First, we adopt Kirsch masks to compute convolution values of each pixel in 8 directions, which can accurately represent the texture information of facial expression compared with the coding scheme of LBP. Second, considering that the difference of facial expression is mainly characterized in the texture change of horizontal, vertical and diagonal directions in eye, mouth, forehead and other facial areas, we only encode three convolution values in the corresponding directions to reduce feature size but still retain superior performance. Experimental results on JAFFE database show that LtriDCP outperforms several state-of-the-art feature descriptors and demonstrate its effectiveness.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Eleftheriadis, S., Rudovic, O., Pantic, M.: Discriminative shared Gaussian processes for multiview and view-invariant facial expression recognition. IEEE Trans. Image Process. 24(1), 189–204 (2015)

    Article  MathSciNet  Google Scholar 

  2. Kaneko, K., Okada, Y.: Facial expression system using Japanese emotional linked data built from knowledge on the web. Int. J. Space Based Situat. Comput. 4(3/4), 165 (2014)

    Article  Google Scholar 

  3. Huang, D., Shan, C., Ardabilian, M., et al.: Local binary patterns and its application to facial image analysis: a survey. IEEE Trans. Syst. Man Cybern. C: Appl. Rev. 41(6), 765–781 (2011)

    Article  Google Scholar 

  4. Jia, S., Shen, L., Li, Q.: Gabor feature-based collaborative representation for hyperspectral imagery classification. IEEE Trans. Geosci. Remote Sens. 53(2), 1118–1129 (2015)

    Article  Google Scholar 

  5. Kim, J., Yu, S., Kim, D., et al.: An adaptive local binary pattern for 3D hand tracking. Pattern Recogn. 61, 139–152 (2017)

    Article  Google Scholar 

  6. Ryu, J., Hong, S., Yang, H.S.: Sorted consecutive local binary pattern for texture classification. IEEE Trans. Image Process. 24(7), 2254–2265 (2015)

    Article  MathSciNet  Google Scholar 

  7. Uchida, N., Okutake, T., Yamamoto, N.: Image recognitions of collaborative drones’ security controls for FPV systems. Int. J. Space Based Situat. Comput. 7(3), 129–135 (2017)

    Article  Google Scholar 

  8. Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recogn. 29(1), 51–59 (1996)

    Article  Google Scholar 

  9. Ojala, T., Pietikäinen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)

    Article  Google Scholar 

  10. Kyperountas, M., Tefas, A., Pitas, I.: Salient feature and reliable classifier selection for facial expression classification. Pattern Recogn. 43, 972–986 (2010)

    Article  Google Scholar 

  11. Ruan, J.: The Key Search of Multi-pose Face Detection and Facial Expression Recognition. South China University of Technology (2010)

    Google Scholar 

  12. Jabid, T., Kabir, M.H., Chae, O.: Robust facial expression recognition based on local directional pattern. ETRI J. 32(5), 784–794 (2010)

    Article  Google Scholar 

  13. Heikkilä, M., Pietikäinen, M., Schmid, C.: Description of interest regions with center-symmetric local binary patterns. ICVGIP 6, 58–69 (2006)

    MATH  Google Scholar 

  14. Ahmed, F.: Gradient directional pattern: a robust feature descriptor for facial expression recognition. Electron. Lett. 48(19), 1203–1204 (2012)

    Article  Google Scholar 

Download references

Acknowledgements

This work is financially supported by NSFC Project (No. 61703201), NSF of Jiangsu Province (BK20170765), NIT fund for Young Scholar (CKJB201602), and Key Laboratory of meteorological detection and information processing in Jiangsu Province (KDXS1503).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Minghu Wu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tong, Y., Chen, R., Yang, J., Wu, M. (2019). Robust Facial Expression Recognition Based on Local Tri-directional Coding Pattern. In: Barolli, L., Javaid, N., Ikeda, M., Takizawa, M. (eds) Complex, Intelligent, and Software Intensive Systems. CISIS 2018. Advances in Intelligent Systems and Computing, vol 772. Springer, Cham. https://doi.org/10.1007/978-3-319-93659-8_55

Download citation

Publish with us

Policies and ethics