Abstract
Automatic facial expression recognition system has broad applications prospect in the field of computer vision, and of which the precision of facial expression feature extraction is the crucial factor for improving recognition accuracy. Whereas the traditional Local Binary Pattern has the shortcomings of inaccurate feature description and large feature size, in this paper we propose a novel feature descriptor, namely local tri-directional coding pattern (LtriDCP), to overcome the above two flaws. First, we adopt Kirsch masks to compute convolution values of each pixel in 8 directions, which can accurately represent the texture information of facial expression compared with the coding scheme of LBP. Second, considering that the difference of facial expression is mainly characterized in the texture change of horizontal, vertical and diagonal directions in eye, mouth, forehead and other facial areas, we only encode three convolution values in the corresponding directions to reduce feature size but still retain superior performance. Experimental results on JAFFE database show that LtriDCP outperforms several state-of-the-art feature descriptors and demonstrate its effectiveness.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Eleftheriadis, S., Rudovic, O., Pantic, M.: Discriminative shared Gaussian processes for multiview and view-invariant facial expression recognition. IEEE Trans. Image Process. 24(1), 189–204 (2015)
Kaneko, K., Okada, Y.: Facial expression system using Japanese emotional linked data built from knowledge on the web. Int. J. Space Based Situat. Comput. 4(3/4), 165 (2014)
Huang, D., Shan, C., Ardabilian, M., et al.: Local binary patterns and its application to facial image analysis: a survey. IEEE Trans. Syst. Man Cybern. C: Appl. Rev. 41(6), 765–781 (2011)
Jia, S., Shen, L., Li, Q.: Gabor feature-based collaborative representation for hyperspectral imagery classification. IEEE Trans. Geosci. Remote Sens. 53(2), 1118–1129 (2015)
Kim, J., Yu, S., Kim, D., et al.: An adaptive local binary pattern for 3D hand tracking. Pattern Recogn. 61, 139–152 (2017)
Ryu, J., Hong, S., Yang, H.S.: Sorted consecutive local binary pattern for texture classification. IEEE Trans. Image Process. 24(7), 2254–2265 (2015)
Uchida, N., Okutake, T., Yamamoto, N.: Image recognitions of collaborative drones’ security controls for FPV systems. Int. J. Space Based Situat. Comput. 7(3), 129–135 (2017)
Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recogn. 29(1), 51–59 (1996)
Ojala, T., Pietikäinen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)
Kyperountas, M., Tefas, A., Pitas, I.: Salient feature and reliable classifier selection for facial expression classification. Pattern Recogn. 43, 972–986 (2010)
Ruan, J.: The Key Search of Multi-pose Face Detection and Facial Expression Recognition. South China University of Technology (2010)
Jabid, T., Kabir, M.H., Chae, O.: Robust facial expression recognition based on local directional pattern. ETRI J. 32(5), 784–794 (2010)
Heikkilä, M., Pietikäinen, M., Schmid, C.: Description of interest regions with center-symmetric local binary patterns. ICVGIP 6, 58–69 (2006)
Ahmed, F.: Gradient directional pattern: a robust feature descriptor for facial expression recognition. Electron. Lett. 48(19), 1203–1204 (2012)
Acknowledgements
This work is financially supported by NSFC Project (No. 61703201), NSF of Jiangsu Province (BK20170765), NIT fund for Young Scholar (CKJB201602), and Key Laboratory of meteorological detection and information processing in Jiangsu Province (KDXS1503).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Tong, Y., Chen, R., Yang, J., Wu, M. (2019). Robust Facial Expression Recognition Based on Local Tri-directional Coding Pattern. In: Barolli, L., Javaid, N., Ikeda, M., Takizawa, M. (eds) Complex, Intelligent, and Software Intensive Systems. CISIS 2018. Advances in Intelligent Systems and Computing, vol 772. Springer, Cham. https://doi.org/10.1007/978-3-319-93659-8_55
Download citation
DOI: https://doi.org/10.1007/978-3-319-93659-8_55
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-93658-1
Online ISBN: 978-3-319-93659-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)