Xinli Yang
ABSTRACT
When a complex scene such as rotation within a plane is encountered, the recognition rate of facial expressions will decrease much. A facial expression recognition algorithm based on CNN and LBP feature fusion is proposed in this paper. Firstly, according to the problem of the lack of feature expression ability of CNN in the process of expression recognition, a CNN model was designed. The model is composed of structural units that have two successive convolutional layers followed by a pool layer, which can improve the expressive ability of CNN. Then, the designed CNN model was used to extract the facial expression features, and local binary pattern (LBP) features with rotation invariance were fused. To a certain extent, it makes up for the lack of CNN sensitivity to in-plane rotation changes. The experimental results show that the proposed method improves the expression recognition rate under the condition of plane rotation to a certain extent and has better robustness.
- Li W, Li M, Su Z, et al. A deep-learning approach to facial expression recognition with candid images{C}// Iapr International Conference on Machine Vision Applications. IEEE, 2015:279--282.Google Scholar
- Alam M A. Facial Expressions Recognition from Complex Background using Face Context and Adaptively Weighted sub-Pattern PCA{J}. International Journal of Computer & Information Sciences, 2012, 6:52--57.Google Scholar
- Qian Y, Ren F, Quan C. A new preprocessing algorithm and local binary pattern based facial expression recognition{C}// Ieee/sice International Symposium on System Integration. IEEE, 2013:239--244.Google Scholar
- Jun He, Jianfeng Cai, Lingzhi Fang, et al. Facial expression recognition based on LBP/VAR and DBN model {J}. computer application research, 2016, 33 (8): 2509--2513.Google Scholar
- Lavin A, Gray S. Fast Algorithms for Convolutional Neural Networks{J}. Computer Science, 2015.Google Scholar
- Kim B K, Roh J, Dong S Y, et al. Hierarchical committee of deep convolutional neural networks for robust facial expression recognition{J}. Journal on Multimodal User Interfaces, 2016, 10(2):173--189.Google ScholarCross Ref
- Xiao Sun, Ting Pan, Fu Ji Ren. Facial expression recognition based on ROI-KNN convolutional neural network {J}. Journal of automation, 2016, 42 (6): 883--891.Google Scholar
- Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. Proc. IEEE, 1998.Google Scholar
- Yu Z, Zhang C. Image based Static Facial Expression Recognition with Multiple Deep Network Learning{C}// ACM on International Conference on Multimodal Interaction. ACM, 2015:435--442. Google ScholarDigital Library
- Ojala T, Pietikainen M, Maenpaa T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns{J}. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2002, 24(7):971--987. Google ScholarDigital Library
- Mollahosseini A, Chan D, Mahoor M H. Going deeper in facial expression recognition using deep neural networks{J}. Computer Science, 2015:1--10.Google Scholar
Index Terms
- Facial Expression Recognition Algorithm Based on CNN and LBP Feature Fusion
Recommendations
Expression recognition methods based on feature fusion
BI'10: Proceedings of the 2010 international conference on Brain informaticsExpression recognition is popular research focus in Artificial Intelligence and Pattern Recognition. Feature fusion is one of the most important technical methods in expression recognition. To study how the feature information extracted from different ...
2D facial expression recognition via 3D reconstruction and feature fusion
This paper proposed a method for facial expression recognition.In proposed method, facial depth has been added to facial texture for feature extraction.We demonstrated that adding the facial depth to feature extraction is effective.The 3DH-LLBP is ...
Improving Deep Learning Feature with Facial Texture Feature for Face Recognition
Face recognition in the reality, is a challenging problem, due to varieties in illumination, background, pose etc. Recently, the deep learning based face recognition algorithm is able to learn effective face features to obtain a very impressive ...
Comments