Quanming Liu
ABSTRACT
Aiming at the problems of huge parameters and network degradation caused by simple linear stacked convolution layers or continuous full connection layers in traditional expression recognition methods, two convolution neural network models are designed through depth separation convolution and residual module respectively to widen and deepen the network. Firstly, model A adopts depth separation convolution instead of regular convolution layer, and the global average pooling layer replaces the final full connection layer, utilizes the methods of dropout, batch normalization, activation function of PReLU and image augmentation to avoid over-fitting effectively. Model B adopts pre-trained ResNet50 model to extract facial features, magnifies the images twice by the SRGAN method. Using ensemble method to fuse model A and B, the accuracy is further improved. To verify the feasibility of the method, the model was tested on the FER2013 facial expression dataset, and the performance was compared with the other facial expression recognition algorithms. The final results showed the improved convolutional neural network (CNN) reached the advanced precision of 73.244% in FER2013 dataset, and the experiment data and the number of model parameters all proved the effectiveness of this method.
- Mehrabian A. Communication without words. Psychology Today, 1968, 2(4):53--56Google Scholar
- Szegedy C, Liu W, Jia Y, et al. Going deeper with convolutions// Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ:IEEE Press, 2015:1--9.Google Scholar
- Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition// 3rd International Conference on Learning Representations (ICLR). Hilton San Diego: Computer Science, 2015:1150--1210.Google Scholar
- Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks //Proceedings of the 25th International Conference on Neural Information Processing Systems. New York: ACM Press, 2012, 1:1097--1105Google Scholar
- Szegedy C, Vanhoucke V, Ioffe S, et al. Rethinking the Inception Architecture for Computer Vision // Computer Vision and Pattern Recognition. IEEE, 2016:2818--2826.Google Scholar
- Chollet F. Xception: deep learning with depthwise separable convolutions //Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA:IEEE, 2017:1800--1807.Google Scholar
- He K, Zhang X, Ren S, et al. Deep Residual Learning for Image Recognition //IEEE International Conference on Computer Vision. 2015:770--778.Google Scholar
- Long M, Wang J, Cao Y, et al. Deep Learning of Transferable Representation for Scalable Domain Adaptation. IEEE Transactions on Knowledge & Data Engineering, 2016, 28(8):2027--2040.Google ScholarCross Ref
- Ledig C, Theis L, Huszar F, et al. Photo-realistic single image super-resolution using a generative adversarial network // CVPR 2017: Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE Computer Society, 2017:105--114.Google Scholar
- Goodfellow I, Erhan D, Carrier P L, et al. Challenges in representation learning: a report on three machine learning contests. Neural Network, 2015, 64(1):59--63.Google ScholarDigital Library
Index Terms
- Face expression recognition based on improved convolutional neural network
Recommendations
Application of Convolutional Neural Network for Facial Expression Recognition
ICRAI '20: Proceedings of the 6th International Conference on Robotics and Artificial IntelligenceThe recognition of people's expression has been a very difficult task for computers from the time of its invention and still continues to pose a lot of challenges to the modern day generation of computers. To solve this problem, Convolutional Neural ...
Facial Expression Recognition Using Convolutional Neural Network
ICVISP 2018: Proceedings of the 2nd International Conference on Vision, Image and Signal ProcessingFacial expressions are part of human language and are often used to convey emotions. With the development of human-computer interaction technology, people pay more and more attention to facial expression recognition (FER) technology. Besides, in the ...
Facial expression recognition with Convolutional Neural Networks
Facial expression recognition has been an active research area in the past 10 years, with growing application areas including avatar animation, neuromarketing and sociable robots. The recognition of facial expressions is not an easy problem for machine ...
Comments