Vladimir Khryashchev
ABSTRACT
The aim of this investigation is to classify real-life facial images into one of six types of emotions. For solving this problem, we propose to use deep machine learning algorithms and convolutional neural network (CNN). CNN is a modern type of neural network, which allows for rapid detection of various objects, as well as to make an effective object classification. For acceleration of CNN learning stage, we use supercomputer NVIDIA DGX-1. This process was implemented in parallel on a large number of independent streams on GPU. Numerical experiments for algorithms were performed on the images of Multi-Pie image database with various lighting of scene and angle rotation of head. For developed models, several metrics of quality were calculated. The designing algorithm was used in real-time video processing in human-computer interaction systems. Moreover, expression recognition can apply in such fields as retail analysis, security, video games, animations, psychiatry, automobile safety, educational software, etc.
- Ekman P. and Friesen W.V. 1977. Manual for the Facial Action Coding System, Consulting Psychologists Press.Google Scholar
- Bettadapura V. 2012. Face Expression Recognition and Analysis: The State of the Art, Tech Report, arXiv: 1203.6722.Google Scholar
- Emotion Recognition in the Wild Challenge. https://sites.google.com/site/emotiwchallenge/Google Scholar
- Challenges in Representation Learning: Facial Expression Recognition Challenge.https://www.kaggle.com/c/challenges-in-representation-learning-facial-expression-recognition-challenge/Google Scholar
- Berns K., Hirth J. 2006. Control of Facial expressions of the humanoid robot head roman. In: IEEE International Conference on Intelligent Robots and Systems, pp. 3119--3124.Google ScholarCross Ref
- Bartlett M.S., Littlewort G., Fasel I., Movellan J.R. 2003. Real time face detection and facial expression recognition: development and applications to human computer interaction. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 53.Google ScholarCross Ref
- Ucar A. 2017. Deep Convolutional Neural Networks for facial expression recognition. INnovations in Intelligent SysTems and Applications (INISTA), IEEE International Conference on, pp. 371--375.Google Scholar
- Niu Z., Zhou M., Wang L., Gao X., Hua G. 2016. Ordinal Regression with Multiple Output CNN for Age Estimation. IEEE Conference on Computer Vision and Pattern Recognition, pp. 4920--4928.Google Scholar
- Paisitkriangkrai S., Sherrah J., Janney P., Van-Den Hengel A. 2015. Effective Semantic Pixel labeling with Convolutional Networks and Conditional Random Fields. IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 36--43.Google Scholar
- Raghuvanshi A., Choksi V. 2017. Facial Expression Recognition with Convolutional Neural Networks, Tech Report.Google Scholar
- Khalajzadeh H., Mansouri M., Teshnehlab M. 2013. Face Recognition using Convolutional Neural Network and Simple Logistic Classifier, In: Soft Computing in Industrial Applications. Advances in Intelligent Systems and Computing, vol. 223. Springer, Cham, pp. 197--207.Google Scholar
- Wen Z., Huang T. 2003. Capturing subtle facial motions in 3d face tracking. Proceedings of the 9th IEEE International Conference on Computer Vision, pp. 1343--1350. Google ScholarDigital Library
- Alizadeh S., Fazel A. 2017. Convolutional Neural Networks for Facial Expression Recognition. arXiv: 1704.06756.Google Scholar
- Yu Z. and Zhang C. 2015. Image based static facial expression recognition with multiple deep network learning. Proceedings of the 2015 ACM International Conference Multimodal Interaction, pp. 435--442. Google ScholarDigital Library
- Bo-Kyeong Kim S.-Y.D., Roh J. and Lee S.-Y. 2015. Hierarchical committee of deep convolutional neural networks for robust facial expression recognition. Journal on Multimodal User Interfaces, vol. 10, pp. 173--189.Google Scholar
- Ali Mollahosseini D.C. and Mahoor M.H. 2016. Going deeper in facial expression recognition using deep neural networks. IEEE Winter Conference on Applications of Computer Vision, pp. 1--10.Google Scholar
- The Binghamton University 3D Facial Expression (BU-3DFE) Database. http://www.cs.binghamton.edu/~lijun/Research/3DFE.Google Scholar
- The Multimedia Understanding Group (MUG) Facial Expression Database. https://mug.ee.auth.gr/fed.Google Scholar
- The CMU Multi-PIE Face Database. http://www.cs.cmu.edu/afs/cs/project/PIE/MultiPie/Multi-Pie/Home.html.Google Scholar
- Ivanovsky L., Khryashchev V., Lebedev A., Kosterin I. 2017. Facial Expression Recognition Algorithm Based on Deep Convolution Neural Network. In Proceedings of the 21th Conference of Open Innovations Association FRUCT'21. Helsinki, Finland. Google ScholarDigital Library
Index Terms
- Deep Learning for Real-Time Robust Facial Expression Analysis
Recommendations
A Real-time Facial Expression Recognizer using Deep Neural Network
IMCOM '16: Proceedings of the 10th International Conference on Ubiquitous Information Management and CommunicationWith increasing boundaries of deep learning based recognition model, particular demands for real-time user state recognizer targeting smart home devices have emerged. This paper suggests real-time facial expression recognizer to satisfy them. We use HOG ...
Recognizing Action Units for Facial Expression Analysis
Most automatic expression analysis systems attempt to recognize a small set of prototypic expressions, such as happiness, anger, surprise, and fear. Such prototypic expressions, however, occur rather infrequently. Human emotions and intentions are more ...
Facial expression recognition based on deep learning
Highlights- Autonomous driving, virtual reality and all kinds of robots integrated into our life rely on facial expression recognition technology.
Abstract Background and objectiveFacial expression recognition technology will play an increasingly important role in our daily life. Autonomous driving, virtual reality and all kinds of robots integrated into our life depend on the ...
Comments