Abstract
Micro-expression recognition has been a challenging problem in computer vision research due to its briefness and subtlety. Previous psychological study shows that even human being can only recognize micro-expressions with low average recognition rates. In this paper, we propose an effective and efficient method to encode the micro-expressions for recognition. The proposed method, referred to as Delaunay-based temporal coding model (DTCM), encodes texture variations corresponding to muscle activities on face due to dynamical micro-expressions. Image sequences of micro-expressions are normalized not only temporally but also spatially based on Delaunay triangulation, so that the influence of personal appearance irrelevant to micro-expressions can be suppressed. Encoding temporal variations at local subregions and selecting spatial salient subregions in the face area escalates the capacity of our method to locate spatiotemporally important features related to the micro-expressions of interest. Extensive experiments on publicly available datasets, including SMIC, CASME, and CASME II, verified the effectiveness of the proposed model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Barber, C., Dobkin, D., Venue, H.: The quickhull algorithm for convex hulls. ACM Trans. Math. Softw. 22, 469–483 (1996)
Breiman, L.: Random forests. Mach. Learn. 45, 5–32 (2001)
Chu, W., Torre, F., Cohn, J.: Selective transfer machine for personalized facial action unit detection. In: International Conference on Computer Vision, pp. 3515–3522 (2013)
Cootes, T., Edwards, G., Taylor, C.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23, 681–685 (2001)
Ekman, P.: Facial expressions of emotion: an old controversy and new findings. Philos. Trans. R. Soc. Lond. Ser. B. Biol. Sci. 335, 63–69 (1992)
Fournier, A., Montuno, D.: Triangulating simple polygons and equivalent problems. ACM Trans. Graph. 3, 153–174 (1984)
Frank, M., Herbasz, M., Sinuk, K., Keller, A., Nolan, C.: I see how you feel: Training laypeople and professionals to recognize fleeting emotions. In: The Annual Meeting of the International Communication Association, pp. 3515–3522, New York (2013)
Gross, R., Matthews, I., Cohn, J., Kanade, T., Baker, S.: Multi-PIE. Image Vis. Comput. 28, 807–813 (2010)
Hamm, J., Verma, R., Kohler, C., Gur, R.: Automated facial action coding system for dynamic analysis of facial expressions in neuropsychiatric disorders. J. Neurosci. Methods 200, 237–256 (2011)
Koelstra, S., Pantic, M., Patras, I.: A dynamic texture-based approach to recognition of facial actions and their temporal models. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1940–1954 (2010)
Li, X., Pfister, T., Huang, X., Zhao, G., Pietikainen, M.: A spontaneous micro-expression database: Inducement, collection and baseline. In: IEEE Conference on Automatic Face and Gesture Recognition, pp. 1–6 (2013)
Mark, B., Cheong, O., Kreveld, M., Overmars, M.: Computational Geometry: Algorithms and Applications. Springer, Berlin (2008)
Park, S., Kim, D.: Spontaneous facial expression classification with facial motion vectors. In: IEEE Conference on Automatic Face and Gesture Recognition, pp. 1–6 (2008)
Pfister, T., Li, X., Zhao, G., Pietikainen, M.: Recognising spontaneous facial micro-expressions. In: International Conference on Computer Vision, pp. 1449–1456 (2011)
Platt, J.: Sequential minimal optimization: a fast algorithm for training support vector machines. Microsoft Research, MSR-TR-98-14, pp. 1–21 (1998)
Polikovsky, S., Kameda, Y., Ohta, Y.: Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor. In: International Conference on Distributed Platforms, pp. 1–6 (2009)
Shen, X.B., Wu, Q., Fu, X.L.: Effects of the duration of expressions on the recognition of microexpressions. J. Zhejiang Univ. Sci. B 13, 221–230 (2012)
Shreve, M., Godavarthy, S., Goldgof, D., Sarkar, S.: Macro-and micro-expression spotting in long videos using spatio-temporal strain. In: IEEE Conference on Automatic Face and Gesture Recognition, pp. 51–56 (2011)
Wang, S., Yan, W., Li, X., Zhao, G., Fu, X.: Micro-expression recognition using dynamic textures on tensor independent color space. In: International Conference on Pattern Recognition (2014)
Wang, Z., Wang, S., Ji, Q.: Capturing complex spatio-temporal relations among facial muscles for facial expression recognition. In: Conference on Computer Vision and Pattern Recognition, pp. 3422–3429 (2013)
Yan, W., Li, X., Wang, S., Zhao, G., Liu, Y., Chen, Y., Fu, X.: CASME II: an improved spontaneous micro-expression database and the baseline evaluation. PLoS ONE 9, 1–8 (2014)
Yan, W., Wu, Q., Liu, Y., Wang, S., Fu, X.: CASME database: a dataset of spontaneous micro-expressions collected from neutralized faces. In: IEEE Conference on Automatic Face and Gesture Recognition, pp. 1–7 (2013)
Zhao, G., Pietikainen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. Pattern Anal. Mach. Intell. 29, 915–928 (2007)
Acknowledgement
This work is supported by National Natural Science Foundation of China (No. 61172141), Key Projects in the National Science&Technology Pillar Program during the 12th Five-Year Plan Period (No. 2012BAK16B06), Science and Technology Program of Guangzhou, China (2014J4100092), and National Undergraduate Scientific and Technological Innovation Project of China.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Lu, Z., Luo, Z., Zheng, H., Chen, J., Li, W. (2015). A Delaunay-Based Temporal Coding Model for Micro-expression Recognition. In: Jawahar, C., Shan, S. (eds) Computer Vision - ACCV 2014 Workshops. ACCV 2014. Lecture Notes in Computer Science(), vol 9009. Springer, Cham. https://doi.org/10.1007/978-3-319-16631-5_51
Download citation
DOI: https://doi.org/10.1007/978-3-319-16631-5_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16630-8
Online ISBN: 978-3-319-16631-5
eBook Packages: Computer ScienceComputer Science (R0)