Abstract
In this paper, we construct facial expression benchmark data of 100 persons using Kinect face tracking application and study the stability of the benchmark data in terms of clustering. Kinect with its Software Development Kit applications has enabled low-cost constructions of various benchmark data on humans. We devised multi-lingual instruction sheets on 25 expressions, collected data from 115 persons, and carefully inspected and labeled the outcome to construct the data. The benchmark data consist of 263,106 instances, each of which includes 6 animation units, 11 shape units, and an image file all provided by the application. Out of the 263,106 instances, we labeled 62,500 of them as 1 of the 25 expressions and investigated their clustering stabilities to the 17 features. We show that the most frequently used clustering algorithm: k-means achieves the average normal mutual information about 0.92 as an evidence of the stability of our facial expression data.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Sebe, N., Lew, M., Sun, Y., Cohen, I., Geners, T., Huang, T.: Authentic Facial Expression Analysis. In: Image and Vision Computing, vol. 25, pp. 1856–1863. Elsevier (2007)
Aarts, E., Encarnacao, J.: Into Ambient Intelligence. In: True Vision - The Emergence of Ambient Intelligence, pp. 1–16. Springer (2006)
Hossny, M., Filippidis, D., Abdelrahman, W., Zho, H., Fielding, M., Mullins, J., Wei, L., Creighton, D., Puri, V., Nahavandi, S.: Low Cost Multimodal Facial Recognition via Kinect Sensors. Technical report, Centre for Intelligent Systems Research (CISR), Deakin University, Australia (2013)
Lyons, M.J., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding Facial Expressions with Gabor Wavelets. In: Proc. Third International Conference on Face and Gesture Recognition (FG), pp. 200–205 (1998)
Valstar, M.F., Jiang, B., Mehu, M., Pantic, M., Schrer, K.: The First Facial Expression Recognition and Analysis Challenge. In: Proc. International Conference on Face and Gesture Recognition (FG), pp. 921–926 (2011)
Verma, A., Sharma, L.K.: A Comprehensive Survey on Human Facial Expression Detection. Int’l J. Image Processing 7(2), 171–182 (2013)
Yong, C.Y., Sudirman, R., Chew, K.M.: Facial Expression Monitoring System Using PCA-Bayes Classifier. In: Future Computer Sciences and Application (ICFCSA), pp. 187–191 (2011)
Yu, L.: Constructing Facial Expressions Data Measured with Kinect for Human Monitoring. Master’s thesis, Graduate School of Systems Life Sciences, Kyushu University, Japan (2014)
Kanade, T., Cohn, J., Tian, Y.: Comprehensive Database for Facial Expression Analysis. In: Proc. Fourth IEEE International Conference on Automatic Face and Gesture Recognition (FG), pp. 46–53 (2000)
MacQueen, J.: Some Methods for Classification and Analysis of Multivariate Observations. In: Proc. Fifth Berkeley Symp. on Math. Statist. and Prob., vol. 1, pp. 281–297 (1967)
Ekman, P., Friesen, W.V.: Facial Action Coding System: Investigator’s Guide. Consulting Psychologists Press, Palo Altom (1978)
Microsoft: Face Tracking http://msdn.microsoft.com/en-us/library/jj130970.aspx (cited October 2013)
Lee, A.: 25 Essential Expressions Challenge, http://karmajello.com/culture/art/illustrated-facial-expressions-gallery.html (cited October 2013)
RikoJasmine: 25 Essential Expressions Challenge, http://rikojasmine.deviantart.com/art/25-Essential-Expressions-124330040 (cited October 2013)
Han, J., Kamber, M.: 7. In: Data Mining: Concepts and Techniques, 2nd edn., pp. 383–460. Morgan Kauffman, San Fransisco (2006)
Jack, R.E.: Culture and Facial Expressions of Emotions. Visual Cognition 21(9-10), 1248–1286 (2013)
Rubinstein, Y.D., Hastie, T.: Discriminative vs Informative Learning. In: Proc. KDD, pp. 49–53 (1997)
Zhou, H., Miller, P., Zhang, J.: Age classification using radon transform and entropy based scaling SVM. In: Proc. 22nd British Machine Vision Conference (BMVC 2011) (2011)
Suzuki, E., Deguchi, Y., Takayama, D., Takano, S., Scuturici, V.-M., Petit, J.-M.: Towards Facilitating the Development of a Monitoring System with Autonomous Mobile Robots. In: Information Search, Integration and Personalization. Springer (accepted for publication)
Ahlberg, J.: Candide-3 An Updated Parameterised Face. Technical report, Linkoping University (January 2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Erna, A., Yu, L., Zhao, K., Chen, W., Suzuki, E. (2014). Facial Expression Data Constructed with Kinect and Their Clustering Stability. In: Ślȩzak, D., Schaefer, G., Vuong, S.T., Kim, YS. (eds) Active Media Technology. AMT 2014. Lecture Notes in Computer Science, vol 8610. Springer, Cham. https://doi.org/10.1007/978-3-319-09912-5_35
Download citation
DOI: https://doi.org/10.1007/978-3-319-09912-5_35
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-09911-8
Online ISBN: 978-3-319-09912-5
eBook Packages: Computer ScienceComputer Science (R0)