Skip to main content
SpringerLink
Log in

Effective curvelet-based facial expression recognition using graph signal processing

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Features in the facial images are multi-dimensional. Different facial expressions-based images are actually the interplay of the edges, which are found on faces. The wavelet transform which has been extensively used as a tool for mathematical analysis of the facial images has the disadvantage of poor directionality. Thus, curvelet transform is preferred for the facial image analysis due to better representation of edges by the directional elements. However, its feature dimension is of large size which makes the curvelet approach computationally expensive. In order to capture the interrelationship in the curvelet transform-based features at the higher level to construct new feature vectors, the proposed work suggests the use of graph signal processing along with the curvelet transform for recognizing the facial expressions. Not only the dimension of the feature vectors has been reduced but also recognition of the facial expression has been significantly improved. Experiments for Japanese female facial expression database and Cohn–Kanade (CK+) database show the effectiveness of the proposed approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Mandal, M.K., Pandey, R., Prasad, A.B.: Facial expressions of emotions and schizophrenia: a review. Schizophr. Bull. 24(3), 399 (1998)

    Article  Google Scholar 

  2. Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001)

    Article  Google Scholar 

  3. Tzimiropoulos, G., Argyriou, V., Zafeiriou, S., Stathaki, T.: Robust FFT-based scale-invariant image registration with image gradients. IEEE Trans. Pattern Anal. Mach. Intell. 32(10), 1899–1906 (2010)

    Article  Google Scholar 

  4. Baker, S., Matthews, I.: Lucas-kanade 20 years on: a unifying framework. Int. J. Comput. Vision 56(3), 221–255 (2004)

    Article  Google Scholar 

  5. Sariyanidi, E., Gunes, H., Cavallaro, A.: Automatic analysis of facial affect: a survey of registration, representation, and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(6), 1113–1133 (2015)

    Article  Google Scholar 

  6. Pinto, N., Cox, D.D., DiCarlo, J.J.: Why is real-world visual object recognition hard? PLoS Comput. Biol. 4(1), e27 (2008)

    Article  MathSciNet  Google Scholar 

  7. Dalal, Navneet, Triggs, Bill: Histograms of oriented gradients for human detection. In: International Conference on Computer Vision & Pattern Recognition (CVPR’05), Vol. 1, pp. 886–893. IEEE Computer Society (2005)

  8. Tong, Y., Chen, J., Ji, Q.: A unified probabilistic framework for spontaneous facial action modeling and understanding. IEEE Trans. Pattern Anal. Mach. Intell. 32(2), 258–273 (2010)

    Article  Google Scholar 

  9. Lecun, Y.: Generalization and network design strategies. In: Connectionism in Perspective, pp 143–155 (1989)

  10. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)

  11. Yu, Z., Zhang, C.: Image based static facial expression recognition with multiple deep network learning. In: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, pp 435–442 (2015)

  12. Shan, K., Guo, J., You, W., Lu, D., Bie, R.: Automatic facial expression recognition based on a deep convolutional-neural-network structure. In: 2017 IEEE 15th International Conference on Software Engineering Research, Management and Applications (SERA), pp 123–128 (2017)

  13. Do, M.N., Vetterli, M.: The finite ridgelet transform for image representation. Trans. Image Process. 12(1), 16–28 (2003)

    Article  MathSciNet  Google Scholar 

  14. Starck, J.-L., Candès, E.J., Donoho, D.L.: The curvelet transform for image denoising. IEEE Trans. Image Process. 11(6), 670–684 (2002)

    Article  MathSciNet  Google Scholar 

  15. Manikandan, M., Saravanan, A., Bagan, K.B.: Curvelet transform based embedded lossy image compression. In: 2007 International Conference on Signal Processing, Communications and Networking, pp. 274–276 (2007)

  16. Starck, J.-L., Donoho, D.L., Candes, E.J.: Very high quality image restoration by combining wavelets and curvelets. In: International Symposium on Optical Science and Technology, pp. 9–19 (2001)

  17. Mandal, T., Majumdar, A., Wu, Q.M.J.: Face recognition by curvelet based feature extraction. In: Proceedings of the 4th International Conference on Image Analysis and Recognition, pp. 806–817 (2007)

  18. Majumdar, A., Bhattacharya, A.: Face recognition by multi-resolution curvelet transform on bit quantized facial images. In: International Conference on Conference on Computational Intelligence and Multimedia Applications, 2007, vol. 2, pp. 209–213 (2007)

  19. Xianxing, W., Zhao, J.: (2010) Curvelet feature extraction for face recognition and facial expression recognition. In: Sixth International Conference on Natural Computation , vol. 3, pp. 1212–1216 (2010)

  20. Tanaya Mandal, Q.M., Jonathan, W., Yuan, Y.: Curvelet based face recognition via dimension reduction. Signal Process. 89(12), 2345–2353 (2009)

    Article  Google Scholar 

  21. Rui, L., Nejati, H., Cheung, N.-M.: Dimensionality reduction of brain imaging data using graph signal processing. In 2016 IEEE International Conference on Image Processing (ICIP), pp 1329–1333. IEEE (2016)

  22. Ménoret, M., Farrugia, N., Pasdeloup, B., Gripon, V.: Evaluating graph signal processing for neuroimaging through classification and dimensionality reduction. In 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP), pp 618–622. IEEE (2017)

  23. Meena, H.K., Sharma, K.K., Joshi, S.D.: Improved facial expression recognition using graph signal processing. Electron. Lett. 53(11), 718–720 (2017)

    Article  Google Scholar 

  24. Candes, E., Demanet, L., Donoho, D., Ying, L.: Fast discrete curvelet transforms. Multiscale Model. Simul. 5(3), 861–899 (2006)

    Article  MathSciNet  Google Scholar 

  25. Niyogi, P., He, X.: Locality preserving projections. Neural Inf. Process. Syst. MIT 16, 153–160 (2003)

    Google Scholar 

  26. Starck, J L.: Image processing by the curvelet transform. http://jstarck.free.fr, p. 4 (2002)

  27. Candès, E.J.: What is... a curvelet? Not. Am. Math. Soc. 50(11), 1402–1403 (2003)

    MathSciNet  Google Scholar 

  28. Lyons, M., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding facial expressions with gabor wavelets. In: IEEE International Conference on Face and Gesture Recognition, pp 200–205 (1998)

  29. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2001. CVPR 2001, vol. 1:, pp. I–511 (2001)

  30. Tang, M., Chen, F.: Facial expression recognition and its application based on curvelet transform and PSO-SVM. Opt. Int. J. Light Electron Opt. 124(22), 5401–5406 (2013)

    Article  Google Scholar 

  31. Uçar, A., Demir, Y., Güzeliş, C.: A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering. Neural Comput. Appl. 27(1), 131–142 (2016)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Malaviya National Institute of Technology, Jaipur, Rajasthan, India

    Hemant Kumar Meena

  2. Department of Electronics and Communication Engineering, Malaviya National Institute of Technology, Jaipur, Rajasthan, India

    Kamalesh Kumar Sharma

  3. Department of Electrical Engineering, Indian Institute of Technology Delhi, New Delhi, India

    Shiv Dutt Joshi

Authors
  1. Hemant Kumar Meena
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kamalesh Kumar Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shiv Dutt Joshi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hemant Kumar Meena.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Meena, H.K., Sharma, K.K. & Joshi, S.D. Effective curvelet-based facial expression recognition using graph signal processing. SIViP 14, 241–247 (2020). https://doi.org/10.1007/s11760-019-01547-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-019-01547-9

Keywords

Search

Navigation