Skip to main content
SpringerLink
Log in

Faceless identification based on temporal strips

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper first presents a novel approach for modelling facial features, Local Directional Texture (LDT), which exploits the unique directional information in image textures for the problem of face recognition. A variant of LDT with privacy-preserving temporal strips (TS) is then considered to achieve faceless recognition with a higher degree of privacy while maintaining high accuracy. The TS uses two strips of pixel blocks from the temporal planes, XT and YT, for face recognition. By removing the reliance on spatial context (i.e., XY plane) for this task, the proposed method withholds facial appearance information from public view, where only one-dimensional temporal information that varies across time are extracted for recognition. Thus, privacy is assured, yet without impeding the facial recognition task which is vital for many security applications such as street surveillance and perimeter access control. To validate the reliability of the proposed method, experiments were carried out using the Honda/UCSD, CK+, CAS(ME)2 and CASME II databases. The proposed method achieved a recognition rate of 98.26% in the standard video-based face recognition database, Honda/UCSD. It also offers a 81.92% reduction in the dimension length required for storing the extracted features, in contrast to the conventional LBP-TOP.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Abdallah TB, Guermazi R, Hammami M (2018) Facial-expression recognition based on a low-dimensional temporal feature space. Multimed Tools Appl 77(15):19455–19479

    Article  Google Scholar 

  2. Ahonen T, Hadid A, Pietikäinen M (2004) Face recognition with local binary patterns. In: European conference on computer vision. Springer, Berlin, pp 469–481

  3. Deng W, Hu J, Guo J (2017) Face recognition via collaborative representation:, Its discriminant nature and superposed representation. IEEE Trans Patt Anal Mach Intell 40(10):2513–2521

    Article  Google Scholar 

  4. Dobs K, Bülthoff I, Schultz J (2018) Use and usefulness of dynamic face stimuli for face perception studies–a review of behavioral findings and methodology. Frontiers in Psychology. 9, 1355

  5. Erdélyi A., Winkler T, Rinner B (2018) Privacy Protection vs. Utility in Visual Data. Multimed Tools Appl 77(2):2285–2312

    Article  Google Scholar 

  6. Fan J, Arandjelović O (2018) Employing domain specific discriminative information to address inherent limitations of the LBP descriptor in face recognition. In: 2018 international joint conference on neural networks (IJCNN). IEEE, pp 1–7

  7. Hadid A, Pietikainen M (2004) From still image to video-based face recognition: an experimental analysis. In: Sixth IEEE international conference on automatic face and gesture recognition, 2004. Proceedings. IEEE, pp 813–818

  8. He DC, Wang L (1990) Texture unit, texture spectrum, and texture analysis. IEEE Trans Geosci Remote Sens 28(4):509–512

    Article  Google Scholar 

  9. He L, Li H, Zhang Q, Sun Z (2018) Dynamic feature learning for partial face recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7054–7063

  10. Jourabloo A, Yin X, Liu X (2015) Attribute preserved face de-identification. In: 2015 International conference on biometrics (ICB). IEEE, pp 278–285

  11. Kätsyri J., Sams M (2008) The effect of dynamics on identifying basic emotions from synthetic and natural faces. Int J Human-Comput Stud 66(4):233–242

    Article  Google Scholar 

  12. Korshunov P, Marcel S (2018) Deepfakes: a New Threat to Face Recognition? Assessment and Detection. arXiv:1812.08685

  13. Lee KC, Ho J, Yang MH, Kriegman D (2005) Visual Tracking and Recognition using Probabilistic Appearance Manifolds. Comput Vision Image Understand 99(3):303–331

    Article  Google Scholar 

  14. Liao S, Jain AK, Li SZ (2012) Partial face recognition: alignment-free approach. IEEE Trans Patt Anal Mach Intell 35(5):1193–1205

    Article  Google Scholar 

  15. Lin J, Xiao L, Wu T, Bian W (2020) Image set-based face recognition using pose estimation with facial landmarks. Multimed Tools Appl 1–15

  16. Liu Z, Hu H, Bai J, Li S, Lian S (2019) Fine-grained Attention-based Video Face Recognition. arXiv:1905.01796

  17. Lucey P, Cohn JF, Kanade T, Saragih J, Ambadar Z, Matthews I (2010) The extended Cohn-kanade dataset (ck+): a complete dataset for action unit and emotion-specified expression. In: 2010 IEEE computer society conference on computer vision and pattern recognition-workshops. IEEE , pp 94–101

  18. Maity S, Abdel-Mottaleb M, Asfour SS (2017) Multimodal Biometrics Recognition from Facial Video via Deep Learning. Signal Image Process Int J 8:81–90

    Google Scholar 

  19. Milborrow S, Nicolls F (2008) Locating facial features with an extended active shape model. In: European conference on computer vision. Springer, Berlin, pp 504–513

  20. Ojala T, Pietikäinen M., Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recognit 29(1):51–59

    Article  Google Scholar 

  21. Peng F, Qin L, Long M (2018) Face Presentation Attack Detection using Guided Scale Texture. Multimed Tools Appl 77(7):8883–8909

    Article  Google Scholar 

  22. Qu F, Wang SJ, Yan WJ, Li H, Wu S, Fu X (2017) CAS (ME) 2:, A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and Recognition. IEEE Trans Affect Comput 9(4):424–436

    Article  Google Scholar 

  23. Rahim MA, Azam MS, Hossain N, Islam MR (2013) Face recognition using local binary patterns (LBP). Global Journal of Computer Science and Technology

  24. Rani PI, Muneeswaran K (2017) Recognize the Facial Emotion in Video Sequences using Eye and Mouth Temporal Gabor features. Multimed Tools Appl 76 (7):10017–10040

    Article  Google Scholar 

  25. Scherhag U, Rathgeb C, Merkle J, Breithaupt R, Busch C (2019) Face recognition systems under morphing attacks. A Survey. IEEE Access 7:23012–23026

    Article  Google Scholar 

  26. Stallkamp J, Ekenel HK, Stiefelhagen R (2007) Video-based face recognition on real-world data. In: 2007 IEEE 11th International Conference on Computer Vision. IEEE, pp 1–8

  27. Tang H, Yin B, Sun Y, Hu Y (2013) 3D face recognition using local binary patterns. Signal Process 93(8):2190–2198

    Article  Google Scholar 

  28. Tharshini G, Shanmugarajah V, Sathananthan H, Thiruchelvam J, Godaliyadda GMRI, Ekanayake MPB, Wijayakulasooriya J (2017) Expression neutralization based algorithm for expression-invariant face recognition for single training sample problem. In: 2017 IEEE International Conference on Industrial and Information Systems (ICIIS). IEEE, pp 1–6

  29. Wang Y, See J, Phan RCW, Oh YH (2015) Efficient spatio-temporal local binary patterns for spontaneous facial micro-expression recognition. PloS one 10(5):e0124674

    Article  Google Scholar 

  30. Wilber MJ, Shmatikov V, Belongie S (2016) Can we still avoid automatic face detection?. In: 2016 IEEE winter conference on applications of computer vision (WACV). IEEE, pp 1–9

  31. Yan WJ, Li X, Wang SJ, Zhao G, Liu YJ, Chen YH, Fu X (2014) CASME II: an Improved Spontaneous Micro-expression Database and the Baseline Evaluation. PloS One 9(1):e86041

    Article  Google Scholar 

  32. Zhao G, Pietikainen M (2007) Dynamic Texture Recognition using Local Binary Patterns with an Application to Facial Expressions. IEEE Trans Patt Anal Mach Intell (6) 915–928

  33. Zheng J, Yu R, Chen JC, Lu B, Castillo CD, Chellappa R (2019) Uncertainty modeling of contextual-connections between tracklets for unconstrained video-based face recognition. In: Proceedings of the IEEE international conference on computer vision, pp 703–712

Download references

Author information

Authors and Affiliations

  1. School of Information Technology, Monash University, Subang Jaya, Malaysia

    Shu-Min Leong, Raphaël C.-W. Phan & Vishnu Monn Baskaran

  2. Department of Software Systems & Cybersecurity, Faculty of IT, Monash University, Melbourne, Australia

    Raphaël C.-W. Phan

  3. Faculty of Engineering, Multimedia University, Cyberjaya, Malaysia

    Chee-Pun Ooi

Authors
  1. Shu-Min Leong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Raphaël C.-W. Phan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vishnu Monn Baskaran
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chee-Pun Ooi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shu-Min Leong.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Leong, SM., Phan, R.CW., Baskaran, V.M. et al. Faceless identification based on temporal strips. Multimed Tools Appl 80, 279–298 (2021). https://doi.org/10.1007/s11042-020-09391-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09391-7

Keywords

Search

Navigation