Abstract
This paper first presents a novel approach for modelling facial features, Local Directional Texture (LDT), which exploits the unique directional information in image textures for the problem of face recognition. A variant of LDT with privacy-preserving temporal strips (TS) is then considered to achieve faceless recognition with a higher degree of privacy while maintaining high accuracy. The TS uses two strips of pixel blocks from the temporal planes, XT and YT, for face recognition. By removing the reliance on spatial context (i.e., XY plane) for this task, the proposed method withholds facial appearance information from public view, where only one-dimensional temporal information that varies across time are extracted for recognition. Thus, privacy is assured, yet without impeding the facial recognition task which is vital for many security applications such as street surveillance and perimeter access control. To validate the reliability of the proposed method, experiments were carried out using the Honda/UCSD, CK+, CAS(ME)2 and CASME II databases. The proposed method achieved a recognition rate of 98.26% in the standard video-based face recognition database, Honda/UCSD. It also offers a 81.92% reduction in the dimension length required for storing the extracted features, in contrast to the conventional LBP-TOP.










Similar content being viewed by others
References
Abdallah TB, Guermazi R, Hammami M (2018) Facial-expression recognition based on a low-dimensional temporal feature space. Multimed Tools Appl 77(15):19455–19479
Ahonen T, Hadid A, Pietikäinen M (2004) Face recognition with local binary patterns. In: European conference on computer vision. Springer, Berlin, pp 469–481
Deng W, Hu J, Guo J (2017) Face recognition via collaborative representation:, Its discriminant nature and superposed representation. IEEE Trans Patt Anal Mach Intell 40(10):2513–2521
Dobs K, Bülthoff I, Schultz J (2018) Use and usefulness of dynamic face stimuli for face perception studies–a review of behavioral findings and methodology. Frontiers in Psychology. 9, 1355
Erdélyi A., Winkler T, Rinner B (2018) Privacy Protection vs. Utility in Visual Data. Multimed Tools Appl 77(2):2285–2312
Fan J, Arandjelović O (2018) Employing domain specific discriminative information to address inherent limitations of the LBP descriptor in face recognition. In: 2018 international joint conference on neural networks (IJCNN). IEEE, pp 1–7
Hadid A, Pietikainen M (2004) From still image to video-based face recognition: an experimental analysis. In: Sixth IEEE international conference on automatic face and gesture recognition, 2004. Proceedings. IEEE, pp 813–818
He DC, Wang L (1990) Texture unit, texture spectrum, and texture analysis. IEEE Trans Geosci Remote Sens 28(4):509–512
He L, Li H, Zhang Q, Sun Z (2018) Dynamic feature learning for partial face recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7054–7063
Jourabloo A, Yin X, Liu X (2015) Attribute preserved face de-identification. In: 2015 International conference on biometrics (ICB). IEEE, pp 278–285
Kätsyri J., Sams M (2008) The effect of dynamics on identifying basic emotions from synthetic and natural faces. Int J Human-Comput Stud 66(4):233–242
Korshunov P, Marcel S (2018) Deepfakes: a New Threat to Face Recognition? Assessment and Detection. arXiv:1812.08685
Lee KC, Ho J, Yang MH, Kriegman D (2005) Visual Tracking and Recognition using Probabilistic Appearance Manifolds. Comput Vision Image Understand 99(3):303–331
Liao S, Jain AK, Li SZ (2012) Partial face recognition: alignment-free approach. IEEE Trans Patt Anal Mach Intell 35(5):1193–1205
Lin J, Xiao L, Wu T, Bian W (2020) Image set-based face recognition using pose estimation with facial landmarks. Multimed Tools Appl 1–15
Liu Z, Hu H, Bai J, Li S, Lian S (2019) Fine-grained Attention-based Video Face Recognition. arXiv:1905.01796
Lucey P, Cohn JF, Kanade T, Saragih J, Ambadar Z, Matthews I (2010) The extended Cohn-kanade dataset (ck+): a complete dataset for action unit and emotion-specified expression. In: 2010 IEEE computer society conference on computer vision and pattern recognition-workshops. IEEE , pp 94–101
Maity S, Abdel-Mottaleb M, Asfour SS (2017) Multimodal Biometrics Recognition from Facial Video via Deep Learning. Signal Image Process Int J 8:81–90
Milborrow S, Nicolls F (2008) Locating facial features with an extended active shape model. In: European conference on computer vision. Springer, Berlin, pp 504–513
Ojala T, Pietikäinen M., Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recognit 29(1):51–59
Peng F, Qin L, Long M (2018) Face Presentation Attack Detection using Guided Scale Texture. Multimed Tools Appl 77(7):8883–8909
Qu F, Wang SJ, Yan WJ, Li H, Wu S, Fu X (2017) CAS (ME) 2:, A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and Recognition. IEEE Trans Affect Comput 9(4):424–436
Rahim MA, Azam MS, Hossain N, Islam MR (2013) Face recognition using local binary patterns (LBP). Global Journal of Computer Science and Technology
Rani PI, Muneeswaran K (2017) Recognize the Facial Emotion in Video Sequences using Eye and Mouth Temporal Gabor features. Multimed Tools Appl 76 (7):10017–10040
Scherhag U, Rathgeb C, Merkle J, Breithaupt R, Busch C (2019) Face recognition systems under morphing attacks. A Survey. IEEE Access 7:23012–23026
Stallkamp J, Ekenel HK, Stiefelhagen R (2007) Video-based face recognition on real-world data. In: 2007 IEEE 11th International Conference on Computer Vision. IEEE, pp 1–8
Tang H, Yin B, Sun Y, Hu Y (2013) 3D face recognition using local binary patterns. Signal Process 93(8):2190–2198
Tharshini G, Shanmugarajah V, Sathananthan H, Thiruchelvam J, Godaliyadda GMRI, Ekanayake MPB, Wijayakulasooriya J (2017) Expression neutralization based algorithm for expression-invariant face recognition for single training sample problem. In: 2017 IEEE International Conference on Industrial and Information Systems (ICIIS). IEEE, pp 1–6
Wang Y, See J, Phan RCW, Oh YH (2015) Efficient spatio-temporal local binary patterns for spontaneous facial micro-expression recognition. PloS one 10(5):e0124674
Wilber MJ, Shmatikov V, Belongie S (2016) Can we still avoid automatic face detection?. In: 2016 IEEE winter conference on applications of computer vision (WACV). IEEE, pp 1–9
Yan WJ, Li X, Wang SJ, Zhao G, Liu YJ, Chen YH, Fu X (2014) CASME II: an Improved Spontaneous Micro-expression Database and the Baseline Evaluation. PloS One 9(1):e86041
Zhao G, Pietikainen M (2007) Dynamic Texture Recognition using Local Binary Patterns with an Application to Facial Expressions. IEEE Trans Patt Anal Mach Intell (6) 915–928
Zheng J, Yu R, Chen JC, Lu B, Castillo CD, Chellappa R (2019) Uncertainty modeling of contextual-connections between tracklets for unconstrained video-based face recognition. In: Proceedings of the IEEE international conference on computer vision, pp 703–712
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Leong, SM., Phan, R.CW., Baskaran, V.M. et al. Faceless identification based on temporal strips. Multimed Tools Appl 80, 279–298 (2021). https://doi.org/10.1007/s11042-020-09391-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-09391-7