Abstract
This paper reviews the contemporary (face, gait, and fusion) computational approaches for automatic human identification at a distance. For remote identification, there may exist large intra-class variations that can affect the performance of face/gait systems substantially. First, we review the face recognition algorithms in light of factors, such as illumination, resolution, blur, occlusion, and pose. Then we introduce several popular gait feature templates, and the algorithms against factors such as shoe, carrying condition, camera view, walking surface, elapsed time, and clothing. The motivation of fusing face and gait, is that, gait is less sensitive to the factors that may affect face (e.g., low resolution, illumination, facial occlusion, etc.), while face is robust to the factors that may affect gait (walking surface, clothing, etc.). We review several most recent face and gait fusion methods with different strategies, and the significant performance gains suggest these two modality are complementary for human identification at a distance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ahonen, T., Rahtu, E., Ojansivu, V., Heikkila, J.: Recognition of blurred faces using local phase quantization. In: ICPR (2008)
Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: Application to face recognition. T-PAMI (2006)
Basri, R., Jacobs, D.: Lambertian reflectance and linear subspaces. T-PAMI (2003)
BBC: Angle grinder gang thefts: Damage put at \(109\)k caused (2014). http://www.bbc.co.uk/news/uk-england-london-27778727
Belhumeur, P., Kriegman, D.: What is the set of images of an object under all possible lighting conditions? In: CVPR (1996)
Beymer, D., Poggio, T.: Face recognition from one example view. In: ICCV (1995)
Beymer, D.: Face recognition under varying pose. In: CVPR (1994)
Biswas, S., Bowyer, K., Flynn, P.: Multidimensional scaling for matching low-resolution facial images. In: BTAS (2010)
Chen, T., Yin, W., Zhou, X.S., Comaniciu, D., Huang, T.: Total variation models for variable lighting face recognition. T-PAMI (2006)
Chen, W., Gao, Y.: Recognizing partially occluded faces from a single sample per class using string-based matching. In: ECCV (2010)
David Barrett, D.: One surveillance camera for every 11 people in britain, says cctv survey. http://www.telegraph.co.uk/technology/10172298/One-surveillance-camera-for-e
Du, S., Ward, R.: Wavelet-based illumination normalization for face recognition. In: ICIP (2005)
Feldman-Haber, S., Keller, Y.: A probabilistic graph-based framework for plug-and-play multi-cue visual tracking. T-IP (2014)
Gao, Y., Leung, M.K.H.: Face recognition using line edge map. T-PAMI (2002)
Geng, X., Wang, L., Li, M., Wu, Q., Smith-Miles, K.: Distance-driven fusion of gait and face for human identification in video. In: IVCNZ (2007)
Georghiades, A., Belhumeur, P., Kriegman, D.: From few to many: illumination cone models for face recognition under variable lighting and pose. T-PAMI (2001)
Goffredo, M., Bouchrika, I., Carter, J., Nixon, M.: Self-calibrating view-invariant gait biometrics. T-SMC-B (2010)
Guan, Y., Li, C.T., Choudhury., S.D.: Robust gait recognition from extremely low frame-rate videos. In: IWBF (2013)
Guan, Y., Sun, Y., Li, C.T., Tistarelli, M.: Human gait identification from extremely low quality videos: an enhanced classifier ensemble method. IET Biometrics (2014)
Guan, Y., Li, C.T.: A robust speed-invariant gait recognition system for walker and runner identification. In: ICB (2013)
Guan, Y., Li, C.T., Hu, Y.: Random subspace method for gait recognition. In: ICMEW (2012)
Guan, Y., Li, C.T., Hu, Y.: Robust clothing-invariant gait recognition. In: IIH-MSP (2012)
Guan, Y., Wei, X., Li, C.T., Marcialis, G., Roli, F., Tistarelli, M.: Combining gait and face for tackling the elapsed time challenges. In: BTAS (2013)
Gunturk, B., Batur, A., Altunbasak, Y., Hayes, M., Mersereau, R.: Eigenface-domain super-resolution for face recognition. T-IP (2003)
Hadid, A., Nishiyama, M., Sato, Y.: Recognition of blurred faces via facial deblurring combined with blur-tolerant descriptors. In: ICPR (2010)
Han, J., Bhanu, B.: Individual recognition using gait energy image. T-PAMI (2006)
Hennings-Yeomans, P., Baker, S., Kumar, B.: Simultaneous super-resolution and feature extraction for recognition of low-resolution faces. In: CVPR (2008)
Hennings-Yeomans, P., Kumar, B., Baker, S.: Robust low-resolution face identification and verification using high-resolution features. In: ICIP (2009)
Ho, T.K.: The random subspace method for constructing decision forests. T-PAMI (1998)
Hofmann, M., Schmidt, S., Rajagopalan, A.N., Rigoll, G.: Combined face and gait recognition using alpha matte preprocessing. In: ICB (2012)
Hua, F., Johnson, P., Sazonova, N., Lopez-Meyer, P., Schuckers, S.: Impact of out-of-focus blur on face recognition performance based on modular transfer function. In: ICB (2012)
Huang, H., He, H.: Super-resolution method for face recognition using nonlinear mappings on coherent features. T-NN (2011)
Huang, Y., Xu, D., Cham, T.J.: Face and human gait recognition using image-to-class distance. T-CSVT (2010)
Bouchrika, I., Goffredo, M., J.C., Nixon, M.S.: On using gait in forensic biometrics. J. Forencics Sci. (2011)
Iwama, H., Okumura, M., Makihara, Y., Yagi, Y.: The ou-isir gait database comprising the large population dataset and performance evaluation of gait recognition. T-IFS (2012)
Jain, A., Ross, A., Prabhakar, S.: An introduction to biometric recognition. T-CSVT (2004)
Jia, H., MartÃnez, A.M.: Face recognition with occlusions in the training and testing sets. In: FG (2008)
Jia, K., Gong, S.: Multi-modal tensor face for simultaneous super-resolution and recognition. In: ICCV (2005)
Bashir, K., T.X., Gong, S.: Gait recognition using gait entropy image. In: ICDP (2009)
Bashir, K., T.X., Gong, S.: Gait recognition without subject cooperation. PRL (2010)
Kale, A., Roychowdhury, A., Chellappa, R.: Fusion of gait and face for human identification. In: ICASSP (2004)
Kusakunniran, W., Wu, Q., Zhang, J., Li, H.: Speed-invariant gait recognition based on procrustes shape analysis using higher-order shape configuration. In: ICIP (2011)
Kusakunniran, W., Wu, Q., Zhang, J., Li, H.: Gait recognition across various walking speeds using higher order shape configuration based on a differential composition model. T-SMC-B (2012)
Kusakunniran, W., Wu, Q., Zhang, J., Li, H., Wang, L.: Recognizing gaits across views through correlated motion co-clustering. T-IP (2014)
Lambert, J.: Photometria sive de mensura et gradibus luminus. Colorum et Umbrae", Eberhard Klett (1760)
Lambert, J.: Photometria sive de mensura et gradibus luminus. Colorum et Umbrae. Eberhard Klett (1760)
Li, B., Chang, H., Shan, S., Chen, X.: Low-resolution face recognition via coupled locality preserving mappings. SPL (2010)
Liao, S., Jain, A.K., Li, S.Z.: Partial face recognition: Alignment-free approach. T-PAMI (2013)
Liu, Z., Sarkar, S.: Outdoor recognition at a distance by fusing gait and face. IVC (2007)
Hossain, M.A., Makihara, Y., J.W., Yagi, Y.: Clothing-invariant gait identification using part-based clothing categorization and adaptive weight control. PR (2010)
Makihara, Y., Sagawa, R., Mukaigawa, Y., Echigo, T., Yagi, Y.: Gait recognition using a view transformation model in the frequency domain. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 151–163. Springer, Heidelberg (2006)
MartÃnez, A.M.: Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. T-PAMI (2002)
Matovski, D., Nixon, M., Mahmoodi, S., Carter, J.: The effect of time on gait recognition performance. T-IFS (2012)
Naseem, A.I., Togneri, B.R., Bennamoun, C.M.: Linear regression for face recognition. T-PAMI (2010)
Nishiyama, M., Hadid, A., Takeshima, H., Shotton, J., Kozakaya, T., Yamaguchi, O.: Facial deblur inference using subspace analysis for recognition of blurred faces. T-PAMI (2011)
Okada, K., Von der Malsburg, C.: Pose-invariant face recognition with parametric linear subspaces. In: FG (2002)
Larsen, P.K., E.S., Lynnerup, N.: Gait analysis in forensic medicine. J. Forencics Sci. (2008)
Ramamoorthi, R.: Analytic pca construction for theoretical analysis of lighting variability in images of a lambertian object. T-PAMI (2002)
Rattani, A., Kisku, D., Bicego, M., Tistarelli, M.: Feature level fusion of face and fingerprint biometrics. In: BTAS (2007)
Sarkar, S., Phillips, P., Liu, Z., Vega, I., Grother, P., Bowyer, K.: The humanid gait challenge problem: data sets, performance, and analysis. T-PAMI (2005)
Shakhnarovich, G., Darrell, T.: On probabilistic combination of face and gait cues for identification. In: FG (2002)
Shan, S., Gao, W., Cao, B., Zhao, D.: Illumination normalization for robust face recognition against varying lighting conditions. In: FG (2003)
Shekhar, S., Patel, V., Chellappa, R.: Synthesis-based recognition of low resolution faces. In: IJCB (2011)
T. H. W. Lam, K.H.C., Liu, J.N.K.: Gait flow image: A silhouette-based gait representation for human identification. PR (2011)
Tan, D., Huang, K., Yu, S., Tan, T.: Efficient night gait recognition based on template matching. In: ICPR (2006)
Tan, X., Chen, S., Zhou, Z.H., Liu, J.: Face recognition under occlusions and variant expressions with partial similarity. T-IFS (2009)
Tan, X., Chen, S., Zhou, Z.H., Zhang, F.: Recognizing partially occluded, expression variant faces from single training image per person with SOM and soft k-NN ensemble. T-NN (2005)
Tao, D., Li, X., Wu, X., Maybank, S.: General tensor discriminant analysis and gabor features for gait recognition. T-PAMI (2007)
Tara McKelvey, a.K.D.: Boston marathon bombings: How notorious bombers got caught, bbc news magazine (2013). http://www.bbc.co.uk/news/magazine-22191033
Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: Subspace learning from image gradient orientations. T-PAMI (2012)
Wang, B., Li, W., Yang, W., Liao, Q.: Illumination normalization based on weber’s law with application to face recognition. SPL (2011)
Wang, C., Zhang, J., Wang, L., Pu, J., Yuan, X.: Human identification using temporal information preserving gait template. T-PAMI (2012)
Wang, L., Tan, T., Ning, H., Hu, W.: Silhouette analysis-based gait recognition for human identification. T-PAMI (2003)
Wang, Y., Tan, T., Jain, A.K.: Combining face and iris biometrics for identity verification. In: AVBPA (2003)
Wei, X., Li, C.T.: Fixation and saccade based face recognition from single image per person with various occlusions and expressions. In: CVPRW (2013)
Wei, X., Li, C.T., Hu, Y.: Robust face recognition under varying illumination and occlusion considering structured sparsity. In: DICTA (2012)
Wei, X., Li, C.T., Hu, Y.: Face recognition with occlusion using dynamic image-to-class warping (DICW). In: FG (2013)
Wei, X., Li, C.T., Hu, Y.: Robust face recognition with occlusions in both reference and query images. In: IWBF (2013)
Wright, J., Yang, A.Y., Ganesh, A., Sastry, S.S., Ma, Y.: Robust face recognition via sparse representation. T-PAMI (2009)
Xu, D., Huang, Y., Zeng, Z., Xu, X.: Human gait recognition using patch distribution feature and locality-constrained group sparse representation. T-IP (2012)
Xu, D., Yan, S., Tao, D., Zhang, L., Li, X., Zhang, H.J.: Human gait recognition with matrix representation. T-CSVT (2006)
Zhang, H., Yang, J., Zhang, Y., Nasrabadi, N., Huang, T.: Close the loop: Joint blind image restoration and recognition with sparse representation prior. In: ICCV (2011)
Zhang, L., Yang, M., Feng, X.: Sparse representation or collaborative representation: Which helps face recognition? In: ICCV (2011)
Zhang, X., Gao, Y.: Face recognition across pose: A review. PR (2009)
Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: A literature survey. ACM Computing Surveys (2003)
Zhou, X., Bhanu, B.: Feature fusion of side face and gait for video-based human identification. PR (2008)
Zhou, X., Bhanu, B.: Integrating face and gait for human recognition at a distance in video. T-SMC-B (2007)
Zhu, J., Cao, D., Liu, S., Lei, Z., Li, S.Z.: Discriminant analysis with gabor phase for robust face recognition. In: ICB (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Guan, Y., Wei, X., Li, CT., Keller, Y. (2014). People Identification and Tracking Through Fusion of Facial and Gait Features. In: Cantoni, V., Dimov, D., Tistarelli, M. (eds) Biometric Authentication. BIOMET 2014. Lecture Notes in Computer Science(), vol 8897. Springer, Cham. https://doi.org/10.1007/978-3-319-13386-7_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-13386-7_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-13385-0
Online ISBN: 978-3-319-13386-7
eBook Packages: Computer ScienceComputer Science (R0)