A framework for online gait recognition based on multilinear tensor analysis

Abstract

The gait recognition is to recognize an individual based on the characteristics extracted from the gait image sequence. There are many researches for the gait recognition which use diverse kinds of information such as shape of gait silhouette, motion variation caused by walking, and so on. In general, shape information is more useful for recognition. However, shape information is influenced by a variety of factors, which degrade the recognition performance. Moreover, the information used in most of those studies might be able to be extracted after all of one or more sequences of the gait cycle are known. And it is also hard to discriminate the gait cycle from given gait sequences exactly by the online approach. In regard to these difficulties, we propose a novel gait recognition method based on the multilinear tensor analysis. To recognize the cyclic characteristic of gait without an exact division for the gait cycle, this paper’s propose is the method to form the accumulated silhouette and then describes those as the tensor. For the accumulated silhouette proposed by this paper, the image sequence of one gait cycle is divided into four sections in the training phase. However, discrimination for the gait cycle in the training phase is not directly related to the recognition phase, thus the online approach is possible. We first form the accumulated silhouettes for every individual using gait silhouettes within each section. And then, we represent these accumulated silhouettes as the tensor. Using a multilinear tensor analysis, we compute the core tensor which governs the interaction between factors organizing the original tensor, and then compose the basis to recognize the individual in the online recognition framework. Finally, we recognize the individual using the computation of similarity based on the Euclidean distance, which is more suitable to our method. We verify the superiority of the proposed approach via experiments with real gait sequences.