Abstract
Person re-identification means retrieving a same person in large amounts of images among disjoint camera views. An effective and robust similarity measure between a person image pair plays an important role in the re-identification tasks. In this work, we propose a new metric learning method based on least squares for person re-identification. Specifically, the similar training images pairs are used to learn a linear transformation matrix by being projected to finite discrete discriminant points using regression model; then, the metric matrix can be deduced by solving least squares problem with a closed form solution. We call it discriminant analytical least squares (DALS) metric. In addition, we develop the incremental learning scheme of DALS, which is particularly valuable in model retraining when given additional samples. Furthermore, DALS could be effectively kernelized to further improve the matching performance. Extensive experiments on the VIPeR, GRID, PRID450S and CUHK01 datasets demonstrate the effectiveness and efficiency of our approaches.
Similar content being viewed by others
References
Gong, S., Cristani, M., Yan, S., Loy, C.C.: Person re-identification. Springer, London (2014)
Yu, J., Hong, C., Rui, Y., Tao, D.: Multi-task autoencoder model for recovering human poses. IEEE Trans. Ind. Electron. 99, 1–1 (2017)
Farenzena, M., Bazzani, L., Perina, A., Murino, V., Cristani, M.: Person re-identification by symmetry-driven accumulation of local features. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2360–2367 (2010)
Kviatkovsky, I., Adam, A., Rivlin, E.: Color invariants for person re-identification. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1622–1634 (2013)
Li, W., Wang, X.: Locally aligned feature transforms across views. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 3954–3601 (2013)
Varior, R.R., Wang, G., Lu, J., Liu, T.: Learning invariant color features for person reidentification. IEEE Trans. Image Process. 25, 3395–3410 (2016)
Xiong, F., Gou, M., Camps, O., Sznaier, M.: Person re-identification using kernel-based metric learning methods: In: Proceedings of European Conference on Computer Vision, pp. 1–16 (2014)
Yang, Y., Yang, J., Yan, J., Liao, S., Yi, D., Li, S.Z.: Salient color names for person re-identification. In: Proceedings of European Conference on Computer Vision, pp. 536–551 (2014)
Wang, X., Doretto, G., Sebastian, T., Rittscher, J., Tu, P.: Shape and appearance context modeling. In: Proceedings of International Conference on Computer Vision, pp. 1–8 (2007)
An, L., kafai, M., Yang, S.: Person reidentification with reference descriptor. IEEE Trans. Circuits Syst. Video Technol. 26, 776–787 (2016)
Bak, S., Corvee, E., Brémond, F., Thonnat, M.: Person re-identification using spatial covariance regions of human body parts. In: Proceedings of IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 435–440 (2010)
Gray, D., Tao, H.: Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: Proceedings of European Conference on Computer Vision, pp. 262–275 (2008)
Zheng, W.-S., Gong, S., Xiang, T.: Reidentification by relative distance comparison. IEEE Trans. Pattern Anal. Mach. Intell. 35, 653–668 (2013)
Zhao, R., Ouyang, W., Wang, X.: Unsupervised salience learning for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 3586–3593 (2013)
Ma, B., Su, Y., Jurie, F.: BiCov: a novel image representation for person re-identification and face verfication. In: Proceedings of British Machine Vision Conference, pp. 1–11 (2012)
Liu, C., Gong, S., Loy, C. C., Lin, X.: Person re-identification: what features are important? In: Proceedings of European Conference on Computer Vision Workshop, pp. 391–401 (2012)
Zhao, R., Ouyang, W., Wang, X: Person re-identification by salience matching. In: Proceedings of International Conference on Computer Vision, pp. 2528–2535 (2013)
Liao, S., Hu, Y., Zhu, X., Li, S. Z.: Person re-identification by local maximal occurrence representation and metric learning. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2197–2206 (2015)
Oreifej, O., Mehran, R., Shah, M.: Human identity recognition in aerial images. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 709–716 (2010)
Matsukawa, T., Okabe, T., Suzuki, E., Sato, Y.: Hierarchical Gaussian Descriptor for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1363–1372 (2016)
Bak, S., Carr, P.: Person re-identification using deformable patch metric learning. In: Proceedings of IEEE Winter Conference on Applications of Computer Vision, pp. 1–9 (2016)
Lin, W., Shen, Y., Yan, J., Xu, M., Wu, J., Wang, J., Lu, K.: Learning correspondence structures for person re-identification. IEEE Trans. Image Process. 26, 2438–2453 (2017)
Shen, Y., Lin, W., Yan, J., Xu, M., Wu, J., Wang, J.: Person re-identification with correspondence structure learning. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 3200–3208 (2015)
Yu, J., Rui, Y., Tang, Y., Tao, D.: High-order distance-based multiview stochastic learning in image classification. IEEE Trans. Cybernet. 44, 2431–2442 (2014)
Ahmed, E., Jones, M., Marks, T.K.: An improved deep learning architecture for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 3908–3916 (2015)
Zhe, S., Guo, C., Lai, J.: Deep ranking for person re-identification via joint representation learning. IEEE Trans. Image Process. 25, 2353–2367 (2016)
Yi, D., Lei, Z., Liao, S., Li, S. Z.: Deep metric learning for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 34–39 (2014)
Cheng, D., Gong, Y., Zhou, S., Wang, J., Zheng, N.: Person re-identification by multi-channel parts-based cnn with improved triplet loss function. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1335–1344 (2016)
Prosser, B., Zheng, W.-S., Gong, S., Xiang, T.: Person re-identification by support vector ranking. In: Proceedings of British Machine Vision Conference, pp. 1–11 (2010)
Yu, J., Yang, X., Gao, F., Tao, D.: Deep multimodal distance metric learning using click constraints for image ranking. IEEE Trans. Cybernet. 47, 4014–4024 (2017)
Tao, D., Jin, L., Wang, Y., Yuan, Y., Li, X.: Person re-identification by regularized smoothing kiss metric learning. IEEE Trans. Circuits Syst. Video Technol. 23, 1675–1685 (2013)
Könstinger, M., Hirzer, M., Wohlhart, P., Roth, P.M., Bischof, H.: Large scale metric learning from equivalence constraints. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2288–2295 (2012)
Li, Y., Tian, X., Tao, D.: Regularized large margin distance metric learning. In: Proceedings of International Conference on Data Mining, pp. 1015–1022 (2016)
Li, W., Zhao, R., Wang, X.: Human reidentification with transferred metric learning. In: Proceedings of Asian Conference on Computer Vision, pp. 31–34 (2012)
Tao, D., Guo, Y., Song, M., Li, Y., Yu, Z., Tang, Y.Y.: Person re-identification by dual-regularized kiss metric learning. IEEE Trans. Image Process. 25, 2726–2738 (2016)
Tao, D., Guo, Y., Li, Y., Gao, X.: Tensor rank preserving discriminant analysis for facial recognition. IEEE Trans. Image Process. 27, 325–334 (2018)
Yu, J., Rui, Y., Tao, D.: Click prediction for web image reranking using multimodal sparse coding. IEEE Trans. Image Process. 23, 2019–2032 (2014)
Deng, C., Ji, R., Liu, W., Tao, D., Gao, X.: Visual reranking through weakly supervised multi-graph learning. In: Proceedings of International Conference on Computer Vision, pp. 2600–2607 (2013)
Jobson, D.J., Rahman, Z.U., Woodel, G.A.: A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans. Image Process. 6, 965–976 (1997)
Li, Y., Tian, X., Shen, X., Tao, D.: Classification and representation joint learning via deep networks. In: Proceedings of International Joint Conference on Artificial Intelligence, pp. 2215–2221 (2017)
Li, W., Zhao, R., Xiao, T., Wang, X.: DeepReID: deep filter pairing neural network for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 152–159 (2014)
Xiao, T., Li, H., Ouyang, W., Wang, X.: Learning deep feature representations with domain guided dropout for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1249–1258 (2016)
Ding, S., Lin, L., Wang, G., Chao, H.: Deep feature learning with relative distance comparison for person re-identification. Pattern Recognit. 48, 2993–3003 (2015)
Weinberger, K.Q., Saul, L.K.: Distance metric learning for large margin nearest neighbor classification. J. Mach. Learn. Res. 10, 207–244 (2009)
Davis, J.V., Kulis, B., Jain, P., Sra, S., Dhillon, I.S.: Information-theoretic metric learning. In: Proceedings of the International Conference on Machine Learning, pp. 209–216 (2007)
Tao, D., Jin, L., Wang, Y., Li, X.: Person reidentification by minimum classification error-based KISS metric learning. IEEE Trans. Cybernet. 45, 242–252 (2015)
Perrot, M., Habrard, A.: Regressive virtual metric learning. In: Proceedings of the Advances in Neural Information Processing Systems, pp. 1810–1818 (2015)
Fisher, R.A.: The use of multiple measurements in taxonomic problems. Ann. Hum. Genet. 7, 179–188 (1936)
Pang, S., Ozawa, S., kasabov, N.: Incremental linear discriminant analysis for classification of data streams. IEEE Trans. Syst. Man Cybern. B Cybern. 35, 905–914 (2005)
Loy, C.C., Xiang, T., Gong, S.: Time-delayed correlation analysis for multi-camera activity understanding. Int. J. Comput. Vis. 90, 106–129 (2010)
Roth, P.M., Hirzer, M., Köstinger, M., Beleznai, C., Bischof, H.: Mahalanobis distance learning for person re-identification. In: Gong, S., Cristani, M., Yan, S., Loy, C.C. (eds.) Person Re-Identfication, pp. 247–267. Springer, Berlin (2014)
Liao, S., Zhao, G., Kellokumpu, V., Pietikainen, M., Li, S.Z.: Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1301–1306 (2010)
Acknowledgements
This research was supported by the National Natural Science of Foundation of China (Nos. 61501177, 61772455, 61363022, 61572486, U1713213), Guangzhou Key Laboratory (No. 201605030014), Guangzhou University’s training program for excellent newly recruited doctors (No. YB201712), the Yunnan Natural Science Funds (No. 2016FB105), the Program for Excellent Young Talents of Yunnan University (No. WX069051) and the Project of Innovative Research Team of Yunnan Province.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yang, Z., Hu, X., Dai, F. et al. Person re-identification by discriminant analytical least squares metric learning. Machine Vision and Applications 29, 1019–1031 (2018). https://doi.org/10.1007/s00138-018-0917-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-018-0917-z