Skip to main content
Log in

Person re-identification by discriminant analytical least squares metric learning

  • Special Issue Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Person re-identification means retrieving a same person in large amounts of images among disjoint camera views. An effective and robust similarity measure between a person image pair plays an important role in the re-identification tasks. In this work, we propose a new metric learning method based on least squares for person re-identification. Specifically, the similar training images pairs are used to learn a linear transformation matrix by being projected to finite discrete discriminant points using regression model; then, the metric matrix can be deduced by solving least squares problem with a closed form solution. We call it discriminant analytical least squares (DALS) metric. In addition, we develop the incremental learning scheme of DALS, which is particularly valuable in model retraining when given additional samples. Furthermore, DALS could be effectively kernelized to further improve the matching performance. Extensive experiments on the VIPeR, GRID, PRID450S and CUHK01 datasets demonstrate the effectiveness and efficiency of our approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Gong, S., Cristani, M., Yan, S., Loy, C.C.: Person re-identification. Springer, London (2014)

    Book  MATH  Google Scholar 

  2. Yu, J., Hong, C., Rui, Y., Tao, D.: Multi-task autoencoder model for recovering human poses. IEEE Trans. Ind. Electron. 99, 1–1 (2017)

    Google Scholar 

  3. Farenzena, M., Bazzani, L., Perina, A., Murino, V., Cristani, M.: Person re-identification by symmetry-driven accumulation of local features. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2360–2367 (2010)

  4. Kviatkovsky, I., Adam, A., Rivlin, E.: Color invariants for person re-identification. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1622–1634 (2013)

    Article  Google Scholar 

  5. Li, W., Wang, X.: Locally aligned feature transforms across views. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 3954–3601 (2013)

  6. Varior, R.R., Wang, G., Lu, J., Liu, T.: Learning invariant color features for person reidentification. IEEE Trans. Image Process. 25, 3395–3410 (2016)

    Article  MathSciNet  Google Scholar 

  7. Xiong, F., Gou, M., Camps, O., Sznaier, M.: Person re-identification using kernel-based metric learning methods: In: Proceedings of European Conference on Computer Vision, pp. 1–16 (2014)

  8. Yang, Y., Yang, J., Yan, J., Liao, S., Yi, D., Li, S.Z.: Salient color names for person re-identification. In: Proceedings of European Conference on Computer Vision, pp. 536–551 (2014)

  9. Wang, X., Doretto, G., Sebastian, T., Rittscher, J., Tu, P.: Shape and appearance context modeling. In: Proceedings of International Conference on Computer Vision, pp. 1–8 (2007)

  10. An, L., kafai, M., Yang, S.: Person reidentification with reference descriptor. IEEE Trans. Circuits Syst. Video Technol. 26, 776–787 (2016)

    Article  Google Scholar 

  11. Bak, S., Corvee, E., Brémond, F., Thonnat, M.: Person re-identification using spatial covariance regions of human body parts. In: Proceedings of IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 435–440 (2010)

  12. Gray, D., Tao, H.: Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: Proceedings of European Conference on Computer Vision, pp. 262–275 (2008)

  13. Zheng, W.-S., Gong, S., Xiang, T.: Reidentification by relative distance comparison. IEEE Trans. Pattern Anal. Mach. Intell. 35, 653–668 (2013)

    Article  Google Scholar 

  14. Zhao, R., Ouyang, W., Wang, X.: Unsupervised salience learning for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 3586–3593 (2013)

  15. Ma, B., Su, Y., Jurie, F.: BiCov: a novel image representation for person re-identification and face verfication. In: Proceedings of British Machine Vision Conference, pp. 1–11 (2012)

  16. Liu, C., Gong, S., Loy, C. C., Lin, X.: Person re-identification: what features are important? In: Proceedings of European Conference on Computer Vision Workshop, pp. 391–401 (2012)

  17. Zhao, R., Ouyang, W., Wang, X: Person re-identification by salience matching. In: Proceedings of International Conference on Computer Vision, pp. 2528–2535 (2013)

  18. Liao, S., Hu, Y., Zhu, X., Li, S. Z.: Person re-identification by local maximal occurrence representation and metric learning. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2197–2206 (2015)

  19. Oreifej, O., Mehran, R., Shah, M.: Human identity recognition in aerial images. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 709–716 (2010)

  20. Matsukawa, T., Okabe, T., Suzuki, E., Sato, Y.: Hierarchical Gaussian Descriptor for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1363–1372 (2016)

  21. Bak, S., Carr, P.: Person re-identification using deformable patch metric learning. In: Proceedings of IEEE Winter Conference on Applications of Computer Vision, pp. 1–9 (2016)

  22. Lin, W., Shen, Y., Yan, J., Xu, M., Wu, J., Wang, J., Lu, K.: Learning correspondence structures for person re-identification. IEEE Trans. Image Process. 26, 2438–2453 (2017)

    Article  MathSciNet  Google Scholar 

  23. Shen, Y., Lin, W., Yan, J., Xu, M., Wu, J., Wang, J.: Person re-identification with correspondence structure learning. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 3200–3208 (2015)

  24. Yu, J., Rui, Y., Tang, Y., Tao, D.: High-order distance-based multiview stochastic learning in image classification. IEEE Trans. Cybernet. 44, 2431–2442 (2014)

    Article  Google Scholar 

  25. Ahmed, E., Jones, M., Marks, T.K.: An improved deep learning architecture for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 3908–3916 (2015)

  26. Zhe, S., Guo, C., Lai, J.: Deep ranking for person re-identification via joint representation learning. IEEE Trans. Image Process. 25, 2353–2367 (2016)

    Article  MathSciNet  Google Scholar 

  27. Yi, D., Lei, Z., Liao, S., Li, S. Z.: Deep metric learning for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 34–39 (2014)

  28. Cheng, D., Gong, Y., Zhou, S., Wang, J., Zheng, N.: Person re-identification by multi-channel parts-based cnn with improved triplet loss function. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1335–1344 (2016)

  29. Prosser, B., Zheng, W.-S., Gong, S., Xiang, T.: Person re-identification by support vector ranking. In: Proceedings of British Machine Vision Conference, pp. 1–11 (2010)

  30. Yu, J., Yang, X., Gao, F., Tao, D.: Deep multimodal distance metric learning using click constraints for image ranking. IEEE Trans. Cybernet. 47, 4014–4024 (2017)

    Article  Google Scholar 

  31. Tao, D., Jin, L., Wang, Y., Yuan, Y., Li, X.: Person re-identification by regularized smoothing kiss metric learning. IEEE Trans. Circuits Syst. Video Technol. 23, 1675–1685 (2013)

    Article  Google Scholar 

  32. Könstinger, M., Hirzer, M., Wohlhart, P., Roth, P.M., Bischof, H.: Large scale metric learning from equivalence constraints. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2288–2295 (2012)

  33. Li, Y., Tian, X., Tao, D.: Regularized large margin distance metric learning. In: Proceedings of International Conference on Data Mining, pp. 1015–1022 (2016)

  34. Li, W., Zhao, R., Wang, X.: Human reidentification with transferred metric learning. In: Proceedings of Asian Conference on Computer Vision, pp. 31–34 (2012)

  35. Tao, D., Guo, Y., Song, M., Li, Y., Yu, Z., Tang, Y.Y.: Person re-identification by dual-regularized kiss metric learning. IEEE Trans. Image Process. 25, 2726–2738 (2016)

    Article  MathSciNet  Google Scholar 

  36. Tao, D., Guo, Y., Li, Y., Gao, X.: Tensor rank preserving discriminant analysis for facial recognition. IEEE Trans. Image Process. 27, 325–334 (2018)

    Article  MathSciNet  Google Scholar 

  37. Yu, J., Rui, Y., Tao, D.: Click prediction for web image reranking using multimodal sparse coding. IEEE Trans. Image Process. 23, 2019–2032 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  38. Deng, C., Ji, R., Liu, W., Tao, D., Gao, X.: Visual reranking through weakly supervised multi-graph learning. In: Proceedings of International Conference on Computer Vision, pp. 2600–2607 (2013)

  39. Jobson, D.J., Rahman, Z.U., Woodel, G.A.: A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans. Image Process. 6, 965–976 (1997)

    Article  Google Scholar 

  40. Li, Y., Tian, X., Shen, X., Tao, D.: Classification and representation joint learning via deep networks. In: Proceedings of International Joint Conference on Artificial Intelligence, pp. 2215–2221 (2017)

  41. Li, W., Zhao, R., Xiao, T., Wang, X.: DeepReID: deep filter pairing neural network for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 152–159 (2014)

  42. Xiao, T., Li, H., Ouyang, W., Wang, X.: Learning deep feature representations with domain guided dropout for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1249–1258 (2016)

  43. Ding, S., Lin, L., Wang, G., Chao, H.: Deep feature learning with relative distance comparison for person re-identification. Pattern Recognit. 48, 2993–3003 (2015)

    Article  Google Scholar 

  44. Weinberger, K.Q., Saul, L.K.: Distance metric learning for large margin nearest neighbor classification. J. Mach. Learn. Res. 10, 207–244 (2009)

    MATH  Google Scholar 

  45. Davis, J.V., Kulis, B., Jain, P., Sra, S., Dhillon, I.S.: Information-theoretic metric learning. In: Proceedings of the International Conference on Machine Learning, pp. 209–216 (2007)

  46. Tao, D., Jin, L., Wang, Y., Li, X.: Person reidentification by minimum classification error-based KISS metric learning. IEEE Trans. Cybernet. 45, 242–252 (2015)

    Article  Google Scholar 

  47. Perrot, M., Habrard, A.: Regressive virtual metric learning. In: Proceedings of the Advances in Neural Information Processing Systems, pp. 1810–1818 (2015)

  48. Fisher, R.A.: The use of multiple measurements in taxonomic problems. Ann. Hum. Genet. 7, 179–188 (1936)

    Google Scholar 

  49. Pang, S., Ozawa, S., kasabov, N.: Incremental linear discriminant analysis for classification of data streams. IEEE Trans. Syst. Man Cybern. B Cybern. 35, 905–914 (2005)

    Article  Google Scholar 

  50. Loy, C.C., Xiang, T., Gong, S.: Time-delayed correlation analysis for multi-camera activity understanding. Int. J. Comput. Vis. 90, 106–129 (2010)

    Article  Google Scholar 

  51. Roth, P.M., Hirzer, M., Köstinger, M., Beleznai, C., Bischof, H.: Mahalanobis distance learning for person re-identification. In: Gong, S., Cristani, M., Yan, S., Loy, C.C. (eds.) Person Re-Identfication, pp. 247–267. Springer, Berlin (2014)

    Chapter  Google Scholar 

  52. Liao, S., Zhao, G., Kellokumpu, V., Pietikainen, M., Li, S.Z.: Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1301–1306 (2010)

Download references

Acknowledgements

This research was supported by the National Natural Science of Foundation of China (Nos. 61501177, 61772455, 61363022, 61572486, U1713213), Guangzhou Key Laboratory (No. 201605030014), Guangzhou University’s training program for excellent newly recruited doctors (No. YB201712), the Yunnan Natural Science Funds (No. 2016FB105), the Program for Excellent Young Talents of Yunnan University (No. WX069051) and the Project of Innovative Research Team of Yunnan Province.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dapeng Tao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, Z., Hu, X., Dai, F. et al. Person re-identification by discriminant analytical least squares metric learning. Machine Vision and Applications 29, 1019–1031 (2018). https://doi.org/10.1007/s00138-018-0917-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-018-0917-z

Keywords

Navigation