Abstract
Person re-identification methods seek robust person matching through combining feature types. Often, these features are assigned implicitly with a single vector of global weights, which are assumed to be universally and equally good for matching all individuals, independent of their different appearances. In this study, we present a comprehensive comparison and evaluation of up-to-date imagery features for person re-identification. We show that certain features play more important roles than others for different people. To that end, we introduce an unsupervised approach to learning a bottom-up measurement of feature importance. This is achieved through first automatically grouping individuals with similar appearance characteristics into different prototypes/clusters. Different features extracted from different individuals are then automatically weighted adaptively driven by their inherent appearance characteristics defined by the associated prototype. We show comparative evaluation on the re-identification effectiveness of the proposed prototype-sensitive feature importance-based method as compared to two generic weight-based global feature importance methods. We conclude by showing that their combination is able to yield more accurate person re-identification.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Since HSV and YCbCr share similar luminance/brightness channel, dropping one of them results in a total of 8 channels.
References
Alahi, A., Vandergheynst, P., Bierlaire, M., Kunt, M.: Cascade of descriptors to detect and track objects across any network of cameras. Comput. Vis. Image Underst. 114(6), 624–640 (2010)
Avraham, T., Gurvich, I., Lindenbaum, M., Markovitch, S.: Learning implicit transfer for person re-identification. In: European Conference on Computer Vision, First International Workshop on Re-Identification, pp. 381–390 (2012)
Bak, S., Corvee, E., Bremond, F., Thonnat, M.: Multiple-shot human re-identification by mean Riemannian covariance grid. In: IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 179–184 (2011)
Bak, S., Corvee, E., Brémond, F., Thonnat, M.: Person re-identification using haar-based and DCD-based signature. In: IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 1–8 (2010)
Bak, S., Corvee, E., Brémond, F., Thonnat, M.: Person re-identification using spatial covariance regions of human body parts. In: IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 435–440 (2010)
Bak. S., Charpiat, G., Corvée, E., Brémond, F., Thonnat, M.: Learning to match appearances by correlations in a covariance metric space. In: European Conference on Computer Vision, pp. 806–820 (2012)
Bauml, M., Stiefelhagen, R.: Evaluation of local features for person re-identification in image sequences. In: IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 291–296 (2011)
Bazzani, L., Cristani, M., Perina, A., Murino, V.: Multiple-shot person re-identification by chromatic and epitomic analyses. Pattern Recogn. Lett. 33(7), 898–903 (2012)
Bazzani, L., Cristani, M., Murino, V.: Symmetry-driven accumulation of local features for human characterization and re-identification. Comput. Vis. Image Underst. 117(2), 130–144 (2013)
Berg, T.L., Berg, A.C., Shih, J.: Automatic attribute discovery and characterization from noisy web data. In: European Conference on Computer Vision, pp. 663–676 (2010)
Breiman, L., Friedman, J., Stone, C., Olshen, R.: Classification and regression trees. Chapman and Hall/CRC, Boca Raton (1984)
Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)
Caruana, R., Karampatziakis, N., Yessenalina, A.: An empirical evaluation of supervised learning in high dimensions. In: International Conference on, Machine learning, pp. 96–103 (2008)
Cheng, D., Cristani, M., Stoppa, M., Bazzani, L., Murino, V.: Custom pictorial structures for re-identification. In: British Machine Vision Conference, pp. 68.1–68.11 (2011)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. IEEE Comput. Vis. Pattern Recogn. 1, 886–893 (2005)
Doretto, G., Sebastian, T., Tu, P., Rittscher, J.: Appearance-based person reidentification in camera networks: problem overview and current approaches. J. Ambient Intell. Humanized Comput. 2(2), 127–151 (2011)
Farenzena, M., Bazzani, L., Perina, A., Murino, V., Cristani, M.: Person re-identification by symmetry-driven accumulation of local features. In: IEEE Conference Computer Vision and, Pattern Recognition, pp. 2360–2367 (2010)
Farhadi, A., Endres, I., Hoiem, D., Forsyth, D.: Describing objects by their attributes. In: IEEE Conference on Computer Vision and, Pattern Recognition, pp. 1778–1785 (2009)
Gray, D., Tao, H.: Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: European Conference on Computer Vision, pp. 262–275 (2008)
Hirzer, M., Beleznai, C., Roth, P., Bischof, H.: Proceedings of the 17th Scandinavian Conference on Image Analysis, Springer-Verlag, 91–102 (2011)
Hirzer, M., Roth, P., Köstinger, M., Bischof, H.: Relaxed pairwise learned metric for person re-identification. In: European Conference on Computer Vision, pp. 780–793 (2012)
Javed, O., Rasheed, Z., Shafique, K., Shah, M.: Tracking across multiple cameras with disjoint views. In: International Conference on Computer Vision, pp. 952–957 (2003)
Layne, R., Hospedales, T., Gong, S.: Person re-identification by attributes. In: British Machine Vision Conference (2012)
Liu, C., Wang, G., Lin, X.: Person re-identification by spatial pyramid color representation and local region matching. IEICE Trans. Inf. Syst. E95-D(8), 2154–2157 (2012)
Liu, B., Xia, Y., Yu, P.S.: Clustering through decision tree construction. In: International Conference on Information and, Knowledge Management, pp. 20–29 (2000)
Loy, C.C., Liu, C., Gong, S.: Person re-identification by manifold ranking. In: IEEE International Conference on Image Processing (2013)
Loy, C.C., Xiang, T., Gong, S.: Time-delayed correlation analysis for multi-camera activity understanding. Int. J. Comput. Vis. 90(1), 106–129 (2010)
Loy, C.C., Xiang, T., Gong, S.: Incremental activity modelling in multiple disjoint cameras. IEEE Trans. Pattern Anal. Mach. Intell. 34(9), 1799–1813 (2012)
Ma, S., Sclaroff, S., Ikizler-Cinbis, N.: Unsupervised learning of discriminative relative visual attributes. In: European Conference on Computer Vision, Workshops and Demonstrations, pp. 61–70 (2012)
Mignon, A., Jurie, F.: PCCA: A new approach for distance learning from sparse pairwise constraints. In: IEEE Conference Computer Vision and, Pattern Recognition, pp. 2666–2672 (2012)
Ng, A.Y., Jordan, M.I., Weiss, Y., et al.: On spectral clustering: analysis and an algorithm. Adv. Neural Inf. Process. Syst. 2, 849–856 (2002)
Perona, P., Zelnik-Manor, L.: Self-tuning spectral clustering. Adv. Neural Inf. Process. Syst. 17, 1601–1608 (2004)
Prosser, B., Zheng, W., Gong, S., Xiang, T.: Person re-identification by support vector ranking. In: British Machine Vision Conference, pp. 21.1–21.11 (2010)
Satta, R., Fumera, G., Roli, F.: Fast person re-identification based on dissimilarity representations. Pattern Recogn. Lett. 33(14), 1838–1848 (2012)
Schulter, S., Wohlhart, P., Leistner, C., Saffari, A., Roth, P.M., Bischof, H.: Alternating decision forests. In: IEEE Conference Computer Vision and Pattern Recognition (2013)
Schwartz, W., Davis, L.: Learning discriminative appearance-based models using partial least squares. In: Brazilian Symposium on, Computer Graphics and Image Processing, pp. 322–329 (2009)
Wang, X.G., Doretto, G., Sebastian, T., Rittscher, J., Tu, P.: Shape and appearance context modeling. In: International Conference on Computer Vision, pp. 1–8 (2007)
Xiang, T., Gong, S.: Spectral clustering with eigenvector selection. Pattern Recogn. 41(3), 1012–1029 (2008)
Zhang, Y., Li, S.: Gabor-LBP based region covariance descriptor for person re-identification. In: International Conference on Image and Graphics, pp. 368–371 (2011)
Zheng, W., Gong, S., Xiang, T.: Associating groups of people. In: British Machine Vision Conference, pp. 23.1–23.11 (2009)
Zheng, W., Gong, S., Xiang, T.: Re-identification by relative distance comparison. IEEE Trans. Pattern Anal. Mach. Intell. 35(3), 653–668 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag London
About this chapter
Cite this chapter
Liu, C., Gong, S., Loy, C.C., Lin, X. (2014). Evaluating Feature Importance for Re-identification. In: Gong, S., Cristani, M., Yan, S., Loy, C. (eds) Person Re-Identification. Advances in Computer Vision and Pattern Recognition. Springer, London. https://doi.org/10.1007/978-1-4471-6296-4_10
Download citation
DOI: https://doi.org/10.1007/978-1-4471-6296-4_10
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-6295-7
Online ISBN: 978-1-4471-6296-4
eBook Packages: Computer ScienceComputer Science (R0)