Abstract.
The CSU Face Identification Evaluation System includes standardized image preprocessing software, four distinct face recognition algorithms, analysis tools to study algorithm performance, and Unix shell scripts to run standard experiments. All code is written in ANSII C. The four algorithms provided are principle components analysis (PCA), a.k.a eigenfaces, a combined principle components analysis and linear discriminant analysis algorithm (PCA + LDA), an intrapersonal/extrapersonal image difference classifier (IIDC), and an elastic bunch graph matching (EBGM) algorithm. The PCA + LDA, IIDC, and EBGM algorithms are based upon algorithms used in the FERET study contributed by the University of Maryland, MIT, and USC, respectively. One analysis tool generates cumulative match curves; the other generates a sample probability distribution for recognition rate at recognition rank 1, 2, etc., using Monte Carlo sampling to generate probe and gallery choices. The sample probability distributions at each rank allow standard error bars to be added to cumulative match curves. The tool also generates sample probability distributions for the paired difference of recognition rates for two algorithms. Whether one algorithm consistently outperforms another is easily tested using this distribution. The CSU Face Identification Evaluation System is available through our Web site and we hope it will be used by others to rigorously compare novel face identification algorithms to standard algorithms using a common implementation and known comparison techniques.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bartlett MS, Draper B, Baek K, Beveridge R (July 2003) Recognizing faces with pca and ica. Comput Vision Image Understand 91:115-137
Beveridge JR (2003) Evaluation of face recognition algorithms Web site. +http: www.cs.colostate.edu+
Beveridge JR (2001) The geometry of LDA and PCA classifiers illustrated with 3D examples. Technical Report CS-01-101, Computer Science, Colorado State University
Beveridge JR, Bolme D, Teixeira M, Draper BA (2003) The CSU Face Identification Evaluation System User’s Guide: Version 5.0. Technical report, Colorado State University
Beveridge JR, She K, Draper B, Givens GH (December 2001) A nonparametric statistical comparison of principal component and linear discriminant subspaces for face recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 535-542
Blackburn DM, Bone M, Phillips PJ (2003) Facial Recognition Vendor Test 2000: executive overview. Technical report, Face Recognition Vendor Test (www.frvt.org)
Bolme DS (June 2003) Elastic bunch graph matching. Master’s thesis, Computer Science, Colorado State University
Duda RO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New York
Givens G, Beveridge JR, Draper BA, Phillips PJ, Grother P (2004) How features of the human face affect recognition: a statistical comparison of three face recognition algorithms. In: Proceedings of the IEEE conference on computer vision and pattern recognition 2004 (to appear)
Givens GH, Beveridge JR, Draper BA, Bolme D (2003) Using a generalized linear mixed model to study the configuration space of a PCA+LDA human face recognition algorithm. Technical report, Computer Science, Colorado State University
Micheals RJ, Boult T (December 2001) Efficient evaluation of classification and recognition systems. In: Proceedings of the IEEE conference on computer vision and pattern recognition 2001, I:50-57
Moghaddam B, Nastar C, Pentland A (1996) A Bayesian similarity measure for direct image matching. In: Proceedings of ICPR, B:350-358
Moon H, Phillips J (1998) Analysis of pca-based face recognition algorithms. In: Boyer K, Phillips J (eds) Empirical evaluation techniques in computer vision. IEEE Press, New York
Okada K, Steffens J, Maurer T, Hong H, Elagin E, Neven H, von der Malsburg C (1998) The Bochum/USC face recognition system and how it fared in the FERET Phase III test. In: Wechsler H, Phillips PJ, Bruce V, Soulié FF, Huang TS (eds) Face recognition: from theory to applications. Springer, Berlin Heidelberg New York, pp 186-205
Phillips PJ, Moon HJ, Rizvi SA, Rauss PJ (October 2000) The FERET evaluation methodology for face-recognition algorithms. Trans Pattern Anal Mach Intell 22(10):1090-1104
Phillips PJ, Grother P, Micheals RJ, Blackburn DM, Tabassi E, Bone JM (2002) FRVT 2002: overview and summary. Technical report, Face Recognition Vendor Test 2002 (www.frvt.org)
Teixeira ML (July 2003) The Bayesian intrapersonal/extrapersonal classifier. Master’s thesis, Computer Science, Colorado State University
Turk MA, Pentland AP (June 1991) Face recognition using eigenfaces. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 586 - 591
Yambor WS (2000) Analysis of PCA-based and Fisher discriminant-based image recognition algorithms. Master’s thesis, Colorado State University
Zhao W, Chellappa R, Krishnaswamy A (1998) Discriminant analysis of principal components for face recognition. In: Wechsler, Philips, Bruce, Fogelman-Soulie, Huang (eds) Face recognition: from theory to applications, Springer, Berlin Heidelberg New York, pp 73-85
Zhao W, Chellappa R, Phillips PJ (1999) Subspace linear discriminant analysis for face recognition. University of Maryland, Computer Science Department
Author information
Authors and Affiliations
Corresponding author
Additional information
Published online: 20 August 2004
Correspondence to: J. Ross Beveridge
Rights and permissions
About this article
Cite this article
Beveridge, J.R., Bolme, D., Draper, B.A. et al. The CSU Face Identification Evaluation System. Machine Vision and Applications 16, 128–138 (2005). https://doi.org/10.1007/s00138-004-0144-7
Issue Date:
DOI: https://doi.org/10.1007/s00138-004-0144-7