Synonyms
Biometric technology test; Performance testing
Definition
Performance evaluation assesses accuracy and usability of biometric algorithms or systems. Performance measures are computed for verification, identification, and watch list tasks, in order to either discover the state of the art of biometric technologies or quantify how well a biometric system meets the requirements of specific applications. Evaluation protocols and biometric databases for testing should be carefully designed to avoid biased results or conclusions.
Introduction
In the past several decades, many biometric algorithms and commercial biometric systems have emerged. Many of them have reported very impressive results on some public or private databases in all kinds of publications. However, it is hard to compare them based only on the reported results, due to the difference in either the evaluation methods or the testing databases they exploited. Actually, these published results often lead to confusion in...
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
NIST: Face Recognition Vendor Test (FRVT) (2000, 2002, 2004), http://www.frvt.org
The Fourth International Fingerprint Verification Competition (2006), http://bias.csr.unibo.it/fvc2006/
P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer et al., Overview of the face recognition grand challenge, in Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, (IEEE Computer Society, Washington, DC, 2005), pp. 947–954
P.J. Phillips, H. Moon, P. Rauss, S.A. Rizvi, The FERET evaluation methodology for face-recognition algorithms, in Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR’97), San Juan, (IEEE Computer Society, Washington, DC, 1997), pp. 137–143
K. Messer, J. Matas, J. Kittler et al., XM2VTSDB: the extendedM2VTS database, in Second International Conference on Audio and Video Based Biometric Person Authentication, Washington, DC, Mar 1999
NIST: Multiple Biometrics Grand Challenge, http://face.nist.gov/mbgc/. Accessed Aug 2008
P.J. Phillips, A. Martin, C.L. Wilson et al., An introduction to evaluating biometric systems, in IEEE Magazine on Computer, 2000, pp. 56–63
NIST: Spoken Language Technology Evaluations, http://www.nist.gov/speech/tests/sre/index.html. Accessed Aug 2008
W. Gao, B. Cao, S. Shan, X. Chen et al., The CAS-PEAL large-scale chinese face database and baseline evaluations. IEEE Trans. Syst. Man Cybern. (Part A) 38(1), 149–161 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer Science+Business Media New York
About this entry
Cite this entry
Shan, S., Chen, X., Gao, W. (2015). Performance Evaluation, Overview. In: Li, S.Z., Jain, A.K. (eds) Encyclopedia of Biometrics. Springer, Boston, MA. https://doi.org/10.1007/978-1-4899-7488-4_211
Download citation
DOI: https://doi.org/10.1007/978-1-4899-7488-4_211
Published:
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4899-7487-7
Online ISBN: 978-1-4899-7488-4
eBook Packages: Computer ScienceReference Module Computer Science and Engineering