Synonyms
Definition
Performance evaluation assesses accuracy and usability of biometric algorithms or systems. Performance measures are computed for verification, identification, and watch list tasks, in order to either discover the state-of-the-art of biometric technologies or quantify how well a biometric system meets the requirements of specific applications. Evaluation protocols and biometric databases for testing should be carefully designed to avoid biased results or conclusions.
Introduction
In the past several decades, many biometric algorithms and commercial biometrics systems have emerged. Many of them have reported very impressive results on some public or private databases in all kinds of publications. However, it is hard to compare them based only on the reported results, due to the difference in either the evaluation methods or the testing databases they exploited. Actually, these published results often lead to confusion in...
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
NIST: Face recognition vendor test (FRVT). http://www.frvt.org, 2000, 2002, 2004
The fourth international fingerprint verification competition. http://bias.csr.unibo.it/fvc2006/
Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., et al. Overview of the face recognition grand challenge. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR’05), pp. 947–954. IEEE Computer Society, Washington, DC (2005)
Phillips, P.J., Moon, H., Rauss, P., Rizvi, S.A.: The FERET evaluation methodology for face-recognition algorithms. In: Proceedings of the IEEE International conference on Computer Vision and Pattern Recognition (CVPR’97), pp.137–143. IEEE Computer Society, Washington, DC (1997)
Messer, K., Matas, J., Kittler, J., et al.: XM2VTSDB: the extendedM2VTS database. In: Second International Conference on Audio and Video based Biometric Person Authentication, March 1999, Washington, DC (1999)
NIST: Multiple biometrics grand challenge. http://face.nist.gov/mbgc/. Accessed Aug 2008
Phillips, P.J., Martin, A., Wilson, C.L., et al.: An introduction to evaluating biometric systems. IEEE magazine on computer, pp. 56–63 (2000)
NIST: Spoken language technology evaluations. http://www.nist.gov/speech/tests/sre/index.html. Accessed Aug 2008
Gao, W., Cao, B., Shan, S., Chen, X., et al. The CAS-PEAL large-scale chinese face database and baseline evaluations. IEEE Trans. Syst. Man Cybern. (Part A) 38(1), 149–161 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer Science+Business Media, LLC
About this entry
Cite this entry
Shan, S., Chen, X., Gao, W. (2009). Performance Evaluation, Overview. In: Li, S.Z., Jain, A. (eds) Encyclopedia of Biometrics. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-73003-5_211
Download citation
DOI: https://doi.org/10.1007/978-0-387-73003-5_211
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-73002-8
Online ISBN: 978-0-387-73003-5
eBook Packages: Computer ScienceReference Module Computer Science and Engineering