Ce Zhan
Skip Abstract Section
Abstract
Getting familiar with a face is an important cognitive process in human perception of faces, but little study has been reported on how to objectively measure the degree of familiarity. In this article, a method is proposed to quantitatively measure the familiarity of a face with respect to a set of reference faces that have been seen previously. The proposed method models the context-free and context-dependent forms of familiarity suggested by psychological studies and accounts for the key factors, namely exposure frequency, exposure intensity and similar exposure, that affect human perception of face familiarity. Specifically, the method divides the reference set into nonexclusive groups and measures the familiarity of a given face by aggregating the similarities of the face to the individual groups. In addition, the nonnegative matrix factorization (NMF) is extended in this paper to learn a compact and localized subspace representation for measuring the similarities of the face with respect to the individual groups. The proposed method has been evaluated through experiments that follow the protocols commonly used in psychological studies and has been compared with subjective evaluation. Results have shown that the proposed measurement is highly consistent with the subjective judgment of face familiarity. Moreover, a face recognition method is devised using the concept of face familiarity and the results on the standard FERET evaluation protocols have further verified the efficacy of the proposed familiarity measurement.
- Ahonen, T., Hadid, A., and Pietikäinen, M. 2006. Face description with local binary patterns: Application to face recognition. IEEE Trans. Patt. Anal. Mach. Intell. 28, 12, 2037--2041. Google Scholar
Digital Library
- Bekios-Calfa, J., Buenaposada, J. M., and Baumela, L. 2011. Revisiting linear discriminant techniques in gender recognition. IEEE Trans. Patt. Anal. Mach. Intell. 33, 4, 858--864. Google ScholarDigital Library
- Belhumeur, P. N., Hespanha, J., and Kriegman, D. 1997. Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection. IEEE Trans. Patt. Anal. Mach. Intell. 19, 7, 711--720. Google ScholarDigital Library
- Bertsekas, D. P. 1976. On the Goldstein-Levitin-Polyak gradient projection method. IEEE Trans. Automat. Cont. 21, 174--184.Google ScholarCross Ref
- Bertsekas, D. P. 1999. Nonlinear Programming. Athena Scientific.Google Scholar
- Bicego, M., Grosso, E., Lagorio, A., Brelstaff, G., Brodo, L., and Tistarelli, M. 2008. Distinctiveness of faces: A computational approach. ACM Trans. Appl. Percep. 5, 2. Google ScholarDigital Library
- Bruyer, R., Mejiasa, S., and Doubleta, S. 2007. Effect of face familiarity on age decision. Acta Psychologica 124, 2, 159--176.Google ScholarCross Ref
- Cai, D., He, X., Han, J., and Huang, T. S. 2001. Graph regularized non-negative matrix factorization for data representation. IEEE Trans. Patt. Anal. Mach. Intell. 33, 8, 1548--1560. Google ScholarDigital Library
- Fasel, B. and Luttin, J. 2003. Automatic facial expression analysis: Survey. Patt. Recog. 36, 1, 259--275.Google ScholarCross Ref
- Frischholz, R. and Dieckmann, U. 2000. BioID: A multimodal biometric identification system. Computer. 33, 2, 64--68. Google ScholarDigital Library
- Fu, Y., Guo, G., and Huang, T. S. 2010. Age synthesis and estimation via faces: A survey. IEEE Trans. Patt. Anal. Mach. Intell. 32, 11, 1955--1976. Google ScholarDigital Library
- Geng, X., Zhou, Z.-H., and Smith-Miles, K. 2007. Automatic age estimation based on facial aging patterns. IEEE Trans. Patt. Anal. Mach. Intell. 29, 12, 2234--2240. Google ScholarDigital Library
- Gu, W., Xiang, G., Venkatesh, Y. V., Huang, D., and Lin, H. 2012. Facial expression recognition using radial encoding of local Gabor features and classifier synthesis. J. Patt. Recog. 45, 80--91. Google ScholarDigital Library
- Guan, N., Tao, D., Luo, Z., and Yuan, B. 2011. Manifold regularized discriminative nonnegative matrix factorization with fast gradient descent. IEEE Trans. Image Proc. 20, 7, 2030--2048. Google ScholarDigital Library
- Hoyer, P. O. 2004. Non-negative matrix factorization with sparseness constraints. J. Mach. Learn. Res. 5, 5, 1457--1469. Google ScholarDigital Library
- http://www.fantamorph.com/.Google Scholar
- Huynh-Thu, Q. and Ghanbari, M. 2008. Scope of validity of PSNR in image/video quality assessment. Electron. Lett. 44, 13, 800--801.Google ScholarCross Ref
- Kendall, M. and Gibbons, J. D. 1990. Rank Correlation Methods. Edward Arnold.Google Scholar
- Kinen, E. M. and Raisamo, R. 2008. Evaluation of gender classification methods with automatically detected and aligned faces. IEEE Trans. Patt. Anal. Mach. Intell. 30, 3, 541--547. Google ScholarDigital Library
- Lee, D. D. and Seung, H. S. 1999. Learning the parts of objects by non-negative matrix factorization. Nature. 401, 788--791.Google ScholarCross Ref
- Lee, D. D. and Seung, H. S. 2000. Algorithms for non-negative matrix factorization. In Proceedings of NIPS 2000. 556--562.Google Scholar
- Lee, D. D. and Seung, H. S. 2001. Algorithms for non-negative matrix factorization. Adv. Neural Inf. Proc. Syst. 13, 556--562.Google Scholar
- Li, S. Z., Hou, X., Zhang, H., and Cheng, Q. 2001. Learning spatially localized, parts-based representation. In Proceedings of CVPR 2001. Vol. 1. 207--212.Google Scholar
- Li, S. Z. and Jain, A. K. 2004. Handbook of Face Recognition. Springer. Google ScholarDigital Library
- Lin, C.-J. 2007a. On the convergence of multiplicative update algorithms for nonnegative matrix factorization. IEEE Trans. Neural. Netw. 18, 6, 1589--1596. Google ScholarDigital Library
- Lin, C.-J. 2007b. Projected gradient methods for nonnegative matrix factorization. Neur. Comput. 19, 10, 2756--2779. Google ScholarDigital Library
- Lin, C.-J. and More, J. J. 1999. Newton's method for large-scale bound constrained problems. SIAM J. Optimiz. 9, 1100--1127. Google ScholarDigital Library
- Liu, X., Yan, S., and Jin, H. 2010. Projective nonnegative graph embedding. IEEE Trans. Image Proc. 19, 5, 1126--1137. Google ScholarDigital Library
- Mandler, G. 1980. Recognizing: The judgement of previous occurrence. Psyc. Rev. 87, 252--271.Google ScholarCross Ref
- Martinez, A. and Benavente, R. 1998. The AR face database. Tech. rep. 24, CVC.Google Scholar
- Naseem, I., Togneri, R., and Bennamoun, M. 2010. Linear regression for face recognition. IEEE Trans. Patt. Anal. Mach. Intell. 32, 11, 2106--2112. Google ScholarDigital Library
- Paatero, P. and Tapper, U. 1994. Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values. Environmetrics 5, 2, 1180--4009.Google ScholarCross Ref
- Pantic, M. and Rothkrantz, L. 2000. Automatic analysis of facial expressions: the state of the art. IEEE Trans. Patt. Anal. Mach. Intell. 22, 12, 1424--1445. Google ScholarDigital Library
- Phillips, P., Wechsler, H., Huang, J., and Rauss, P. 1998. The FERET database and evaluation procedure for face recognition algorithms. Image Vis. Comp. 16, 295--306.Google ScholarCross Ref
- Rakover, S. S. and Cahlon, B. 2001. Face recognition: Cognitive and Computational Processes. (Illustrated Ed). John Benjamins Publishing Company.Google Scholar
- Rossion, B. 2002. Is sex categorisation from faces really parallel to face recognition? Vis. Cog. 9, 1003--1020.Google Scholar
- Samaria, F. and Harter, A. 1994. Parameterisation of a stochastic model for human face identification. In Proceedings of the 2nd IEEE Workshop on Applications of Computer Vision, 138--142.Google Scholar
- Schwaninger, A., Lobmaier, J. S., Wallraven, C., and Collishaw, S. M. 2009. Two routes to face perception: Evidence from psychophysics and computational modeling. Cog. Sci. 33, 8, 1413--1440.Google ScholarCross Ref
- Sinha, P., Balas, B., Ostrovsky, Y., and Russell, R. 2006. Face recognition by humans: 19 results all computer vision researchers should know about. Proc. IEEE 94, 11, 1948--1962.Google ScholarCross Ref
- Solso, R. and McCarthy, J. 1981. Prototype formation of faces: A case of pseudo-memory. British J. Psych. 72, 499--503.Google ScholarCross Ref
- Stein, S. and Fink, G. A. 2011. A new method for combined face detection and identification using interest point descriptors. In Proceedings of FG 2011.Google Scholar
- Tistarelli, M., Bicego, M., and Grosso, E. 2009. Dynamic face recognition: From human to machine vision. Image Vision Comput. 27, 3, 222--232. Google ScholarDigital Library
- Turk, M. and Pentland, A. 1991. Eigenfaces for recognition. J. Cognit. Neurosci. 3, 1, 71--76. Google ScholarDigital Library
- Valentine, T. 1991. A unified account of the effects of distinctiveness, inversion, and race in face recognition. Quart. J. Exper. Psych. 43, A, 161--204.Google ScholarCross Ref
- Viola, P. and Jones, M. 2004. Robust real-time object detection. Int. J. Comput. Vis. 57, 2, 137--154. Google ScholarDigital Library
- Wallis, G., Siebeck, U. E., Swann, K., Blanz, V., and Bülthoff, H. H. 2008. The prototype effect revisited: Evidence for an abstract feature model of face recognition. J. Vis. 8, 3, Art. 20.Google ScholarCross Ref
- Wang, C., Song, Z., Yan, S., Zhang, L., and Zhang, H. 2009. Multiplicative nonnegative graph embedding. In Proceedings of CVPR 2009. Vol. 5. 389--396.Google Scholar
- Wiskott, L., Fellous, J., Kuiger, N., and von der Malsburg, C. 1997. Face recognition by elastic bunch graph matching. IEEE Trans. Patt. Anal. Mach. Intell. 19, 775--779. Google ScholarDigital Library
- Yang, J., Yang, S., Fu, Y., Li, X., and Huang, T. 2008. Non-negative graph embedding. In Proceedings of CVPR 2008. 1--8.Google Scholar
- Yonelinas, A. P. 2002. The nature of recollection and familiarity: A review of 30 years of research. J. Memory Lang. 46, 441517.Google ScholarCross Ref
- Zafeiriou, S., Tefas, A., Buciu, I., and Pitas, I. 2006. Exploiting discriminant information in nonnegative matrix factorization with application to frontal face verification. IEEE Trans. Neural Netw. 17, 3, 683--695. Google ScholarDigital Library
- Zhan, C., Li, W., Ogunbona, P., and Safaei, F. 2007. Real-time facial feature point extraction. Adv. Multimed. Inf. Proc. (PCM2007). Lecture Notes in Computer Science, vol. 4810, Springer 88--97. Google ScholarDigital Library
- Zhang, T., Fang, B., Tang, Y. Y., He, G., and Wen, J. 2008. Topology preserving non-negative matrix factorization for face recognition. IEEE Trans. Image Proc. 17, 574--584. Google ScholarDigital Library
- Zhao, W., Chellappa, R., Rosenfeld, A., and Phillips, P. 2003. Face recognition: A literature survey. ACM Comput. Surv. 35, 4, 399--458. Google ScholarDigital Library
- Zhi, R., Flierl, M., Ruan, Q., and Kleijn, W. B. 2011. Graph-preserving sparse nonnegative matrix factorization with application to facial expression recognition. IEEE Trans. Syst. Man. Cybern. Part B 41, 38--52. Google ScholarDigital Library
Index Terms
- Measuring the degree of face familiarity based on extended NMF
Recommendations
Automatic face analysis system based on face recognition and facial physiognomy
ICHIT'06: Proceedings of the 1st international conference on Advances in hybrid information technologyAn automatic face analysis system is proposed which uses face recognition and facial physiognomy. It first detects human's face, extracts its features, and classifies the shape of facial features. It will analyze the person's facial physiognomy and then ...
Color Face Recognition Based on Revised NMF Algorithm
FITME '09: Proceedings of the 2009 Second International Conference on Future Information Technology and Management EngineeringColor face image is composed of color information of different channels. Color image provides more information for face recognition task compared with grey scale image. A novel approach coined block diagonal non-negative matrix factorization (BDNMF) is ...
Face recognition under varying illumination using gradientfaces
In this correspondence, we propose a novel method to extract illumination insensitive features for face recognition under varying lighting called the Gradientfaces. Theoretical analysis shows Gradientfaces is an illumination insensitive measure, and ...
Comments