Abstract
We have recently developed an extension of a Principal Component Analysis Artificial Neural Network which we have linked to the statistical technique of Factor Analysis. The learning rule can be shown to be optimal for data sets corrupted by Gaussian noise. We now derive from a new cost function a novel learning rule which is optimal for a standard data set. We compare both rules on a data set composed of 10 faces in a mixture of poses. The first learning rule performs best on the face data. Our conclusion is that the first rule which is optimal for Gaussian noise is more generally useful but that specific rules may be optimal for finding the independent factors underlying specific data sets dependent on the noise in the data set.
Similar content being viewed by others
References
Charles, D. and Fyfe, C.: Modelling multiple cause structure using rectification constraints. Network: Computation in Neural Systems, 1998.
Földiák, P.: Models of Sensory Coding, PhD thesis, University of Cambridge. 1992.
Fyfe, C.: Pca properties of interneurons. In:From Neurobiology to Real World Computing, ICANN 93, pp. 183-188, 1993.
Hinton, G. E., Dayan, P. and Revow, M.: Modelling the manifolds of images of handwritten digits. IEEE Transactions on Neural Networks, 8(1) (1997) 65-74.
Karhunen, J. and Joutsensalo, J.: Representation and separation of signals using nonlinear pca type learning, Neural Networks, 7(1) (1994) 113-127.
Oja, E.: Neural networks, principal components and subspaces. International Journal of Neural Systems, 1 (1989) 61-68.
Smola, A. J. and Scholkopf, B.: A tutorial on support vector regression. Technical Report NC2-TR-1998-030, NeuroCOLT2 Technical Report Series, 1998.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Lai, P.L., Fyfe, C. Simultaneous Identification of Face and Orientation. Neural Processing Letters 12, 33–40 (2000). https://doi.org/10.1023/A:1009669814346
Issue Date:
DOI: https://doi.org/10.1023/A:1009669814346