Abstract
The Pseudo Fisher Linear Discriminant (PFLD) based on a pseudo-inverse technique shows a peaking behaviour of the generalisation error for training sample sizes that are about the feature size: with an increase in the training sample size, the generalisation error first decreases, reaching a minimum, then increases, reaching a maximum at the point where the training sample size is equal to the data dimensionality, and afterwards begins again to decrease. A number of ways exist to solve this problem. In this paper, it is shown that noise injection by adding redundant features to the data is similar to other regularisation techniques, and helps to improve the generalisation error of this classifier for critical training sample sizes.
Similar content being viewed by others
Author information
Authors and Affiliations
Additional information
Received: 10 November 1998¶Received in revised form: 7 January 1999¶Accepted: 7 January 1999
Rights and permissions
About this article
Cite this article
Skurichina, M., Duin, R. Regularisation of Linear Classifiers by Adding Redundant Features. Pattern Analysis & Applications 2, 44–52 (1999). https://doi.org/10.1007/s100440050013
Published:
Issue Date:
DOI: https://doi.org/10.1007/s100440050013