Abstract
In previous work, Regularisation by Convolution was proposed to improve the generalisation on regression of Gaussian Radial Basis Function Networks [Molina and Niranjan, 1997]. In this paper, we demonstrate that the same technique can be applied to a more general family of RBF networks called Symmetric-α-Stable function networks (SαS networks) which contains the Gaussian and Cauchy functions as particular cases. We also demonstrate that Regularisation by Convolution can be applied to sigmoidallike function networks obtained by integration of SαS kernels. We illustrate the performance of Regularisation by Convolution on Wahba's toy problem and the probability density estimation of ink in ancient manuscript letters (British library Beowulf manuscript).
This research is sponsored by grant RDD/G/228 from the British Library.
Preview
Unable to display preview. Download preview PDF.
References
Bishop, C. M. (1995). Neural network for Pattern Recognition. Clarendon Press-Oxford, Oxford.
Girosi, F., Jones, M., and Poggio, T. (1995). Regularization theory and neural networks architectures. Neural Computation, 7(2):219–269.
Molina, C. and Niranjan, M. (1997). Generalisation and Regularisation by Gaussian Filter Convolution of Radial Basis Function Networks. To appear in Mathematics of Neural Networks: Models, Algorithms and Applications. Operations Research/Computer Science Interface Series, Kluwer Academic Publishers.
Nikias, C. L. and Shao, M. (1995). Signal Processing with α-stable Distributions and Applications. John Wiley & Sons.
Ripley, B. D. (1996). Pattern Recognition and Neural Networks. Cambridge University Press, Oxford.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Molina, C.G., Fitzgerald, W.J., Rayner, P.J.W. (1997). Regularisation by Convolution in Symmetric-α-Stable function networks. In: Mira, J., Moreno-Díaz, R., Cabestany, J. (eds) Biological and Artificial Computation: From Neuroscience to Technology. IWANN 1997. Lecture Notes in Computer Science, vol 1240. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0032518
Download citation
DOI: https://doi.org/10.1007/BFb0032518
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-63047-0
Online ISBN: 978-3-540-69074-0
eBook Packages: Springer Book Archive