Abstract
This paper aims at exploring the behavior of the sensitivity for an ensemble of Madalines. An algorithm is first given to compute the Madalines’ sensitivity, and its efficiency is verified by computer simulations. Then, based on the algorithm, the sensitivity analysis is conducted, which shows that the dimension of input has little effect on the sensitivity as long as the dimension is sufficient large, and the increases in the number of Adalines in a layer and the number of layers will lead the sensitivity to increase under an upper bound. The analysis results will be useful for designing robust Madalines.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Stevenson, M., Winter, R., Widrow, B.: Sensitivity of Feedforward Neural Networks to Weight Errors. IEEE Trans. on Neural Networks 1(1), 71–80 (1990)
Choi, J.Y., Choi, C.H.: Sensitivity Analysis of Multilayer Perceptron with Differentiable Activation Functions. IEEE Trans. on Neural Networks 3(1), 101–107 (1992)
Fu, L., Chen, T.: Sensitivity Analysis for Input Vector in Multilayer Feedforward Neural Networks. In: Proc. of IEEE Int. Conf. on Neural Networks, vol. 1, pp. 215–218 (1993)
Piché, S.W.: The Selection of Weight Accuracies for Madalines. IEEE Trans. on Neural Networks 6(2), 432–445 (1995)
Oh, S.H., Lee, Y.: Sensitivity Analysis of a Single Hidden-Layer Neural Networks with Threshold Function. IEEE Trans. on Neural Networks 6(4), 1005–1007 (1995)
Zeng, X., Yeung, D.S.: Sensitivity Analysis of Multilayer Perceptron to Input and Weight Perturbations. IEEE Trans. on Neural Networks 12(6), 1358–1366 (2001)
Zeng, X., Yeung, D.S.: A Quantified Sensitivity Measure for Multilayer Perceptron to Input Perturbation. Neural Computation 15(1), 183–212 (2003)
Wang, Y., Zeng, X., Han, L.: Sensitivity of Madalines to Input and Weight Perturbations. In: Proceedings of IEEE International Conference on Machine Learning and Cybernetics, November 2003, pp. 1349–1354 (2003)
Gong, J., Zhao, G.: An approximate algorithm for bivariate normal integral. Computational Structural Mechanics and Applications 13(4), 494–497 (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, Y., Zeng, X., Yeung, D.S. (2006). Sensitivity Analysis of Madalines to Weight Perturbation. In: Yeung, D.S., Liu, ZQ., Wang, XZ., Yan, H. (eds) Advances in Machine Learning and Cybernetics. Lecture Notes in Computer Science(), vol 3930. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11739685_86
Download citation
DOI: https://doi.org/10.1007/11739685_86
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33584-9
Online ISBN: 978-3-540-33585-6
eBook Packages: Computer ScienceComputer Science (R0)