Abstract
We introduce a neural network for the analysis of local independent components of an input signal. The network is a modification of Kohonen's adaptive-subspace self-organizing map. The map units consist of weight matrices adapted to represent linear transformations which locally minimize statistical dependence among pattern vector components. Training of the map is carried out in episodes comprising pattern vectors sampled from adjacent time instants or spatial locations. The use of episodes produces independent directions which are preserved in translations of the input signal. The independent components modeled by each map unit are estimated with a nonlinear Hebbian-like learning rule, which searches for weight vectors maximizing a measure of non-Gaussianity of the scalar product of weight and pattern vectors. For demonstration, the method was applied to the segmentation of a composition image of four periodic texture fields. The spatial convolution masks, created by the map for the extraction of independent components, represent distinct frequences of particular directions.
Preview
Unable to display preview. Download preview PDF.
References
P. Comon. Independent component analysis, A new concept? Signal Processing, 36(3):287–314, April 1994.
J. Hurri, A. Hyvärinen, and E. Oja. Wavelets and natural image statistics. In Proceedings of the 10th Scandinavian Conference on Image Analysis, volume I, pages 13–18, Lappeenranta, Finland, June 9–11 1997.
A. Hyvärinen and E. Oja. Independent component analysis by general non-lineal Hebbian-like learning rules. Submitted to Signal Processing, 1997. Available as an Internet resource: http://nucleus.hut.fl/∢apo/pub.html.
J. Karhunen, E. Oja, L. Wang, R. Vigário, and J. Joutsensalo. A class of neural networks for independent component analysis. IEEE Transactions on Neural Networks, 8(3), May 1997.
T. Kohonen. Self-Organizing Maps. Springer-Verlag, Berlin, 1995.
T. Kohonen. Emergence of invariant-feature detectors in the adaptive-subspace self-organizing map. Biological Cybernetics, 75:281–291, 1996.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Oja, E., Valkealahti, K. (1997). Local independent component analysis by the self-organizing map. In: Gerstner, W., Germond, A., Hasler, M., Nicoud, JD. (eds) Artificial Neural Networks — ICANN'97. ICANN 1997. Lecture Notes in Computer Science, vol 1327. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0020212
Download citation
DOI: https://doi.org/10.1007/BFb0020212
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-63631-1
Online ISBN: 978-3-540-69620-9
eBook Packages: Springer Book Archive