Learning in Neural Network – Unusual Effects of “Artificial Dreams”

Abstract

Most researchers focused on particular result ignore intermediate stages of learning process of neural networks. The unstable and transitory phenomena, discovered in neural networks during the learning process, long time after the initial stage of learning, when the network knows nothing because of random values of all weights, and long time before final stage of learning process, when the network knows (almost) everything – can be very interesting, especially when we can associate with them some psychological interpretations. Some "immature" neurons exhibit behavior that can be interpreted as source of "artificial dreams". Article presents examples of simple neural networks with capabilities which might explain the origins of dreams and myths.