Selforganizing memory: active learning of landmarks used for navigation

Abstract

We propose a memory architecture that is suited to solve a specific task, namely homing, that is finding a not directly visible home place by using visually accessible landmarks. We show that an agent equipped with such a memory structure can autonomously learn the situation and can later use its memory to accomplish homing behaviour. The architecture is based on neuronal structures and grows in a self-organized way depending on experience. The basic architecture consists of three parts, (i) a pre-processor, (ii) a simple, one-layered feed-forward network, called distributor net, and (iii) a full recurrently connected net for representing the situation models to be stored. Apart from Hebbian learning and a local version of the delta-rule, explorative learning is applied that is not based on passive detection of correlations, but is actively searching for interesting hypotheses. Hypotheses are spontaneously introduced and are verified or falsified depending on how well the network representing the hypothesis approaches an internal error of zero. The stability of this approach is successfully tested by removal of one landmark or shifting the position of one or several landmarks showing results comparable to those found in biological experiments. Furthermore, we applied noise in two ways. The trained network was either due to sensory noise or to noise applied to the bias weights describing the memory content. Finally, we tested to what extent learning of the weights is affected by noisy input given to the sensor data. The architecture proposed is discussed to have some at least superficial similarity to the mushroom bodies of insects.