“Live” neuron and optimal learning rule

Abstract

A concept of the live unit as an automatic regulation system with a few admissible states areas in the space of states is considered. Energetic profit of oscillatory behavior consisting in the consecutive transitions of system from one admissible states area to another is shown. It is stated, that external disturbances cause the energy consumption of oscillatory system to decrease. On the basis of this concept and some neurophysiological data, the “live” energy-consuming nonlinear three-state neuron model is proposed and the existence of energy optimal generation frequency v _opt is proved. For the realization of tendency to v _opt the optimal learning rule is proposed, which provides unsupervised learning and interlinked short-term and long-term memories with forgetting. The model proposed explains the genesis of neural network, is promising in the sense of network self-organization and allows to solve the problem of internal activity in the researches on artificial intelligence.