Neocognitron Trained by Winner-Kill-Loser with Triple Threshold

Abstract

The neocognitron is a hierarchical, multi-layered neural network capable of robust visual pattern recognition. The neocognitron acquires the ability to recognize visual patterns through learning. The winner-kill-loser is a recently introduced competitive learning rule that has been shown to improve the neocognitron’s performance in character recognition. This paper proposes an improved winner-kill-loser rule, in which we use a triple threshold, instead of the dual threshold used as part of the conventional winner-kill-loser. It is shown theoretically, and also by computer simulation, that the use of a triple threshold makes the learning process more stable. In particular, a high recognition rate can be obtained with a smaller network.