The "Bottleneck" Behaviours in Linear Feedforward Neural Network Classifiers and Their Breakthrough

The classification mechanisms of linear feedforward neural network classifiers (FNNC), whose hidden layer performs the Fisher linear transformation of the input patterns, under the supervision of outer-supervised signals are inves- tigated. The "bottleneck" behaviours in linear FNNCs are observed and analyzed. In addition, the structure stabilities of the linear FNNCs are also discussed. It is pointed out that the key point to break through the "bottleneck" behaviours for lin- ear FNNCs is to change linear …