We use cookies to improve your experience with our site.

双向联想记忆网络的进化准松弛算法(EPRBAM)

Evolutionary Pseudo-Relaxation Learning Algorithm for Bidirectional Associative Memory

  • 摘要: 双向联想记忆网络(BAM)因其结构简单并且具有和人脑相似的联想记忆功能而备受关注,并在模式识别领域得到了应用。BAM的准松弛学习算法(PRLAB)保证了BAM能够正确回忆出训练样本集中的所有模式,并且它的快速算法(QLBAM)有效地减少了学习迭代次数。研究中发现,虽然BAM对模式噪声就有一定的鲁棒性,但是即使保持很低的噪声水平(例如输入模式与训练模式只有一个输入神经元的状态不同,而这个神经元的位置是随机的),经多次试验,总会出现联想错误的情况(此时称BAM对此神经元位置的噪声敏感)。研究人员发现BAM对噪声的敏感性与网络的最小输入绝对值(MAV)有关。本文首先针对QLBAM学习算法得到的BAM网络对噪声的敏感性进行了全面研究,引入了敏感神经元和不稳定神经元的概念,分析了这两种神经元对BAM网络抗噪能力的影响,接着通过这两种神经元出现的概率作为桥梁,证明了BAM的抗噪声能力不仅与输入最小绝对值(MAV)有关,还和网络连接权的方差有着密切的关系。实际上,BAM的抗噪声能力是MAV和连接权方差之商的单增函数。从而提出了一种提高BAM抗噪能力的准则,基于此准则可以有效地减少敏感神经元和不稳定神经元的数量,进而提高BAM的抗噪能力。还有,准松弛学习算法所得网络的抗噪能力依赖于学习参数(λ和ξ),但是它们之间的关系并非线性关系,很难找到能保证最高抗噪能力的学习参数最佳组合。即使在λ和ξ取定后,准松弛算法的训练和学习仍是一种局部最优化过程,它只是在初始权矩阵的附近找到第一个可行解就结束训练,这类算法并不能保证获得全局最优解。从这些结论和问题出发,本文提出了一种新的学习算法--进化准松弛学习算法(EPRBAM)。这种方法应用遗传算法和准松弛方法来得到BAM的可行解,以MAV和连接权方差之商为个体适应度函数,并应用准松弛方法来调整不满足约束条件的个体。实验结果表明此算法大大改善了BAM的抗噪能力,所得到的是全局最优解且不依赖于学习参数。

     

    Abstract: This paper analyzes the sensitivity to noise in BAM (Bidirectional Associative Memory), and then proves the noise immunity of BAM relates not only to the minimum absolute value of net inputs (MAV) but also to the variance of weights associated with synapse connections. In fact, it is a positive monotonically increasing function of the quotient of MAV divided by the variance of weights. Besides, the performance of pseudo-relaxation method depends on learning parameters (lambda and xi), but the relation of them is not linear. So it is hard to find a best combination of lambda and xi which leads to the best BAM performance. And it is obvious that pseudo-relaxation is a kind of local optimization method, so it cannot guarantee to get the global optimal solution. In this paper, a novel learning algorithm EPRBAM (evolutionary psendo-relaxation learning algorithm for bidirectional association memory) employing genetic algorithm and pseudo-relaxation method is proposed to get feasible solution of BAM weight matrix. This algorithm uses the quotient as the fitness of each individual and employs pseudo-relaxation method to adjust individual solution when it does not satisfy constraining condition any more after genetic operation. Experimental results show this algorithm improves noise immunity of BAM greatly. At the same time, EPRBAM does not depend on learning parameters and can get global optimal solution.

     

/

返回文章
返回