Special Issue: Artificial Intelligence and Pattern Recognition

• Articles • Previous Articles     Next Articles

Speed up Training of the Recurrent Neural Network Based on Constrained optimization Techniques

Chen Ke; Bao Weiquan; Chi Huisheng;   

  1. National Laboratory of Machine Perception and Center for Information SciencePeking University; Beijing 100871;
  • Online:1996-11-10 Published:1996-11-10

In this paper, the constrained optimization technique for a substantial prob-lem is explored, that is accelerating training the globally recurrent neural net-work. Unlike most of the previous methods in feedforward neuxal networks, the authors adopt the constrained optimization technique to improve the gradiellt-based algorithm of the globally recuxrent neural network for the adaptive learn-ing rate during training. Using the recurrent network with the improved algo-rithm, some experiments in two real-world…

Key words: 3-D interconnect parasitic capacitance extraction; IBEM (indirect boundary element method); electronic design automation; parasitic parameter extraction; VLSI simulation verification;



[1] Nerrand.O et al. Training recurrent neural networks: Why and how An illustration in dynamical processing modeling. IEEE Trans.on Neural Networks, 1994, 5(2): 178-184.

[2] Williams.R.J et al. Gradient-Based Learning Algorithm for Recurrent Networks. In Back-Propagation Theory: Architectures and Applications, Chauvin Y et al.(eds.), Hillsdale, NJ: Erbaum, 1991.

[3] Chan.L.W et al. An Adaptive Training Algorithm for Backpropagation Networks. Computer Speech and Language 2, 1987, pp. 205-218. ………….
[1] Lixue Xia, Peng Gu, Boxun Li, Tianqi Tang, Xiling Yin, Wenqin Huangfu, Shimeng Yu, Yu Cao, Yu Wang, Huazhong Yang. Technological Exploration of RRAM Crossbar Array for Matrix-Vector Multiplication [J]. , 2016, 31(1): 3-19.
[2] Zhao-Zhi Yang and Ze-Yi Wang. New Multipole Method for 3-D Capacitance Extraction [J]. , 2004, 19(4): 0-0.
[3] LU Zongwei (吕宗伟), LIN Zhenghui (林争辉) and CHEN Houpeng (陈后鹏). Variables Bounding Based Retiming Algorithm [J]. , 2002, 17(6): 0-0.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!

ISSN 1000-9000(Print)

         1860-4749(Online)
CN 11-2296/TP

Home
Editorial Board
Author Guidelines
Subscription
Journal of Computer Science and Technology
Institute of Computing Technology, Chinese Academy of Sciences
P.O. Box 2704, Beijing 100190 P.R. China
Tel.:86-10-62610746
E-mail: jcst@ict.ac.cn
 
  Copyright ©2015 JCST, All Rights Reserved