The Davidon Fletcher Powell (DFP) optimization algorithm usually used for nonlinear least squares is presented and is combined with the standard backpropagation (SBP) algorithm yielding a new fast training multilayer perceptron (MLP) algorithm (DFP/SBP). The new algorithm is tested on several function approximation problems. The number of iterations required by this algorithm to converge is less than 40% of what is required by the SBP algorithm. Also it is less affected by the choice of initial weights and setup parameters. The DFP/SBP algorithm is much more efficient than either of other techniques when the network contains no more than few hundred weights.
A new fast multilayer perceptron training procedure based on the Davidon Fletcher Powell algorithm
2003-01-01
276381 byte
Conference paper
Electronic Resource
English
A New Fast Multilayer Perceptron Training Procedure Based On The Davidon Fletcher Powell Algorithm
British Library Conference Proceedings | 2003
|Orbit determination with the Davidon method.
NTRS | 1966
|