Graduation Semester and Year
2015
Language
English
Document Type
Thesis
Degree Name
Master of Science in Electrical Engineering
Department
Electrical Engineering
First Advisor
Michael T Manry
Abstract
There is always an ambiguity in deciding the number of learning factors that is really required for training a Multi-Layer Perceptron. This thesis solves this problem by introducing a new method of adaptively changing the number of learning factors computed based on error change created per multiply. A new method is introduced for computing learning factors for weights grouped based on the curvature of the objective function. A method for linearly compressing large ill-conditioned Newton's Hessian matrices to smaller well-conditioned ones is shown. This thesis also shows that the proposed training algorithm adapts itself between two other algorithms in order to produce a better error decrease per multiply. The performance of the proposed algorithm is shown to be better than OWO-MOLF and Levenberg Marquardt for most of the data sets.
Disciplines
Electrical and Computer Engineering | Engineering
License
This work is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 4.0 International License.
Recommended Citation
Challagundla, Jeshwanth, "Adaptive Multiple Optimal Learning Factors For Neural Network Training" (2015). Electrical Engineering Theses. 291.
https://mavmatrix.uta.edu/electricaleng_theses/291
Comments
Degree granted by The University of Texas at Arlington