Theoretical and Experimental Aspects of Supervised Learning in Artificial Neural Networks
Abstract
The topic of supervised learning within the conceptual framework of artificial neural network (ANN) models is addressed. An ANN is a parallel distributed processing system that consists of many computationally simple processing elements interconnected through unidirectional weighted connections. Such networks, which are roughly patterned after biological nervous systems, have been proposed for use in areas in which the traditional von Neumann computer architecture has been relatively unsuccessful. Learning in these networks is accomplished through the use of algorithms that adjust the values of the connection weights. The work presented here addresses the issue of improving the rate at which ANNs can learn to achieve the mapping of an input pattern to a desired output pattern. The most successful learning algorithms for accomplishing this task are based on gradient descent error minimization techniques. However, the large amount of training time that such algorithms require is currently one of the factors that limits the use of ANN systems. A number of improvements to existing algorithms were developed and analyzed through the use of simulation. Furthermore, a highly flexible simulation environment based on an object-oriented software paradigm was developed and successfully used to implement and test these novel learning algorithms. A comparison of this object-oriented approach with the traditional techniques used by existing ANN simulation systems is performed. Finally, the issue of simulating ANN models on parallel hardware is considered. An associative memory ANN was implemented on a systolic array architecture. The memory requirements and processing times of this implementation are analyzed based upon the number of processing elements required by the ANN and the number of training patterns. Compared with other digital implementations, this design is shown to yield significant improvements in runtime performance and offers the capability of using ANN associative memories in real-time applications.
Notes
This item is only available in print in the UCF Libraries. If this is your thesis or dissertation, you can help us make it available online for use by researchers around the world by STARS for more information.
Graduation Date
1989
Semester
Summer
Advisor
Myler, Harley R.
Degree
Doctor of Philosophy (Ph.D.)
College
College of Engineering
Department
Computer Engineering
Format
Language
English
Length of Campus-only Access
None
Access Status
Doctoral Dissertation (Open Access)
Identifier
DP0026696
Subjects
Dissertations, Academic -- Engineering; Engineering -- Dissertations, Academic
STARS Citation
Heileman, Gregory L., "Theoretical and Experimental Aspects of Supervised Learning in Artificial Neural Networks" (1989). Retrospective Theses and Dissertations. 4148.
https://stars.library.ucf.edu/rtd/4148
Accessibility Status
Searchable text