NASA Logo

NTRS

NTRS - NASA Technical Reports Server

Back to Results
Fast temporal neural learning using teacher forcingA neural network is trained to output a time dependent target vector defined over a predetermined time interval in response to a time dependent input vector defined over the same time interval by applying corresponding elements of the error vector, or difference between the target vector and the actual neuron output vector, to the inputs of corresponding output neurons of the network as corrective feedback. This feedback decreases the error and quickens the learning process, so that a much smaller number of training cycles are required to complete the learning process. A conventional gradient descent algorithm is employed to update the neural network parameters at the end of the predetermined time interval. The foregoing process is repeated in repetitive cycles until the actual output vector corresponds to the target vector. In the preferred embodiment, as the overall error of the neural network output decreasing during successive training cycles, the portion of the error fed back to the output neurons is decreased accordingly, allowing the network to learn with greater freedom from teacher forcing as the network parameters converge to their optimum values. The invention may also be used to train a neural network with stationary training and target vectors.
Document ID
19960009260
Acquisition Source
Legacy CDMS
Document Type
Other - Patent
Authors
Toomarian, Nikzad
(NASA Pasadena Office CA, United States)
Bahren, Jacob
(NASA Pasadena Office CA, United States)
Date Acquired
August 17, 2013
Publication Date
June 27, 1995
Subject Category
Cybernetics
Accession Number
96N16426
Distribution Limits
Public
Copyright
Work of the US Gov. Public Use Permitted.
Patent
US-PATENT-5,428,710|NASA-CASE-NPO-18553-1-CU
Patent Application
US-PATENT-APPL-SN-908677
No Preview Available