NASA Logo

NTRS

NTRS - NASA Technical Reports Server

Back to Results
Fast temporal neural learning using teacher forcingA neural network is trained to output a time dependent target vector defined over a predetermined time interval in response to a time dependent input vector defined over the same time interval by applying corresponding elements of the error vector, or difference between the target vector and the actual neuron output vector, to the inputs of corresponding output neurons of the network as corrective feedback. This feedback decreases the error and quickens the learning process, so that a much smaller number of training cycles are required to complete the learning process. A conventional gradient descent algorithm is employed to update the neural network parameters at the end of the predetermined time interval. The foregoing process is repeated in repetitive cycles until the actual output vector corresponds to the target vector. In the preferred embodiment, as the overall error of the neural network output decreasing during successive training cycles, the portion of the error fed back to the output neurons is decreased accordingly, allowing the network to learn with greater freedom from teacher forcing as the network parameters converge to their optimum values. The invention may also be used to train a neural network with stationary training and target vectors.
Document ID
19920020842
Acquisition Source
Legacy CDMS
Document Type
Other - Patent Application
Authors
Toomarian, Nikzad
(Jet Propulsion Lab. California Inst. of Tech., Pasadena., United States)
Bahren, Jacob
(Jet Propulsion Lab. California Inst. of Tech., Pasadena., United States)
Date Acquired
September 6, 2013
Publication Date
June 29, 1992
Subject Category
Cybernetics
Report/Patent Number
NAS 1.71:NPO-18553-1-CU
Accession Number
92N30085
Funding Number(s)
CONTRACT_GRANT: NAS7-918
Distribution Limits
Public
Copyright
Work of the US Gov. Public Use Permitted.
Patent
NASA-CASE-NPO-18553-1-CU
Patent Application
US-PATENT-APPL-SN-908677
No Preview Available