%A P Vamplew
%A A Adams
%T Neural Transplant Surgery: An Approach to Pre-training Recurrent Networks
%X Partially-recurrent networks have advantages over strictly feed-forward networks for certain spatiotemporal pattern classification or prediction tasks. However networks involving recurrent links are generally more difficult to train than their non-recurrent counterparts. In this paper we demonstrate that the costs of training a recurrent network can be greatly reduced by initialising the network prior to training with weights 'transplanted' from a non-recurrent architecture.
%C University of Queensland
%D 1994
%K recurrent neural networks, pre-training, weight initialisation
%L epprod41