Natural gradient learning for spatio-temporal decorrelation: Recurrent network

Abstract

Spatio-temporal decorrelation is the task of eliminating correlations between associated signals in spatial domain as well as in time domain. In this paper. we present a simple but efficient adaptive algorithm for spatio-temporal decorrelation. For the task of spatio-temporal decorrelation. we consider a dynamic recurrent network and calculate the associated natural gradient for the minimization of all appropriate optimization function, The natural gradient based spatio-temporal decorrelation algorithm is applied to the task of blind deconvolution of linear single input multiple output (SIMO) system and its performance is compared to the spatio-temporal anti-Hebbian learning rule.