Statistical temporal pattern extraction by neuronal architecture

Physical Review Research, vol. 5

Abstract

Neuronal systems need to process temporal signals. Here, we show how higher-order temporal (co)fluctuations can be employed to represent and process information. Concretely, we demonstrate that a simple biologically inspired feedforward neuronal model can extract information from up to the third-order cumulant to perform time series classification. This model relies on a weighted linear summation of synaptic inputs followed by a nonlinear gain function. Training both the synaptic weights and the nonlinear gain function exposes how the nonlinearity allows for the transfer of higher-order correlations to the mean, which in turn enables the synergistic use of information encoded in multiple cumulants to maximize the classification accuracy. The approach is demonstrated both on synthetic and real-world datasets of multivariate time series. Moreover, we show that the biologically inspired architecture makes better use of the number of trainable parameters than a classical machine-learning scheme. Our findings emphasize the benefit of biological neuronal architectures, paired with dedicated learning algorithms, for the processing of information embedded in higher-order statistical cumulants of temporal (co)fluctuations.

Authors 3

1. Sandra Nestler corresponding Aachen

   RWTH Aachen University · Forschungszentrum Jülich · Jülich Aachen Research Alliance

   Affiliation as printed

   Institute of Neuroscience and Medicine (INM-6) and Institute for Advanced Simulation (IAS-6) and JARA-Institute Brain Structure-Function Relationships (INM-10), Jülich Research Centre, 52428 Jülich, Germany

   RWTH Aachen University, 52062 Aachen, Germany

2. Moritz Helias Aachen Department of Physics Faculty 1

   RWTH Aachen University · Forschungszentrum Jülich · Jülich Aachen Research Alliance

   Affiliation as printed

   Department of Physics, Faculty 1, RWTH Aachen University, 52062 Aachen, Germany

   Institute of Neuroscience and Medicine (INM-6) and Institute for Advanced Simulation (IAS-6) and JARA-Institute Brain Structure-Function Relationships (INM-10), Jülich Research Centre, 52428 Jülich, Germany

3. Matthieu Gilson

   Forschungszentrum Jülich · Inserm · Jülich Aachen Research Alliance · Institut de Neurosciences des Systèmes

   Affiliation as printed

   Institut de Neurosciences des Systèmes (INS, UMR1106), INSERM-AMU, 13005 Marseille, France

   Institute of Neuroscience and Medicine (INM-6) and Institute for Advanced Simulation (IAS-6) and JARA-Institute Brain Structure-Function Relationships (INM-10), Jülich Research Centre, 52428 Jülich, Germany