Event-driven eligibility propagation in large sparse networks

Neuromorphic Computing and Engineering, vol. 6, pp. 034024

Abstract

Abstract Eligibility propagation (e-prop) is a biologically plausible learning rule for recurrent spiking neural networks (SNNs). It approximates gradients computed by backpropagation through time using online updates based on eligibility traces and learning signals. We reformulate the originally time-driven gradient calculations used to compute synaptic weight updates in an event-driven form and show that the resulting formulation accurately reproduces the time-driven results on the benchmark tasks of the original study. We further incorporate additional biological features and show on the event-camera dataset neuromorphic MNIST that they do not degrade learning performance. Enabled by the event-driven formulation, we implement mechanisms that reduce gradient computations, particularly in sparse settings: exactly for the original e-prop model and approximately for the biologically extended model. We assess runtime and memory scaling of both event-driven e-prop models up to millions of neurons, with flat weak-scaling curves suggesting feasibility beyond this range. By providing a reference implementation in the NEST simulation code, an established open-source framework optimized for large-scale SNN simulation, this work supports reproducible studies of e-prop-like learning rules and their prototyping before deployment on neuromorphic hardware.

Authors 8

1. Agnes Korcsak-Gorzo corresponding Aachen

   Forschungszentrum Jülich · RWTH Aachen University

   Affiliation as printed

   Jülich Research Centre

   RWTH Aachen University

2. Jesús A. Espinoza-Valverde corresponding

   University of Wuppertal

   Affiliation as printed

   University of Wuppertal

3. Jonas Stapmanns corresponding

   University of Bern

   Affiliation as printed

   University of Bern

4. Hans Ekkehard Pleßer corresponding Aachen

   Forschungszentrum Jülich · Norwegian University of Life Sciences · RWTH Aachen University

   Affiliation as printed

   Jülich Research Centre

   Norwegian University of Life Sciences

   RWTH Aachen University

5. David Dahmen corresponding

   Forschungszentrum Jülich

   Affiliation as printed

   Jülich Research Centre

6. Matthias Bolten corresponding

   University of Wuppertal

   Affiliation as printed

   University of Wuppertal

7. Sacha Jennifer van Albada corresponding

   Forschungszentrum Jülich · University of Cologne

   Affiliation as printed

   Jülich Research Centre

   University of Cologne

8. Markus Diesmann corresponding Aachen

   Forschungszentrum Jülich · RWTH Aachen University

   Affiliation as printed

   Jülich Research Centre

   RWTH Aachen University