Interpretable compositional computation with recurrent neural networks
bioRxiv (Cold Spring Harbor Laboratory)
Abstract
Abstract Flexible cognition utilizes reusable components to enable rapid adaptation of behavior to different contexts or tasks. Analysis of artificial neural networks trained on multiple tasks suggested that this compositionality is supported by dynamical structures which are shared and re-used across tasks. However, the nature of these shared components, and how they can be used in a task-dependent manner, remained unclear. Here, we develop a theory of interpretable compositional computation based on shared dynamical structures in the low-dimensional latent space of low-rank recurrent neural networks. We show that these shared latent components are not immediately visible in the neural activity, and are thus compatible with task-dependent activity. We identify hallmarks of shared latent components both in the connectivity statistics and the neural representations. These hallmarks yield testable predictions for the network’s response to specific perturbation experiments. Finally, we identify distinct loci where task-dependence can enter the computation, allowing us to characterize qualitatively different solutions to compositional tasks. In summary, our theory provides a mechanistic understanding and testable hallmarks of compositional computation via shared components in low-rank networks.
Authors 2
-
Louis Pezon corresponding
École Polytechnique Fédérale de Lausanne
Affiliation as printed
School of Computer and Communication Sciences and School of Life Sciences, EPFL, Lausanne, Switzerland
-
RWTH Aachen University · École Polytechnique Fédérale de Lausanne
Affiliation as printed
Department of Physics, Faculty of Mathematics and Natural Sciences, RWTH Aachen University, Aachen, Germany
School of Computer and Communication Sciences and School of Life Sciences, EPFL, Lausanne, Switzerland
Cited by 0 stored of 0
No patents citing this paper on Lens.org (checked 2026-10-06).