Progressive multi-stage extrapolation of predictable motion in human visual cortex

bioRxiv (Cold Spring Harbor Laboratory)

Abstract

Abstract Neural processing of sensory information takes time. Consequently, to estimate the current state of the world, the brain must rely on predictive processes – for example, extrapolating the motion of a ball to determine its probable present position. Some evidence implicates early (pre-cortical) processing in extrapolation, but it remains unclear whether extrapolation continues during later-stage (cortical) processing, where further delays accumulate. Moreover, the majority of such evidence relies on invasive neurophysiological techniques in animals, with accurate characterisation of extrapolation effects in the human brain currently lacking. Here, we address these issues by demonstrating how precise probabilistic maps can be constructed from human EEG recordings. Participants (N = 18, 2 sessions) viewed a stimulus moving along a circular trajectory while EEG was recorded. Using LDA classification, we extracted maps of stimulus location over time and found evidence of a forwards temporal shift occurring across temporally distinct processing stages. This accelerated emergence of position representations indicates extrapolation occurring at multiple stages of processing, with representations progressively shifted closer to real-time. We further show evidence of representational overshoot during early-stage processing following unexpected changes to an object’s trajectory, and demonstrate that the observed dynamics can emerge without supervision in a simulated neural network via spike-timing-dependent plasticity.

Authors 4

1. William Turner corresponding

   Queensland University of Technology · The University of Melbourne · Stanford University

   Affiliation as printed

   Department of Psychology, Stanford University, California, United States

   Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia

   School of Psychology & Counselling, Queensland University of Technology, Brisbane, Australia

2. Charlie M. Sexton

   The University of Melbourne

   Affiliation as printed

   Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia

3. Philippa Anne Johnson Aachen Cognitive Psychology Unit Institute of Psychology and Leiden Institute for Brain and Cognition

   Leiden University

   Affiliation as printed

   Cognitive Psychology Unit, Institute of Psychology & Leiden Institute for Brain and Cognition, Leiden University, Leiden, Netherlands

4. Hinze Hogendoorn

   Queensland University of Technology · The University of Melbourne

   Affiliation as printed

   Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia

   School of Psychology & Counselling, Queensland University of Technology, Brisbane, Australia