Recurrence is required to capture the representational dynamics of the human visual system
The human visual system is an intricate network of brain regions that enables us to recognize the world around us. Despite its abundant lateral and feedback connections, object processing is commonly viewed and studied as a feedforward process. Here, we measure and model the rapid representational dynamics across multiple stages of the human ventral stream using time-resolved brain imaging and deep learning. We observe substantial representational transformations during the first 300 ms of processing within and across ventral-stream regions. Categorical divisions emerge in sequence, cascading forward and in reverse across regions, and Granger causality analysis suggests bidirectional information flow between regions. Finally, recurrent deep neural network models clearly outperform parameter-matched feedforward models in terms of their ability to capture the multi-region cortical dynamics. Targeted virtual cooling experiments on the recurrent deep network models further substantiate the importance of their lateral and top-down connections. These results establish that recurrent models are required to understand information processing in the human ventral stream.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Consequences of Slow Neural Dynamics for Incremental Learning
In the human brain, internal states are often correlated over time (due to local recurrence and other intrinsic circuit properties), punctuated by abrupt transitions. At first glance, temporal smoothness of internal stat…
Incremental LearningInductive BiasRecurrence measures and transitions in stock market dynamics
The financial markets are understood as complex dynamical systems whose dynamics is analysed mostly using nonstationary and brief data sets that usually come from stock markets. For such data sets, a reliable method of a…
Time SeriesTime Series AnalysisIntegrating Recurrence Dynamics for Speech Emotion Recognition
We investigate the performance of features that can capture nonlinear recurrence dynamics embedded in the speech signal for the task of Speech Emotion Recognition (SER). Reconstruction of the phase space of each speech f…
Emotion RecognitionEmotion Recognition in ConversationSpeech Emotion RecognitionRecurrence of Nonlinear Control Systems: Entropy and Bit Rates
In this paper, we introduce the notion of recurrence entropy in the context of nonlinear control systems. A set is said to be ($\tau$-)recurrent if every trajectory that starts in the set returns to it (within at most $\…
Visualizing Representational Dynamics with Multidimensional Scaling Alignment
Representational similarity analysis (RSA) has been shown to be an effective framework to characterize brain-activity profiles and deep neural network activations as representational geometry by computing the pairwise di…
Object Categorization