paper-with-me

Papers

Simple Models, Rich Representations: Visual Decoding from Primate Intracortical Neural Signals

2026-01-16 · Matteo Ciferri, Matteo Ferrante, Nicola Toschi arxiv

Understanding how neural activity gives rise to perception is a central challenge in neuroscience. We address the problem of decoding visual information from high-density intracortical recordings in primates, using the THINGS Ventral Stream Spiking Dataset. We systematically evaluate the effects of model architecture, training objectives, and data scaling on decoding performance. Results show that decoding accuracy is mainly driven by modeling temporal dynamics in neural signals, rather than architectural complexity. A simple model combining temporal attention with a shallow MLP achieves up to 70% top-1 image retrieval accuracy, outperforming linear baselines as well as recurrent and convolutional approaches. Scaling analyses reveal predictable diminishing returns with increasing input dimensionality and dataset size. Building on these findings, we design a modular generative decoding pipeline that combines low-resolution latent reconstruction with semantically conditioned diffusion, generating plausible images from 200 ms of brain activity. This framework provides principles for brain-computer interfaces and semantic neural decoding.

📄 PDF Abstract BibTeX arXiv:2601.11108

Code (0)

등록된 구현이 없습니다.

Tasks

Image Retrieval

Similar Papers 제목 키워드 기반

A Rich Source of Labels for Deep Network Models of the Primate Dorsal Visual Stream

2016-10-17

Deep convolutional neural networks (CNNs) have structures that are loosely related to that of the primate visual cortex. Surprisingly, when these networks are trained for object classification, the activity of their earl…

Fundamental principles of cortical computation: unsupervised learning with prediction, compression and feedback

2016-08-19 · Micah Richert, Dimitry Fisher, Filip Piekniewski, Eugene M. Izhikevich 외

There has been great progress in understanding of anatomical and functional microcircuitry of the primate cortex. However, the fundamental principles of cortical computation - the principles that allow the visual cortex …

Visual Tracking

Adversarially trained neural representations may already be as robust as corresponding biological neural representations

2022-06-19 · Chong Guo, Michael J. Lee, Guillaume Leclerc, Joel Dapello 외

Visual systems of primates are the gold standard of robust perception. There is thus a general belief that mimicking the neural representations that underlie those systems will yield artificial visual systems that are ad…

Your head is there to move you around: Goal-driven models of the primate dorsal pathway

2021-12-01 · NeurIPS 2021 12 · Patrick Mineault, Shahab Bakhtiari, Blake Richards, Christopher Pack

Neurons in the dorsal visual pathway of the mammalian brain are selective for motion stimuli, with the complexity of stimulus representations increasing along the hierarchy. This progression is similar to that of the ven…

Action RecognitionObject RecognitionSelf-Supervised Learning

Examining Representational Similarity in ConvNets and the Primate Visual Cortex

2016-09-12 · Abhimanyu Dubey, Jayadeva, Sumeet Agarwal

We compare several ConvNets with different depth and regularization techniques with multi-unit macaque IT cortex recordings and assess the impact of the same on representational similarity with the primate visual cortex.…