paper-with-me

Papers

Aligning Neuronal Coding of Dynamic Visual Scenes with Foundation Vision Models

2024-07-15 · Rining Wu, Feixiang Zhou, Ziwei Yin, Jian K. Liu

Our brains represent the ever-changing environment with neurons in a highly dynamic fashion. The temporal features of visual pixels in dynamic natural scenes are entrapped in the neuronal responses of the retina. It is crucial to establish the intrinsic temporal relationship between visual pixels and neuronal responses. Recent foundation vision models have paved an advanced way of understanding image pixels. Yet, neuronal coding in the brain largely lacks a deep understanding of its alignment with pixels. Most previous studies employ static images or artificial videos derived from static images for emulating more real and complicated stimuli. Despite these simple scenarios effectively help to separate key factors influencing visual coding, complex temporal relationships receive no consideration. To decompose the temporal features of visual coding in natural scenes, here we propose Vi-ST, a spatiotemporal convolutional neural network fed with a self-supervised Vision Transformer (ViT) prior, aimed at unraveling the temporal-based encoding patterns of retinal neuronal populations. The model demonstrates robust predictive performance in generalization tests. Furthermore, through detailed ablation experiments, we demonstrate the significance of each temporal module. Furthermore, we introduce a visual coding evaluation metric designed to integrate temporal considerations and compare the impact of different numbers of neuronal populations on complementary coding. In conclusion, our proposed Vi-ST demonstrates a novel modeling framework for neuronal coding of dynamic visual scenes in the brain, effectively aligning our brain representation of video with neuronal activity. The code is available at https://github.com/wurining/Vi-ST.

📄 PDF Abstract BibTeX arXiv:2407.10737

Code (1)

wurining/Vi-ST 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Invariant inter-subject relational structures in the human visual cortex

2024-07-11 · Ofer Lipman, Shany Grossman, Doron Friedman, Yacov Hel-Or 외

It is a fundamental behavior that different individuals see the world in a largely similar manner. This is an essential basis for humans' ability to cooperate and communicate. However, what are the neuronal properties th…

Population-coding and Dynamic-neurons improved Spiking Actor Network for Reinforcement Learning

2021-06-15 · Duzhen Zhang, Tielin Zhang, Shuncheng Jia, Xiang Cheng 외

With the Deep Neural Networks (DNNs) as a powerful function approximator, Deep Reinforcement Learning (DRL) has been excellently demonstrated on robotic control tasks. Compared to DNNs with vanilla artificial neurons, th…

Deep Reinforcement LearningOpenAI Gymreinforcement-learningReinforcement Learning (RL)

Reconstruction of Natural Visual Scenes from Neural Spikes with Deep Neural Networks

2019-04-30 · Yichen Zhang, Shanshan Jia, Yajing Zheng, Zhaofei Yu 외

Neural coding is one of the central questions in systems neuroscience for understanding how the brain processes stimulus from the environment, moreover, it is also a cornerstone for designing algorithms of brain-machine …

Decoder

DynaMind: Reconstructing Dynamic Visual Scenes from EEG by Aligning Temporal Dynamics and Multimodal Semantics to Guided Diffusion

2025-09-01 · Junxiang Liu, Junming Lin, Jiangtong Li, Jie Li arxiv

Reconstruction dynamic visual scenes from electroencephalography (EEG) signals remains a primary challenge in brain decoding, limited by the low spatial resolution of EEG, a temporal mismatch between neural recordings an…

Video ReconstructionBrain Decoding

The Dynamic Sensorium competition for predicting large-scale mouse visual cortex activity from videos

2023-05-31 · Polina Turishcheva, Paul G. Fahey, Laura Hansel, Rachel Froebe 외

Understanding how biological visual systems process information is challenging due to the complex nonlinear relationship between neuronal responses and high-dimensional visual input. Artificial neural networks have alrea…