Predicting population neural activity in the Algonauts challenge using end-to-end trained Siamese networks and group convolutions
The Algonauts challenge is about predicting the object representations in the form of Representational Dissimilarity Matrices (RDMS) derived from visual brain regions. We used a customized deep learning model using the concept of Siamese networks and group convolutions to predict neural distances corresponding to a pair of images. Training data was best explained by distances computed over the last layer.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Parameter-efficient Multi-subject Model for Predicting fMRI Activity
This is the Algonauts 2023 submission report for team "BlobGPT". Our model consists of a multi-subject linear encoding head attached to a pretrained trunk model. The multi-subject head consists of three components: (1) a…
The Algonauts Project: A Platform for Communication between the Sciences of Biological and Artificial Intelligence
In the last decade, artificial intelligence (AI) models inspired by the brain have made unprecedented progress in performing real-world perceptual tasks like object classification and speech recognition. Recently, resear…
Benchmarkingspeech-recognitionSpeech RecognitionA Multimodal Seq2Seq Transformer for Predicting Brain Responses to Naturalistic Stimuli
The Algonauts 2025 Challenge called on the community to develop encoding models that predict whole-brain fMRI responses to naturalistic multimodal movies. In this submission, we propose a sequence-to-sequence Transformer…
Activity PredictionStacked Regression using Off-the-shelf, Stimulus-tuned and Fine-tuned Neural Networks for Predicting fMRI Brain Responses to Movies (Algonauts 2025 Report)
We present our submission to the Algonauts 2025 Challenge, where the goal is to predict fMRI brain responses to movie stimuli. Our approach integrates multimodal representations from large language models, video encoders…
Insights from the Algonauts 2025 Winners
The Algonauts 2025 Challenge just wrapped up a few weeks ago. It is a biennial challenge in computational neuroscience in which teams attempt to build models that predict human brain activity from carefully curated stimu…