Functional Brain-to-Brain Transformation with No Shared Data
Combining Functional MRI (fMRI) data across different subjects and datasets is crucial for many neuroscience tasks. Relying solely on shared anatomy for brain-to-brain mapping is inadequate. Existing functional transformation methods thus depend on shared stimuli across subjects and fMRI datasets, which are often unavailable. In this paper, we propose an approach for computing functional brain-to-brain transformations without any shared data, a feat not previously achieved in functional transformations. This presents exciting research prospects for merging and enriching diverse datasets, even when they involve distinct stimuli that were collected using different fMRI machines of varying resolutions (e.g., 3-Tesla and 7-Tesla). Our approach combines brain-to-brain transformation with image-to-fMRI encoders, thus enabling to learn functional transformations on visual stimuli to which subjects were never exposed. Furthermore, we demonstrate the applicability of our method for improving image-to-fMRI encoding of subjects scanned on older low-resolution 3T fMRI datasets, by using a new high-resolution 7T fMRI dataset (scanned on different subjects and different stimuli).
Code (0)
등록된 구현이 없습니다.
Tasks
AnatomySimilar Papers 제목 키워드 기반
Lifespan associations of resting-state brain functional networks with ADHD symptoms
Attention-deficit/hyperactivity disorder (ADHD) is increasingly being diagnosed in both children and adults, but the neural mechanisms that underlie its distinct symptoms and whether children and adults share the same me…
Reconstructing perceived faces from brain activations with deep adversarial neural decoding
Here, we present a novel approach to solve the problem of reconstructing perceived stimuli from brain responses by combining probabilistic inference with deep learning. Our approach first inverts the linear transformatio…
Multi-faceted Neuroimaging Data Integration via Analysis of Subspaces
Neuroimaging studies, such as the Human Connectome Project (HCP), often collect multi-faceted and multi-block data to study the complex human brain. However, these data are often analyzed in a pairwise fashion, which can…
Data IntegrationFunctional ConnectivityIdentifying Shared Decodable Concepts in the Human Brain Using Image-Language Foundation Models
We introduce a method that takes advantage of high-quality pretrained multimodal representations to explore fine-grained semantic networks in the human brain. Previous studies have documented evidence of functional local…
Contrastive LearningDimensionality ReductionBrain-OF: An Omnifunctional Foundation Model for fMRI, EEG and MEG
Brain foundation models have achieved remarkable advances across a wide range of neuroscience tasks. However, most existing models are limited to a single functional modality, restricting their ability to exploit complem…
Self-Supervised Learning