paper-with-me

Papers

Swin fMRI Transformer Predicts Early Neurodevelopmental Outcomes from Neonatal fMRI

2024-11-25 · Patrick Styll, Dowon Kim, Jiook Cha

Brain development in the first few months of human life is a critical phase characterized by rapid structural growth and functional organization. Accurately predicting developmental outcomes during this time is crucial for identifying delays and enabling timely interventions. This study introduces the SwiFT (Swin 4D fMRI Transformer) model, designed to predict Bayley-III composite scores using neonatal fMRI from the Developing Human Connectome Project (dHCP). To enhance predictive accuracy, we apply dimensionality reduction via group independent component analysis (ICA) and pretrain SwiFT on large adult fMRI datasets to address the challenges of limited neonatal data. Our analysis shows that SwiFT significantly outperforms baseline models in predicting cognitive, motor, and language outcomes, leveraging both single-label and multi-label prediction strategies. The model's attention-based architecture processes spatiotemporal data end-to-end, delivering superior predictive performance. Additionally, we use Integrated Gradients with Smoothgrad sQuare (IG-SQ) to interpret predictions, identifying neural spatial representations linked to early cognitive and behavioral development. These findings underscore the potential of Transformer models to advance neurodevelopmental research and clinical practice.

📄 PDF Abstract BibTeX arXiv:2412.07783

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality Reduction

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

SwiFT: Swin 4D fMRI Transformer

2023-07-12 · NeurIPS 2023 11 · Peter Yongho Kim, Junbeom Kwon, Sunghwan Joo, Sangyoon Bae 외

Modeling spatiotemporal brain dynamics from high-dimensional data, such as functional Magnetic Resonance Imaging (fMRI), is a formidable task in neuroscience. Existing approaches for fMRI analysis utilize hand-crafted fe…

Voxel-Level Brain States Prediction Using Swin Transformer

2025-06-13 · Yifei Sun, Daniel Chahine, Qinghao Wen, Tianming Liu 외

Understanding brain dynamics is important for neuroscience and mental health. Functional magnetic resonance imaging (fMRI) enables the measurement of neural activities through blood-oxygen-level-dependent (BOLD) signals,…

Prediction

Self-Supervised Pre-training Tasks for an fMRI Time-series Transformer in Autism Detection

2024-09-18 · Yinchi Zhou, Peiyu Duan, Yuexi Du, Nicha C. Dvornek

Autism Spectrum Disorder (ASD) is a neurodevelopmental condition that encompasses a wide variety of symptoms and degrees of impairment, which makes the diagnosis and treatment challenging. Functional magnetic resonance i…

Autism detectionFunctional ConnectivityTime Series

Community-Aware Transformer for Autism Prediction in fMRI Connectome

2023-06-24 · Anushree Bannadabhavi, Soojin Lee, Wenlong Deng, Xiaoxiao Li

Autism spectrum disorder(ASD) is a lifelong neurodevelopmental condition that affects social communication and behavior. Investigating functional magnetic resonance imaging (fMRI)-based brain functional connectome can ai…

Prediction

Prediction of severity and treatment outcome for ASD from fMRI

2018-10-28

Autism spectrum disorder (ASD) is a complex neurodevelopmental syndrome. Early diagnosis and precise treatment are essential for ASD patients. Although researchers have built many analytical models, there has been limite…

feature selectionMedical Image Analysisregression