paper-with-me

홈 › Papers

BrainMAE: A Region-aware Self-supervised Learning Framework for Brain Signals

2024-06-24 · Yifan Yang, Yutong Mao, Xufu Liu, Xiao Liu

The human brain is a complex, dynamic network, which is commonly studied using functional magnetic resonance imaging (fMRI) and modeled as network of Regions of interest (ROIs) for understanding various brain functions. Recent studies utilize deep learning approaches to learn the brain network representation based on functional connectivity (FC) profile, broadly falling into two main categories. The Fixed-FC approaches, utilizing the FC profile which represents the linear temporal relation within the brain network, are limited by failing to capture informative brain temporal dynamics. On the other hand, the Dynamic-FC approaches, modeling the evolving FC profile over time, often exhibit less satisfactory performance due to challenges in handling the inherent noisy nature of fMRI data. To address these challenges, we propose Brain Masked Auto-Encoder (BrainMAE) for learning representations directly from fMRI time-series data. Our approach incorporates two essential components: a region-aware graph attention mechanism designed to capture the relationships between different brain ROIs, and a novel self-supervised masked autoencoding framework for effective model pre-training. These components enable the model to capture rich temporal dynamics of brain activity while maintaining resilience to inherent noise in fMRI data. Our experiments demonstrate that BrainMAE consistently outperforms established baseline methods by significant margins in four distinct downstream tasks. Finally, leveraging the model's inherent interpretability, our analysis of model-generated representations reveals findings that resonate with ongoing research in the field of neuroscience.

📄 PDF Abstract BibTeX arXiv:2406.17086

Code (0)

등록된 구현이 없습니다.

Tasks

Functional ConnectivityGraph AttentionSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Self-Supervised Facial Representation Learning with Facial Region Awareness

2024-03-04 · CVPR 2024 1 · Zheng Gao, Ioannis Patras

Self-supervised pre-training has been proved to be effective in learning transferable representations that benefit various visual tasks. This paper asks this question: can self-supervised pre-training learn general facia…

Deep ClusteringRepresentation LearningSemantic SegmentationTransfer Learning

Hard-aware Instance Adaptive Self-training for Unsupervised Cross-domain Semantic Segmentation

2023-02-14 · Chuang Zhu, Kebin Liu, Wenqi Tang, Ke Mei 외

The divergence between labeled training data and unlabeled testing data is a significant challenge for recent deep learning models. Unsupervised domain adaptation (UDA) attempts to solve such problem. Recent works show t…

Domain AdaptationPseudo LabelSemantic SegmentationSynthetic-to-Real Translation+2

Object-Aware Cropping for Self-Supervised Learning

2021-12-01 · Shlok Mishra, Anshul Shah, Ankan Bansal, Abhyuday Jagannatha 외

A core component of the recent success of self-supervised learning is cropping data augmentation, which selects sub-regions of an image to be used as positive views in the self-supervised loss. The underlying assumption …

Data AugmentationObjectobject-detectionObject Detection+1

UM-Depth : Uncertainty Masked Self-Supervised Monocular Depth Estimation with Visual Odometry

2025-09-17 · Tae-Wook Um, Ki-Hyeon Kim, Hyun-Duck Choi, Hyo-Sung Ahn arxiv

Monocular depth estimation has been increasingly adopted in robotics and autonomous driving for its ability to infer scene geometry from a single camera. In self-supervised monocular depth estimation frameworks, the netw…

Monocular Depth EstimationAutonomous DrivingPose EstimationVisual Odometry

Synthesize Boundaries: A Boundary-aware Self-consistent Framework for Weakly Supervised Salient Object Detection

2022-12-04 · Binwei Xu, Haoran Liang, Ronghua Liang, Peng Chen

Fully supervised salient object detection (SOD) has made considerable progress based on expensive and time-consuming data with pixel-wise annotations. Recently, to relieve the labeling burden while maintaining performanc…

object-detectionObject DetectionSalient Object Detection