paper-with-me

Papers

MSBraM: A Multi-scale Self-supervised Brain Foundation Model for Hierarchical EEG Dynamics Learning

2026-07-23 · Tao Zhou, Jing Han, Lingyu Shu, Zixing Zhang arxiv

Self-supervised foundation models have recently shown strong potential for electroencephalogram (EEG)-based analysis. However, existing approaches struggle to capture the inherently multi-scale temporal structure of EEG signals, where local neural patterns and long-range dependencies jointly encode task-relevant information. This limitation hampers cross-scale representation learning and generalization across diverse downstream tasks. To address this challenge, we propose MSBraM, a Multi-Scale self-supervised Brain foundation Model designed to learn hierarchical EEG representations. MSBraM follows a two-stage pretraining framework. First, a multi-scale neural tokenizer discretizes raw EEG signals into semantic codes at different temporal resolutions via vector-quantized reconstruction. Second, the model is pretrained to predict masked codes using a curriculum multi-scale masking strategy, progressively integrating fine-grained local patterns with global temporal context. We pretrain MSBraM on over 2,400 hours of EEG data and evaluate it across 10 downstream tasks on 12 public datasets. Extensive experiments show that MSBraM achieves superior performance on other state-of-the-art pretrained models, demonstrating strong generalization and transferability. These results indicate that explicitly modeling multi-scale temporal dynamics is critical for effective EEG foundation models.

📄 PDF Abstract BibTeX arXiv:2607.21402

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

A large-scale heterogeneous 3D magnetic resonance brain imaging dataset for self-supervised learning

2025-06-17 · Asbjørn Munk, Stefano Cerri, Jakob Ambsdorf, Julia Machnio 외

We present FOMO60K, a large-scale, heterogeneous dataset of 60,529 brain Magnetic Resonance Imaging (MRI) scans from 13,900 sessions and 11,187 subjects, aggregated from 16 publicly available sources. The dataset include…

BenchmarkingSelf-Supervised Learning

Multiplexed Immunofluorescence Brain Image Analysis Using Self-Supervised Dual-Loss Adaptive Masked Autoencoder

2022-05-10 · Son T. Ly, Bai Lin, Hung Q. Vo, Dragan Maric 외

Reliable large-scale cell detection and segmentation is the fundamental first step to understanding biological processes in the brain. The ability to phenotype cells at scale can accelerate preclinical drug evaluation an…

Cell DetectionContrastive LearningImage ReconstructionSegmentation+2

Self-supervised multimodal neuroimaging yields predictive representations for a spectrum of Alzheimer's phenotypes

2022-09-07 · Alex Fedorov, Eloy Geenjaar, Lei Wu, Tristan Sylvain 외

Recent neuroimaging studies that focus on predicting brain disorders via modern machine learning approaches commonly include a single modality and rely on supervised over-parameterized models.However, a single modality p…

DiagnosticSelf-Supervised Learning

BaRISTA: Brain Scale Informed Spatiotemporal Representation of Human Intracranial Neural Activity

2025-12-13 · Lucine L. Oganesian, Saba Hashemi, Maryam M. Shanechi arxiv

Intracranial recordings have opened a unique opportunity to simultaneously measure activity across multiregional networks in the human brain. Recent works have focused on developing transformer-based neurofoundation mode…

Towards Generalisable Foundation Models for Brain MRI

2025-10-27 · Moona Mazher, Geoff J. M. Parker, Daniel C. Alexander arxiv

Foundation models in artificial intelligence (AI) are transforming medical imaging by enabling general-purpose feature learning from large-scale, unlabeled datasets. In this work, we introduce BrainFound, a self-supervis…

Image Segmentation