paper-with-me

홈 › Papers

CORTEG: Foundation Models Enable Cross-Modality Representation Transfer from Scalp to Intracranial Brain Recordings

2026-05-11 · Liuyin Yang, Qiang Sun, Bob Van Dyck, Eva Calvo Merino, Marc M. Van Hulle arxiv

Intracranial electrocorticography (ECoG) offers high-signal-to-noise access to cortical activity for brain-computer interfaces, yet limited per-patient data has led most prior work to rely on small, subject-specific decoders that neglect information shared across patients. We investigate whether large pretrained scalp-EEG foundation models (EEG FMs) can be adapted to ECoG, enabling cross-patient learning and competitive decoding performance while calibrating to a held-out patient in 10-30 minutes on a single GPU. We introduce CORTEG, a cross-modality transfer framework that combines a pretrained EEG FM backbone, an electrode-aware KNNSoftFourier spatial adapter, a dual-stream tokenizer for low-frequency and high-gamma activity, and a leave-one-subject-out fine-tuning strategy. We evaluate CORTEG on two challenging regression tasks: public finger trajectory regression (n=9) and private audio envelope regression (n=16). CORTEG matches or exceeds the strongest task-specific baselines on both tasks: it reaches the highest mean correlation among compared methods on the public finger benchmark (gain not statistically significant on n=9 subjects), with larger and statistically significant gains on the audio task and in low-data per-patient calibration. Feature analyses align with neurophysiology, and latent manifolds capture low-dimensional finger-movement structure. CORTEG provides systematic evidence that scalp-EEG pretraining can be repurposed for ECoG decoding, enabling data-efficient intracranial BCIs that can adapt to new patients.

📄 PDF Abstract BibTeX arXiv:2605.10337

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Divide and Conquer: Decoupled Representation Alignment for Multimodal World Models

2026-05-03 · Junyuan Xiao, Dingkang Liang, Xin Zhou, Yixuan Ye 외 arxiv

Emerging multi-modal world models attempt to jointly generate videos across diverse modalities (e.g., RGB, depth, and mask), yet they fail to fully exploit the rich priors of existing foundation models. We propose $M^2$-…

Video Generation

M-IDoL: Information Decomposition for Modality-Specific and Diverse Representation Learning in Medical Foundation Model

2026-04-10 · Yihang Liu, Longzhen Yang, Jiaxiong Yang, Ying Wen 외 arxiv

Medical foundation models (MFMs) aim to learn universal representations from multimodal medical images that can generalize effectively to diverse downstream clinical tasks. However, most existing MFMs suffer from informa…

Representation Learning

Multimodal Wireless Foundation Models

2025-11-19 · Ahmed Aboulfotouh, Hatem Abou-Zeid arxiv

Wireless foundation models (WFMs) have recently demonstrated promising capabilities, jointly performing multiple wireless functions and adapting effectively to new environments. However, while current WFMs process only o…

MMSense: Adapting Vision-based Foundation Model for Multi-task Multi-modal Wireless Sensing

2025-11-15 · Zhizhen Li, Xuanhao Luo, Xueren Ge, Longyu Zhou 외 arxiv

Large AI models have been widely adopted in wireless communications for channel modeling, beamforming, and resource optimization. However, most existing efforts remain limited to single-modality inputs and channel-specif…

GeoMeld: Toward Semantically Grounded Foundation Models for Remote Sensing

2026-04-12 · Maram Hasan, Md Aminur Hossain, Savitra Roy, Souparna Bhowmik 외 arxiv

Effective foundation modeling in remote sensing requires spatially aligned heterogeneous modalities coupled with semantically grounded supervision, yet such resources remain limited at scale. We present GeoMeld, a large-…

Representation Learning