paper-with-me

Papers

EEGDM: Learning EEG Representation with Latent Diffusion Model

2025-08-28 · Shaocong Wang, Tong Liu, Yihan Li, Ming Li, Kairui Wen, Pei Yang, Wenqi Ji, Minjing Yu, Yong-Jin Liu arxiv

Recent advances in self-supervised learning for EEG representation have largely relied on masked reconstruction, where models are trained to recover randomly masked signal segments. While effective at modeling local dependencies, such objectives are inherently limited in capturing the global dynamics and long-range dependencies essential for characterizing neural activity. To address this limitation, we propose EEGDM, a novel self-supervised framework that leverages latent diffusion models to generate EEG signals as an objective. Unlike masked reconstruction, diffusion-based generation progressively denoises signals from noise to realism, compelling the model to capture holistic temporal patterns and cross-channel relationships. Specifically, EEGDM incorporates an EEG encoder that distills raw signals and their channel augmentations into a compact representation, acting as conditional information to guide the diffusion model for generating EEG signals. This design endows EEGDM with a compact latent space, which not only offers ample control over the generative process but also can be leveraged for downstream tasks. Experimental results show that EEGDM (1) reconstructs high-quality EEG signals, (2) learns robust representations, and (3) achieves competitive performance across diverse downstream tasks, thus exploring a new direction for self-supervised EEG representation learning.

📄 PDF Abstract BibTeX arXiv:2508.20705

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised LearningRepresentation Learning

Similar Papers 제목 키워드 기반

EEGDM: EEG Representation Learning via Generative Diffusion Model

2025-08-13 · Jia Hong Puah, Sim Kuan Goh, Ziwei Zhang, Zixuan Ye 외 arxiv

While electroencephalogram (EEG) has been a crucial tool for monitoring the brain and diagnosing neurological disorders (e.g., epilepsy), learning meaningful representations from raw EEG signals remains challenging due t…

Representation Learning

InfoDiffusion: Representation Learning Using Information Maximizing Diffusion Models

2023-06-14 · Yingheng Wang, Yair Schiff, Aaron Gokaslan, Weishen Pan 외

While diffusion models excel at generating high-quality samples, their latent variables typically lack semantic meaning and are not suitable for representation learning. Here, we propose InfoDiffusion, an algorithm that …

Representation Learning

How to Train Your Latent Diffusion Language Model Jointly With the Latent Space

2026-05-08 · Viacheslav Meshchaninov, Alexander Shabalin, Egor Chimbulatov, Nikita Gushchin 외 arxiv

Latent diffusion models offer an attractive alternative to discrete diffusion for non-autoregressive text generation by operating on continuous text representations and denoising entire sequences in parallel. The major c…

Text Generation

Discriminative protein sequence modelling with Latent Space Diffusion

2025-03-24 · Eoin Quinn, Ghassene Jebali, Maxime Seince, Oliver Bent

We explore a framework for protein sequence representation learning that decomposes the task between manifold learning and distributional modelling. Specifically we present a Latent Space Diffusion architecture which com…

DenoisingLanguage ModelingLanguage ModellingProperty Prediction+1

DiffVoice: Text-to-Speech with Latent Diffusion

2023-04-23 · Zhijun Liu, Yiwei Guo, Kai Yu

In this work, we present DiffVoice, a novel text-to-speech model based on latent diffusion. We propose to first encode speech signals into a phoneme-rate latent representation with a variational autoencoder enhanced by a…

text-to-speechText to Speech