paper-with-me

홈 › Papers

MBrain: A Multi-channel Self-Supervised Learning Framework for Brain Signals

2023-06-15 · Donghong Cai, Junru Chen, Yang Yang, Teng Liu, Yafeng Li

Brain signals are important quantitative data for understanding physiological activities and diseases of human brain. Most existing studies pay attention to supervised learning methods, which, however, require high-cost clinical labels. In addition, the huge difference in the clinical patterns of brain signals measured by invasive (e.g., SEEG) and non-invasive (e.g., EEG) methods leads to the lack of a unified method. To handle the above issues, we propose to study the self-supervised learning (SSL) framework for brain signals that can be applied to pre-train either SEEG or EEG data. Intuitively, brain signals, generated by the firing of neurons, are transmitted among different connecting structures in human brain. Inspired by this, we propose MBrain to learn implicit spatial and temporal correlations between different channels (i.e., contacts of the electrode, corresponding to different brain areas) as the cornerstone for uniformly modeling different types of brain signals. Specifically, we represent the spatial correlation by a graph structure, which is built with proposed multi-channel CPC. We theoretically prove that optimizing the goal of multi-channel CPC can lead to a better predictive representation and apply the instantaneou-time-shift prediction task based on it. Then we capture the temporal correlation by designing the delayed-time-shift prediction task. Finally, replace-discriminative-learning task is proposed to preserve the characteristics of each channel. Extensive experiments of seizure detection on both EEG and SEEG large-scale real-world datasets demonstrate that our model outperforms several state-of-the-art time series SSL and unsupervised models, and has the ability to be deployed to clinical practice.

📄 PDF Abstract BibTeX arXiv:2306.13102

Code (0)

등록된 구현이 없습니다.

Tasks

EEGSeizure DetectionSelf-Supervised Learning

Similar Papers 제목 키워드 기반

CaMBRAIN: Real-time, Continuous EEG Inference with Causal State Space Models

2026-05-27 · Abhilash Durgam, Nyle Siddiqui, Jeffrey A. Chan-Santiago, Qiushi Fu 외 arxiv

Electroencephalography (EEG) is a critical, non-invasive method to monitor electrical brain activity. EEGs can span anywhere from a couple seconds to multiple hours, posing a major hurdle for existing deep learning metho…

StreamBrain: An HPC Framework for Brain-like Neural Networks on CPUs, GPUs and FPGAs

2021-06-09 · Artur Podobas, Martin Svedin, Steven W. D. Chien, Ivy B. Peng 외

The modern deep learning method based on backpropagation has surged in popularity and has been used in multiple domains and application areas. At the same time, there are other -- less-known -- machine learning algorithm…

BIG-bench Machine Learning

SwarmBrain: Embodied agent for real-time strategy game StarCraft II via large language models

2024-01-31 · Xiao Shao, Weifu Jiang, Fei Zuo, Mengqing Liu

Large language models (LLMs) have recently garnered significant accomplishments in various exploratory tasks, even surpassing the performance of traditional reinforcement learning-based methods that have historically dom…

StarcraftStarcraft II

Higgs Boson Classification: Brain-inspired BCPNN Learning with StreamBrain

2021-07-14 · Martin Svedin, Artur Podobas, Steven W. D. Chien, Stefano Markidis

One of the most promising approaches for data analysis and exploration of large data sets is Machine Learning techniques that are inspired by brain models. Such methods use alternative learning rules potentially more eff…

Classification

Self-Supervised Learning for Multi-Channel Neural Transducer

2024-08-06 · Atsushi Kojima

Self-supervised learning, such as with the wav2vec 2.0 framework significantly improves the accuracy of end-to-end automatic speech recognition (ASR). Wav2vec 2.0 has been applied to single-channel end-to-end ASR models.…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)QuantizationSelf-Supervised Learning+2