SingLEM: Single-Channel Large EEG Model
Current deep learning models for electroencephalography (EEG) are often task-specific and depend on large labeled datasets, limiting their adaptability. Although emerging foundation models aim for broader applicability, their rigid dependence on fixed, high-density multi-channel montages restricts their use across heterogeneous datasets and in missing-channel or practical low-channel settings. To address these limitations, we introduce SingLEM, a self-supervised foundation model that learns robust, general-purpose representations from single-channel EEG, making it inherently hardware agnostic. The model employs a hybrid encoder architecture that combines convolutional layers to extract local features with a hierarchical transformer to model both short- and long-range temporal dependencies. SingLEM is pretrained on 71 public datasets comprising over 9,200 subjects and 357,000 single-channel hours of EEG. When evaluated as a fixed feature extractor across six motor imagery and cognitive tasks, aggregated single-channel representations consistently outperformed leading multi-channel foundation models and handcrafted baselines. These results demonstrate that a single-channel approach can achieve state-of-the-art generalization while enabling fine-grained neurophysiological analysis and enhancing interpretability. The source code and pretrained models are available at https://github.com/ttlabtuat/SingLEM.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
S-Omninet: Structured Data Enhanced Universal Multimodal Learning Architecture
Multimodal multitask learning has attracted an increasing interest in recent years. Singlemodal models have been advancing rapidly and have achieved astonishing results on various tasks across multiple domains. Multimoda…
Revisiting the nonlinear Gaussian noise model: The case of hybrid fiber spans
We rederive from first principles and generalize the theoretical framework of the nonlinear Gaussian noise model to the case of coherent optical systems with multiple fiber types per span and ideal Nyquist spectra. We fo…
Soft Correspondences in Multimodal Scene Parsing
Exploiting multiple modalities for semantic scene parsing has been shown to improve accuracy over the singlemodality scenario. However multimodal datasets often suffer from problems such as data misalignment and label in…
Scene ParsingLearning diffusion coefficients, kinetic parameters, and the number of underlying states from a multi-state diffusion process: robustness results and application to PDK1/PKC$α$, dynamics
Systems driven by Brownian motion are ubiquitous. A prevailing challenge is inferring, from data, the diffusion and kinetic parameters that describe these stochastic processes. In this work, we investigate a multi-state …
Model SelectionLarge Intelligent Surfaces with Channel Estimation Overhead: Achievable Rate and Optimal Configuration
Large intelligent surfaces (LIS) present a promising new technology for enhancing the performance of wireless communication systems. Realizing the gains of LIS requires accurate channel knowledge, and in practice the cha…