Learning from Heterogeneous EEG Signals with Differentiable Channel Reordering
We propose CHARM, a method for training a single neural network across inconsistent input channels. Our work is motivated by Electroencephalography (EEG), where data collection protocols from different headsets result in varying channel ordering and number, which limits the feasibility of transferring trained systems across datasets. Our approach builds upon attention mechanisms to estimate a latent reordering matrix from each input signal and map input channels to a canonical order. CHARM is differentiable and can be composed further with architectures expecting a consistent channel ordering to build end-to-end trainable classifiers. We perform experiments on four EEG classification datasets and demonstrate the efficacy of CHARM via simulated shuffling and masking of input channels. Moreover, our method improves the transfer of pre-trained representations between datasets collected with different protocols.
Code (0)
등록된 구현이 없습니다.
Tasks
EEGElectroencephalogram (EEG)Similar Papers 제목 키워드 기반
PermLLM: Learnable Channel Permutation for N:M Sparse Large Language Models
Channel permutation is a powerful technique for enhancing the accuracy of N:M sparse models by reordering the channels of weight matrices to prioritize the retention of important weights. However, traditional channel per…
DM3D: Deformable Mamba via Offset-Guided Differentiable Scanning for Point Cloud Understanding
State Space Models (SSMs) show significant potential for long-sequence modeling, but their reliance on input order conflicts with the irregular nature of point clouds. Existing approaches often rely on predefined seriali…
Few-Shot LearningPoint CloudsSelf-Supervised Learning of Audio Representations from Permutations with Differentiable Ranking
Self-supervised pre-training using so-called "pretext" tasks has recently shown impressive performance across a wide range of modalities. In this work, we advance self-supervised learning from permutations, by pre-traini…
ClassificationGeneral ClassificationSelf-Supervised LearningShuffle to Learn: Self-supervised learning from permutations via differentiable ranking
Self-supervised pre-training using so-called "pretext" tasks has recently shown impressive performance across a wide range of tasks. In this work we advance self-supervised learning from permutations, that consists in sh…
General ClassificationSelf-Supervised LearningVideo ClassificationCompositional Generalisation with Structured Reordering and Fertility Layers
Seq2seq models have been shown to struggle with compositional generalisation, i.e. generalising to new and potentially more complex structures than seen during training. Taking inspiration from grammar-based models that …
Semantic Parsing