paper-with-me

홈 › Papers

Multi-Domain EEG Representation Learning with Orthogonal Mapping and Attention-based Fusion for Cognitive Load Classification

2025-11-16 · Prithila Angkan, Amin Jalali, Paul Hungler, Ali Etemad arxiv

We propose a new representation learning solution for the classification of cognitive load based on Electroencephalogram (EEG). Our method integrates both time and frequency domains by first passing the raw EEG signals through the convolutional encoder to obtain the time domain representations. Next, we measure the Power Spectral Density (PSD) for all five EEG frequency bands and generate the channel power values as 2D images referred to as multi-spectral topography maps. These multi-spectral topography maps are then fed to a separate encoder to obtain the representations in frequency domain. Our solution employs a multi-domain attention module that maps these domain-specific embeddings onto a shared embedding space to emphasize more on important inter-domain relationships to enhance the representations for cognitive load classification. Additionally, we incorporate an orthogonal projection constraint during the training of our method to effectively increase the inter-class distances while improving intra-class clustering. This enhancement allows efficient discrimination between different cognitive states and aids in better grouping of similar states within the feature space. We validate the effectiveness of our model through extensive experiments on two public EEG datasets, CL-Drive and CLARE for cognitive load classification. Our results demonstrate the superiority of our multi-domain approach over the traditional single-domain techniques. Moreover, we conduct ablation and sensitivity analyses to assess the impact of various components of our method. Finally, robustness experiments on different amounts of added noise demonstrate the stability of our method compared to other state-of-the-art solutions.

📄 PDF Abstract BibTeX arXiv:2511.12394

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Entangled Residual Mappings

2022-06-02 · Mathias Lechner, Ramin Hasani, Zahra Babaiee, Radu Grosu 외

Residual mappings have been shown to perform representation learning in the first layers and iterative feature refinement in higher layers. This interplay, combined with their stabilizing effect on the gradient norms, en…

Inductive BiasRepresentation Learning

Revisiting Attention for Multivariate Time Series Forecasting

2024-07-18 · Haixiang Wu

Current Transformer methods for Multivariate Time-Series Forecasting (MTSF) are all based on the conventional attention mechanism. They involve sequence embedding and performing a linear projection of Q, K, and V, and th…

Multivariate Time Series ForecastingTime SeriesTime Series Forecasting

Orthogonal Self-Attention

2026-02-05 · Leo Zhang, James Martens arxiv

Softmax Self-Attention (SSA) is a key component of Transformer architectures. However, when utilised within skipless architectures, which aim to improve representation learning, recent work has highlighted the inherent i…

Representation Learning

Unsupervised Disentanglement Without Compromises : How Functional Orthogonality Enforces Identifiability

2026-06-19 · Mathieu Cyrille Simon, Pascal Frossard, Christophe De Vleeschouwer arxiv

This paper explores unsupervised disentangled representation learning from a functional perspective. We define latent concepts as factors that influence observations through locally orthogonal directions, formalized as a…

Representation Learning

O-ViT: Orthogonal Vision Transformer

2022-01-28 · Yanhong Fei, Yingjie Liu, Xian Wei, Mingsong Chen

Inspired by the tremendous success of the self-attention mechanism in natural language processing, the Vision Transformer (ViT) creatively applies it to image patch sequences and achieves incredible performance. However,…