paper-with-me

홈 › Papers

Knowledge-guided EEG Representation Learning

2024-02-15 · Aditya Kommineni, Kleanthis Avramidis, Richard Leahy, Shrikanth Narayanan

Self-supervised learning has produced impressive results in multimedia domains of audio, vision and speech. This paradigm is equally, if not more, relevant for the domain of biosignals, owing to the scarcity of labelled data in such scenarios. The ability to leverage large-scale unlabelled data to learn robust representations could help improve the performance of numerous inference tasks on biosignals. Given the inherent domain differences between multimedia modalities and biosignals, the established objectives for self-supervised learning may not translate well to this domain. Hence, there is an unmet need to adapt these methods to biosignal analysis. In this work we propose a self-supervised model for EEG, which provides robust performance and remarkable parameter efficiency by using state space-based deep learning architecture. We also propose a novel knowledge-guided pre-training objective that accounts for the idiosyncrasies of the EEG signal. The results indicate improved embedding representation learning and downstream performance compared to prior works on exemplary tasks. Also, the proposed objective significantly reduces the amount of pre-training data required to obtain performance equivalent to prior works.

📄 PDF Abstract BibTeX arXiv:2403.03222

Code (0)

등록된 구현이 없습니다.

Tasks

EEGRepresentation LearningSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Complementarity-driven Representation Learning for Multi-modal Knowledge Graph Completion

2025-07-28 · Lijian Li arxiv

Multi-modal Knowledge Graph Completion (MMKGC) aims to uncover hidden world knowledge in multimodal knowledge graphs by leveraging both multimodal and structural entity information. However, the inherent imbalance in mul…

Knowledge Graph CompletionRepresentation LearningKnowledge Graphs

Abstract Meaning Representation Guided Graph Encoding and Decoding for Joint Information Extraction

2021-06-01 · NAACL 2021 4 · Zixuan Zhang, Heng Ji

The tasks of Rich Semantic Parsing, such as Abstract Meaning Representation (AMR), share similar goals with Information Extraction (IE) to convert natural language texts into structured semantic representations. To take …

Abstract Meaning RepresentationDecoderSemantic Parsing

Learning Protein Structure-Function Relationships through Knowledge-guided Representation Decomposition

2026-05-12 · Mingqing Wang, Zhiwei Nie, Athanasios V. Vasilakos, Yonghong He 외 arxiv

Proteins encode diverse functions within complex three-dimensional structures, yet most deep learning representations remain highly entangled, obscuring the biophysical signals that underlie function. Here we introduce P…

Knowledge-Guided Masked Autoencoder with Linear Spectral Mixing and Spectral-Angle-Aware Reconstruction

2025-12-13 · Abdul Matin, Rupasree Dey, Tanjim Bin Faruk, Shrideep Pallickara 외 arxiv

Integrating domain knowledge into deep learning has emerged as a promising direction for improving model interpretability, generalization, and data efficiency. In this work, we present a novel knowledge-guided ViT-based …

Self-Supervised Learning

MLIP: Enhancing Medical Visual Representation with Divergence Encoder and Knowledge-guided Contrastive Learning

2024-02-03 · CVPR 2024 1 · Zhe Li, Laurence T. Yang, Bocheng Ren, Xin Nie 외

The scarcity of annotated data has sparked significant interest in unsupervised pre-training methods that leverage medical reports as auxiliary signals for medical visual representation learning. However, existing resear…

Contrastive Learningimage-classificationImage Classificationobject-detection+4