MC2SleepNet: Multi-modal Cross-masking with Contrastive Learning for Sleep Stage Classification
Sleep profoundly affects our health, and sleep deficiency or disorders can cause physical and mental problems. Despite significant findings from previous studies, challenges persist in optimizing deep learning models, especially in multi-modal learning for high-accuracy sleep stage classification. Our research introduces MC2SleepNet (Multi-modal Cross-masking with Contrastive learning for Sleep stage classification Network). It aims to facilitate the effective collaboration between Convolutional Neural Networks (CNNs) and Transformer architectures for multi-modal training with the help of contrastive learning and cross-masking. Raw single channel EEG signals and corresponding spectrogram data provide differently characterized modalities for multi-modal learning. Our MC2SleepNet has achieved state-of-the-art performance with an accuracy of both 84.6% on the SleepEDF-78 and 88.6% accuracy on the Sleep Heart Health Study (SHHS). These results demonstrate the effective generalization of our proposed network across both small and large datasets.
Code (1)
Tasks
Contrastive LearningEEGSleep Stage DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Toward Foundational Model for Sleep Analysis Using a Multimodal Hybrid Self-Supervised Learning Framework
Sleep is essential for maintaining human health and quality of life. Analyzing physiological signals during sleep is critical in assessing sleep quality and diagnosing sleep disorders. However, manual diagnoses by clinic…
Contrastive LearningDiagnosticEEGElectroencephalogram (EEG)+6ULW-SleepNet: An Ultra-Lightweight Network for Multimodal Sleep Stage Scoring
Automatic sleep stage scoring is crucial for the diagnosis and treatment of sleep disorders. Although deep learning models have advanced the field, many existing models are computationally demanding and designed for sing…
SalientSleepNet: Multimodal Salient Wave Detection Network for Sleep Staging
Sleep staging is fundamental for sleep assessment and disease diagnosis. Although previous attempts to classify sleep stages have achieved high classification performance, several challenges remain open: 1) How to effect…
object-detectionObject DetectionSalient Object DetectionSleep StagingInfMasking: Unleashing Synergistic Information by Contrastive Multimodal Interactions
In multimodal representation learning, synergistic interactions between modalities not only provide complementary information but also create unique outcomes through specific interaction patterns that no single modality …
Representation LearningInformation ExtractionA Conflict-aware Evidential Framework for Reliable Sleep Stage Classification
Multi-view learning has been widely applied for sleep stage classification using multi-modal data. However, existing methods typically assume that different modalities are well-aligned, which is often unattainable in rea…