paper-with-me

Papers

A Deep Knowledge Distillation framework for EEG assisted enhancement of single-lead ECG based sleep staging

2021-12-14 · Vaibhav Joshi, Sricharan Vijayarangan, Preejith SP, Mohanasankar Sivaprakasam

Automatic Sleep Staging study is presently done with the help of Electroencephalogram (EEG) signals. Recently, Deep Learning (DL) based approaches have enabled significant progress in this area, allowing for near-human accuracy in automated sleep staging. However, EEG based sleep staging requires an extensive as well as an expensive clinical setup. Moreover, the requirement of an expert for setup and the added inconvenience to the subject under study renders it unfavourable in a point of care context. Electrocardiogram (ECG), an unobtrusive alternative to EEG, is more suitable, but its performance, unsurprisingly, remains sub-par compared to EEG-based sleep staging. Naturally, it would be helpful to transfer knowledge from EEG to ECG, ultimately enhancing the model's performance on ECG based inputs. Knowledge Distillation (KD) is a renowned concept in DL that looks to transfer knowledge from a better but potentially more cumbersome teacher model to a compact student model. Building on this concept, we propose a cross-modal KD framework to improve ECG-based sleep staging performance with assistance from features learned through models trained on EEG. Additionally, we also conducted multiple experiments on the individual components of the proposed model to get better insight into the distillation approach. Data of 200 subjects from the Montreal Archive of Sleep Studies (MASS) was utilized for our study. The proposed model showed a 14.3\% and 13.4\% increase in weighted-F1-score in 4-class and 3-class sleep staging, respectively. This demonstrates the viability of KD for performance improvement of single-channel ECG based sleep staging in 4-class(W-L-D-R) and 3-class(W-N-R) classification.

📄 PDF Abstract BibTeX arXiv:2112.07252

Code (1)

acrophase/sleep_staging_kd 공식 구현 pytorch

Tasks

ECG based Sleep StagingEEGEEG based sleep stagingElectroencephalogram (EEG)Knowledge DistillationSleep Stage DetectionSleep StagingW-R-L-D Sleep StagingW-R-N Sleep Staging

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…
Teacher-Tutor-Student Knowledge Distillation Teacher-Tutor-Student Knowledge Distillation is a method for image virtual try-on models. It treats fake images produced by the parser-based method as "tutor knowledge", where…

Similar Papers 제목 키워드 기반

Sub-Band Knowledge Distillation Framework for Speech Enhancement

2020-05-29 · Xiang Hao, Shixue Wen, Xiangdong Su, Yun Liu 외

In single-channel speech enhancement, methods based on full-band spectral features have been widely studied. However, only a few methods pay attention to non-full-band spectral features. In this paper, we explore a knowl…

Knowledge DistillationSpeech Enhancement

Injecting Spatial Information for Monaural Speech Enhancement via Knowledge Distillation

2022-12-02 · Xinmeng Xu, Weiping tu, Yuhong Yang

Monaural speech enhancement (SE) provides a versatile and cost-effective approach to SE tasks by utilizing recordings from a single microphone. However, the monaural SE lags performance behind multi-channel SE as the mon…

Knowledge DistillationSpeech Enhancement

Pushing the Limits of Distillation-Based Continual Learning via Classifier-Proximal Lightweight Plugins

2025-12-03 · Zhiming Xu, Baile Xu, Jian Zhao, Furao Shen 외 arxiv

Continual learning requires models to learn continuously while preserving prior knowledge under evolving data streams. Distillation-based methods are appealing for retaining past knowledge in a shared single-model framew…

Continual Learning

MetricGAN-OKD: Multi-Metric Optimization of MetricGAN via Online Knowledge Distillation for Speech Enhancement

2023-07-24 · ICML 2023 7 · WooSeok Shin, Byung Hoon Lee, Jin Sob Kim, Hyun Joon Park 외

In speech enhancement, MetricGAN-based approaches reduce the discrepancy between the $L_p$ loss and evaluation metrics by utilizing a non-differentiable evaluation metric as the objective function. However, optimizing mu…

Knowledge DistillationSpeech Enhancement

SDAKD: Student Discriminator Assisted Knowledge Distillation for Super-Resolution Generative Adversarial Networks

2025-10-04 · Nikolaos Kaparinos, Vasileios Mezaris arxiv

Generative Adversarial Networks (GANs) achieve excellent performance in generative tasks, such as image super-resolution, but their computational requirements make difficult their deployment on resource-constrained devic…

Knowledge DistillationImage Super-Resolution