PSDNorm: Test-Time Temporal Normalization for Deep Learning in Sleep Staging
Distribution shift poses a significant challenge in machine learning, particularly in biomedical applications using data collected across different subjects, institutions, and recording devices, such as sleep data. While existing normalization layers, BatchNorm, LayerNorm and InstanceNorm, help mitigate distribution shifts, when applied over the time dimension they ignore the dependencies and auto-correlation inherent to the vector coefficients they normalize. In this paper, we propose PSDNorm that leverages Monge mapping and temporal context to normalize feature maps in deep learning models for signals. Notably, the proposed method operates as a test-time domain adaptation technique, addressing distribution shifts without additional training. Evaluations with architectures based on U-Net or transformer backbones trained on 10K subjects across 10 datasets, show that PSDNorm achieves state-of-the-art performance on unseen left-out datasets while being 4-times more data-efficient than BatchNorm.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationSleep StagingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ST-USleepNet: A Spatial-Temporal Coupling Prominence Network for Multi-Channel Sleep Staging
Sleep staging is critical to assess sleep quality and diagnose disorders. Despite advancements in artificial intelligence enabling automated sleep staging, significant challenges remain: (1) Simultaneously extracting pro…
graph constructionImage SegmentationSemantic SegmentationSleep Quality+1Convolutional Monge Mapping Normalization for learning on sleep data
In many machine learning applications on signals and biomedical data, especially electroencephalogram (EEG), one major challenge is the variability of the data across subjects, sessions, and hardware devices. In this wor…
Domain AdaptationEEGElectroencephalogram (EEG)Test-time AdaptationThe Objective and Subjective Sleepiness Voice Corpora
Following patients with chronic sleep disorders involves multiple appointments between doctors and patients which often results in episodic follow-ups with unevenly spaced interviews. Speech technologies and virtual doct…
Convolution Monge Mapping Normalization for learning on sleep data
In many machine learning applications on signals and biomedical data, especially electroencephalogram (EEG), one major challenge is the variability of the data across subjects, sessions, and hardware devices. In this wor…
Evaluating the Influence of Temporal Context on Automatic Mouse Sleep Staging through the Application of Human Models
In human sleep staging models, augmenting the temporal context of the input to the range of tens of minutes has recently demonstrated performance improvement. In contrast, the temporal context of mouse sleep staging mode…
Sleep Staging