Foundation Model Hidden Representations for Heart Rate Estimation from Auscultation
Auscultation, particularly heart sound, is a non-invasive technique that provides essential vital sign information. Recently, self-supervised acoustic representation foundation models (FMs) have been proposed to offer insights into acoustics-based vital signs. However, there has been little exploration of the extent to which auscultation is encoded in these pre-trained FM representations. In this work, using a publicly available phonocardiogram (PCG) dataset and a heart rate (HR) estimation model, we conduct a layer-wise investigation of six acoustic representation FMs: HuBERT, wav2vec2, wavLM, Whisper, Contrastive Language-Audio Pretraining (CLAP), and an in-house CLAP model. Additionally, we implement the baseline method from Nie et al., 2024 (which relies on acoustic features) and show that overall, representation vectors from pre-trained foundation models (FMs) offer comparable performance to the baseline. Notably, HR estimation using the representations from the audio encoder of the in-house CLAP model outperforms the results obtained from the baseline, achieving a lower mean absolute error (MAE) across various train/validation/test splits despite the domain mismatch.
Code (0)
등록된 구현이 없습니다.
Tasks
Heart rate estimationSimilar Papers 제목 키워드 기반
BeliefPPG: Uncertainty-aware Heart Rate Estimation from PPG signals via Belief Propagation
We present a novel learning-based method that achieves state-of-the-art performance on several heart rate estimation benchmarks extracted from photoplethysmography signals (PPG). We consider the evolution of the heart ra…
Heart rate estimationPhotoplethysmography (PPG) heart rate estimationTime Series AnalysisTime Series Anomaly DetectionLeveraging Deep Representations of Radiology Reports in Survival Analysis for Predicting Heart Failure Patient Mortality
Utilizing clinical texts in survival analysis is difficult because they are largely unstructured. Current automatic extraction models fail to capture textual information comprehensively since their labels are limited in …
Survival AnalysisParameterization of state duration in Hidden semi-Markov Models: an application in electrocardiography
This work aims at providing a new model for time series classification based on learning from just one example. We assume that time series can be well characterized as a parametric random process, a sort of Hidden semi-M…
Heartbeat ClassificationTime SeriesTime Series AnalysisTime Series ClassificationListen2YourHeart: A Self-Supervised Approach for Detecting Murmur in Heart-Beat Sounds
Heart murmurs are abnormal sounds present in heartbeats, caused by turbulent blood flow through the heart. The PhysioNet 2022 challenge targets automatic detection of murmur from audio recordings of the heart and automat…
Self-Supervised LearningA Robust Interpretable Deep Learning Classifier for Heart Anomaly Detection Without Segmentation
Traditionally, abnormal heart sound classification is framed as a three-stage process. The first stage involves segmenting the phonocardiogram to detect fundamental heart sounds; after which features are extracted and cl…
Anomaly DetectionClassificationExplainable artificial intelligenceGeneral Classification+2