paper-with-me

Papers

Optimizing Audio Augmentations for Contrastive Learning of Health-Related Acoustic Signals

2023-09-11 · Louis Blankemeier, Sebastien Baur, Wei-Hung Weng, Jake Garrison, Yossi Matias, Shruthi Prabhakara, Diego Ardila, Zaid Nabulsi

Health-related acoustic signals, such as cough and breathing sounds, are relevant for medical diagnosis and continuous health monitoring. Most existing machine learning approaches for health acoustics are trained and evaluated on specific tasks, limiting their generalizability across various healthcare applications. In this paper, we leverage a self-supervised learning framework, SimCLR with a Slowfast NFNet backbone, for contrastive learning of health acoustics. A crucial aspect of optimizing Slowfast NFNet for this application lies in identifying effective audio augmentations. We conduct an in-depth analysis of various audio augmentation strategies and demonstrate that an appropriate augmentation strategy enhances the performance of the Slowfast NFNet audio encoder across a diverse set of health acoustic tasks. Our findings reveal that when augmentations are combined, they can produce synergistic effects that exceed the benefits seen when each is applied individually.

📄 PDF Abstract BibTeX arXiv:2309.05843

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningMedical DiagnosisSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Bitcoin Customer Service Number +1-833-534-1729 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Average Pooling 설명 없음
Residual Connection 설명 없음
Batch Normalization 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Kaiming Initialization 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…

Similar Papers 제목 키워드 기반

The Impact of Spatiotemporal Augmentations on Self-Supervised Audiovisual Representation Learning

2021-10-13 · Haider Al-Tahan, Yalda Mohsenzadeh

Contrastive learning of auditory and visual perception has been extremely successful when investigated individually. However, there are still major questions on how we could integrate principles learned from both domains…

Contrastive LearningRepresentation LearningSelf-Supervised Learning

Feature Dropout: Revisiting the Role of Augmentations in Contrastive Learning

2023-09-21 · NeurIPS 2023 11

What role do augmentations play in contrastive learning? Recent work suggests that good augmentations are label-preserving with respect to a specific downstream task. We complicate this picture by showing that label-dest…

Automatic Data Augmentation Selection and Parametrization in Contrastive Self-Supervised Speech Representation Learning

2022-04-08 · Salah Zaiem, Titouan Parcollet, Slim Essid

Contrastive learning enables learning useful audio and speech representations without ground-truth labels by maximizing the similarity between latent representations of similar signal segments. In this framework various …

Contrastive LearningData AugmentationRepresentation LearningSpeech Representation Learning

EquiAV: Leveraging Equivariance for Audio-Visual Contrastive Learning

2024-03-14 · Jongsuk Kim, Hyeongkeun Lee, Kyeongha Rho, Junmo Kim 외

Recent advancements in self-supervised audio-visual representation learning have demonstrated its potential to capture rich and comprehensive representations. However, despite the advantages of data augmentation verified…

Audio Classificationaudio-visual learningContrastive LearningData Augmentation+1

Anomalous Sound Detection using Audio Representation with Machine ID based Contrastive Learning Pretraining

2023-04-07 · Jian Guan, Feiyang Xiao, Youde Liu, Qiaoxi Zhu 외

Existing contrastive learning methods for anomalous sound detection refine the audio representation of each audio sample by using the contrast between the samples' augmentations (e.g., with time or frequency masking). Ho…

Anomaly DetectionContrastive Learning