Federated Self-Supervised Learning for Acoustic Event Classification
Standard acoustic event classification (AEC) solutions require large-scale collection of data from client devices for model optimization. Federated learning (FL) is a compelling framework that decouples data collection and model training to enhance customer privacy. In this work, we investigate the feasibility of applying FL to improve AEC performance while no customer data can be directly uploaded to the server. We assume no pseudo labels can be inferred from on-device user inputs, aligning with the typical use cases of AEC. We adapt self-supervised learning to the FL framework for on-device continual learning of representations, and it results in improved performance of the downstream AEC classifiers without labeled/pseudo-labeled data available. Compared to the baseline w/o FL, the proposed method improves precision up to 20.3\% relatively while maintaining the recall. Our work differs from prior work in FL in that our approach does not require user-generated learning targets, and the data we use is collected from our Beta program and is de-identified, to maximally simulate the production settings.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationContinual LearningFederated LearningModel OptimizationSelf-Supervised LearningSimilar Papers 제목 키워드 기반
Perceptual Loss based Speech Denoising with an ensemble of Audio Pattern Recognition and Self-Supervised Models
Deep learning based speech denoising still suffers from the challenge of improving perceptual quality of enhanced signals. We introduce a generalized framework called Perceptual Ensemble Regularization Loss (PERL) built …
DenoisingEmotion ClassificationMulti-Task LearningSpeech DenoisingUnsupervised Clustered Federated Learning in Complex Multi-source Acoustic Environments
In this paper we introduce a realistic and challenging, multi-source and multi-room acoustic environment and an improved algorithm for the estimation of source-dominated microphone clusters in acoustic sensor networks. O…
ClusteringFederated LearningSemi-supervised Acoustic Event Detection based on tri-training
This paper presents our work of training acoustic event detection (AED) models using unlabeled dataset. Recent acoustic event detectors are based on large-scale neural networks, which are typically trained with huge amou…
Event DetectionKnowledge DistillationEstimation of Microphone Clusters in Acoustic Sensor Networks using Unsupervised Federated Learning
In this paper we present a privacy-aware method for estimating source-dominated microphone clusters in the context of acoustic sensor networks (ASNs). The approach is based on clustered federated learning which we adapt …
ClusteringFederated LearningAcoustic scattering AI for non-invasive object classifications: A case study on hair assessment
This paper presents a novel non-invasive object classification approach using acoustic scattering, demonstrated through a case study on hair assessment. When an incident wave interacts with an object, it generates a scat…
ClassificationDeep LearningPrivacy PreservingSound Classification