paper-with-me

홈 › Papers

Federated Self-Supervised Learning for Acoustic Event Classification

2022-03-22 · Meng Feng, Chieh-Chi Kao, Qingming Tang, Ming Sun, Viktor Rozgic, Spyros Matsoukas, Chao Wang

Standard acoustic event classification (AEC) solutions require large-scale collection of data from client devices for model optimization. Federated learning (FL) is a compelling framework that decouples data collection and model training to enhance customer privacy. In this work, we investigate the feasibility of applying FL to improve AEC performance while no customer data can be directly uploaded to the server. We assume no pseudo labels can be inferred from on-device user inputs, aligning with the typical use cases of AEC. We adapt self-supervised learning to the FL framework for on-device continual learning of representations, and it results in improved performance of the downstream AEC classifiers without labeled/pseudo-labeled data available. Compared to the baseline w/o FL, the proposed method improves precision up to 20.3\% relatively while maintaining the recall. Our work differs from prior work in FL in that our approach does not require user-generated learning targets, and the data we use is collected from our Beta program and is de-identified, to maximally simulate the production settings.

📄 PDF Abstract BibTeX arXiv:2203.11997

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationContinual LearningFederated LearningModel OptimizationSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Perceptual Loss based Speech Denoising with an ensemble of Audio Pattern Recognition and Self-Supervised Models

2020-10-22

Deep learning based speech denoising still suffers from the challenge of improving perceptual quality of enhanced signals. We introduce a generalized framework called Perceptual Ensemble Regularization Loss (PERL) built …

DenoisingEmotion ClassificationMulti-Task LearningSpeech Denoising

Unsupervised Clustered Federated Learning in Complex Multi-source Acoustic Environments

2021-06-07 · Alexandru Nelus, Rene Glitza, Rainer Martin

In this paper we introduce a realistic and challenging, multi-source and multi-room acoustic environment and an improved algorithm for the estimation of source-dominated microphone clusters in acoustic sensor networks. O…

ClusteringFederated Learning

Semi-supervised Acoustic Event Detection based on tri-training

2019-04-29 · Bowen Shi, Ming Sun, Chieh-Chi Kao, Viktor Rozgic 외

This paper presents our work of training acoustic event detection (AED) models using unlabeled dataset. Recent acoustic event detectors are based on large-scale neural networks, which are typically trained with huge amou…

Event DetectionKnowledge Distillation

Estimation of Microphone Clusters in Acoustic Sensor Networks using Unsupervised Federated Learning

2021-02-05 · Alexandru Nelus, Rene Glitza, Rainer Martin

In this paper we present a privacy-aware method for estimating source-dominated microphone clusters in the context of acoustic sensor networks (ASNs). The approach is based on clustered federated learning which we adapt …

ClusteringFederated Learning

Acoustic scattering AI for non-invasive object classifications: A case study on hair assessment

2025-06-17 · Long-Vu Hoang, Tuan Nguyen, Tran Huy Dat

This paper presents a novel non-invasive object classification approach using acoustic scattering, demonstrated through a case study on hair assessment. When an incident wave interacts with an object, it generates a scat…

ClassificationDeep LearningPrivacy PreservingSound Classification