paper-with-me

홈 › Papers

Privacy attacks for automatic speech recognition acoustic models in a federated learning framework

2021-11-06 · Natalia Tomashenko, Salima Mdhaffar, Marc Tommasi, Yannick Estève, Jean-François Bonastre

This paper investigates methods to effectively retrieve speaker information from the personalized speaker adapted neural network acoustic models (AMs) in automatic speech recognition (ASR). This problem is especially important in the context of federated learning of ASR acoustic models where a global model is learnt on the server based on the updates received from multiple clients. We propose an approach to analyze information in neural network AMs based on a neural network footprint on the so-called Indicator dataset. Using this method, we develop two attack models that aim to infer speaker identity from the updated personalized models without access to the actual users' speech data. Experiments on the TED-LIUM 3 corpus demonstrate that the proposed approaches are very effective and can provide equal error rate (EER) of 1-2%.

📄 PDF Abstract BibTeX arXiv:2111.03777

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Federated Learningspeech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Configurable Privacy-Preserving Automatic Speech Recognition

2021-04-01 · Ranya Aloufi, Hamed Haddadi, David Boyle

Voice assistive technologies have given rise to far-reaching privacy and security concerns. In this paper we investigate whether modular automatic speech recognition (ASR) can improve privacy in voice assistive systems b…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Privacy Preservingspeech-recognition+2

Leveraging Domain Features for Detecting Adversarial Attacks Against Deep Speech Recognition in Noise

2022-11-03 · Christian Heider Nielsen, Zheng-Hua Tan

In recent years, significant progress has been made in deep model-based automatic speech recognition (ASR), leading to its widespread deployment in the real world. At the same time, adversarial attacks against deep ASR s…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Adversarial Black-Box Attacks on Automatic Speech Recognition Systems using Multi-Objective Evolutionary Optimization

2018-11-04 · Shreya Khare, Rahul Aralikatte, Senthil Mani

Fooling deep neural networks with adversarial input have exposed a significant vulnerability in the current state-of-the-art systems in multiple domains. Both black-box and white-box approaches have been used to either r…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Are disentangled representations all you need to build speaker anonymization systems?

2022-08-22 · Pierre Champion, Denis Jouvet, Anthony Larcher

Speech signals contain a lot of sensitive information, such as the speaker's identity, which raises privacy concerns when speech data get collected. Speaker anonymization aims to transform a speech signal to remove the s…

AllAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)Disentanglement+5

Controlling Whisper: Universal Acoustic Adversarial Attacks to Control Speech Foundation Models

2024-07-05 · Vyas Raina, Mark Gales

Speech enabled foundation models, either in the form of flexible speech recognition based systems or audio-prompted large language models (LLMs), are becoming increasingly popular. One of the interesting aspects of these…

Adversarial AttackAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)Form+3