Self-Supervised Speech Representations Preserve Speech Characteristics while Anonymizing Voices
Collecting speech data is an important step in training speech recognition systems and other speech-based machine learning models. However, the issue of privacy protection is an increasing concern that must be addressed. The current study investigates the use of voice conversion as a method for anonymizing voices. In particular, we train several voice conversion models using self-supervised speech representations including Wav2Vec2.0, Hubert and UniSpeech. Converted voices retain a low word error rate within 1% of the original voice. Equal error rate increases from 1.52% to 46.24% on the LibriSpeech test set and from 3.75% to 45.84% on speakers from the VCTK corpus which signifies degraded performance on speaker verification. Lastly, we conduct experiments on dysarthric speech data to show that speech features relevant to articulation, prosody, phonation and phonology can be extracted from anonymized voices for discriminating between healthy and pathological speech.
Code (0)
등록된 구현이 없습니다.
Tasks
Speaker Verificationspeech-recognitionSpeech RecognitionVoice ConversionSimilar Papers 제목 키워드 기반
Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clustering
Self-supervised speech representation models have succeeded in various tasks, but improving them for content-related problems using unlabeled data is challenging. We propose speaker-invariant clustering (Spin), a novel s…
Acoustic Unit DiscoveryClusteringGPUSelf-Supervised Learning+2SparQLe: Speech Queries to Text Translation Through LLMs
With the growing influence of Large Language Models (LLMs), there is increasing interest in integrating speech representations with them to enable more seamless multi-modal processing and speech understanding. This study…
Speech-to-TextSpeech-to-Text TranslationTranslationSpeech-to-Speech Translation with Discrete-Unit-Based Style Transfer
Direct speech-to-speech translation (S2ST) with discrete self-supervised representations has achieved remarkable accuracy, but is unable to preserve the speaker timbre of the source speech. Meanwhile, the scarcity of hig…
In-Context LearningLanguage ModelingLanguage ModellingSpeech-to-Speech Translation+2Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
Self-supervised learning (SSL), which utilizes the input data itself for representation learning, has achieved state-of-the-art results for various downstream speech tasks. However, most of the previous studies focused o…
Representation LearningSelf-Supervised Learningspeech-recognitionSpeech RecognitionProbing self-supervised speech models for phonetic and phonemic information: a case study in aspiration
Textless self-supervised speech models have grown in capabilities in recent years, but the nature of the linguistic information they encode has not yet been thoroughly examined. We evaluate the extent to which these mode…