paper-with-me

홈 › Papers

Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning

2021-06-01 · Haibin Wu, Xu Li, Andy T. Liu, Zhiyong Wu, Helen Meng, Hung-Yi Lee

Previous works have shown that automatic speaker verification (ASV) is seriously vulnerable to malicious spoofing attacks, such as replay, synthetic speech, and recently emerged adversarial attacks. Great efforts have been dedicated to defending ASV against replay and synthetic speech; however, only a few approaches have been explored to deal with adversarial attacks. All the existing approaches to tackle adversarial attacks for ASV require the knowledge for adversarial samples generation, but it is impractical for defenders to know the exact attack algorithms that are applied by the in-the-wild attackers. This work is among the first to perform adversarial defense for ASV without knowing the specific attack algorithms. Inspired by self-supervised learning models (SSLMs) that possess the merits of alleviating the superficial noise in the inputs and reconstructing clean samples from the interrupted ones, this work regards adversarial perturbations as one kind of noise and conducts adversarial defense for ASV by SSLMs. Specifically, we propose to perform adversarial defense from two perspectives: 1) adversarial perturbation purification and 2) adversarial perturbation detection. Experimental results show that our detection module effectively shields the ASV by detecting adversarial samples with an accuracy of around 80%. Moreover, since there is no common metric for evaluating the adversarial defense performance for ASV, this work also formalizes evaluation metrics for adversarial defense considering both purification and detection based approaches into account. We sincerely encourage future works to benchmark their approaches based on the proposed evaluation framework.

📄 PDF Abstract BibTeX arXiv:2106.00273

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial DefenseAdversarial RobustnessSelf-Supervised LearningSpeaker Verification

Similar Papers 제목 키워드 기반

Adversarial defense for automatic speaker verification by cascaded self-supervised learning models

2021-02-14 · Haibin Wu, Xu Li, Andy T. Liu, Zhiyong Wu 외

Automatic speaker verification (ASV) is one of the core technologies in biometric identification. With the ubiquitous usage of ASV systems in safety-critical applications, more and more malicious attackers attempt to lau…

Adversarial DefenseOpen-Ended Question AnsweringSelf-Supervised LearningSpeaker Verification

Cross-lingual Text-independent Speaker Verification using Unsupervised Adversarial Discriminative Domain Adaptation

2019-08-05 · Wei Xia, Jing Huang, John H. L. Hansen

Speaker verification systems often degrade significantly when there is a language mismatch between training and testing data. Being able to improve cross-lingual speaker verification system using unlabeled data can great…

Domain AdaptationSpeaker VerificationText-Independent Speaker Verification

Causally Disentangled Contrastive Learning for Multilingual Speaker Embeddings

2026-02-01 · Mariëtte Olijslager, Seyed Sahand Mohammadi Ziabari, Ali Mohammed Mansoor Alsahag arxiv

Self-supervised speaker embeddings are widely used in speaker verification systems, but prior work has shown that they often encode sensitive demographic attributes, raising fairness and privacy concerns. This paper inve…

Contrastive LearningSpeaker Verification

Pushing the limits of self-supervised speaker verification using regularized distillation framework

2022-11-08 · Yafeng Chen, Siqi Zheng, Hui Wang, Luyao Cheng 외

Training robust speaker verification systems without speaker labels has long been a challenging task. Previous studies observed a large performance gap between self-supervised and fully supervised methods. In this paper,…

Data AugmentationDiversitySelf-Supervised LearningSpeaker Verification

Defense for Black-box Attacks on Anti-spoofing Models by Self-Supervised Learning

2020-06-05 · Haibin Wu, Andy T. Liu, Hung-Yi Lee

High-performance anti-spoofing models for automatic speaker verification (ASV), have been widely used to protect ASV by identifying and filtering spoofing audio that is deliberately generated by text-to-speech, voice con…

Self-Supervised LearningSpeaker Verificationtext-to-speechText to Speech+1