paper-with-me

Papers

Channel adversarial training for cross-channel text-independent speaker recognition

2019-02-25

The conventional speaker recognition frameworks (e.g., the i-vector and CNN-based approach) have been successfully applied to various tasks when the channel of the enrolment dataset is similar to that of the test dataset. However, in real-world applications, mismatch always exists between these two datasets, which may severely deteriorate the recognition performance. Previously, a few channel compensation algorithms have been proposed, such as Linear Discriminant Analysis (LDA) and Probabilistic LDA. However, these methods always require the collections of different channels from a specific speaker, which is unrealistic to be satisfied in real scenarios. Inspired by domain adaptation, we propose a novel deep-learning based speaker recognition framework to learn the channel-invariant and speaker-discriminative speech representations via channel adversarial training. Specifically, we first employ a gradient reversal layer to remove variations across different channels. Then, the compressed information is projected into the same subspace by adversarial training. Experiments on test datasets with 54,133 speakers demonstrate that the proposed method is not only effective at alleviating the channel mismatch problem, but also outperforms state-of-the-art speaker recognition methods. Compared with the i-vector-based method and the CNN-based method, our proposed method achieves significant relative improvement of 44.7% and 22.6% respectively in terms of the Top1 recall.

📄 PDF Abstract BibTeX arXiv:1902.09074

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationSpeaker RecognitionText-Independent Speaker Recognition

Similar Papers 제목 키워드 기반

Adversarial Robustness of Deep Sensor Fusion Models

2020-06-23 · Shaojie Wang, Tong Wu, Ayan Chakrabarti, Yevgeniy Vorobeychik

We experimentally study the robustness of deep camera-LiDAR fusion architectures for 2D object detection in autonomous driving. First, we find that the fusion model is usually both more accurate, and more robust against …

2D Object DetectionAdversarial RobustnessAutonomous DrivingGeneral Classification+3

CIFS: Improving Adversarial Robustness of CNNs via Channel-wise Importance-based Feature Selection

2021-02-10 · Hanshu Yan, Jingfeng Zhang, Gang Niu, Jiashi Feng 외

We investigate the adversarial robustness of CNNs from the perspective of channel-wise activations. By comparing \textit{non-robust} (normally trained) and \textit{robustified} (adversarially trained) models, we observe …

Adversarial Robustnessfeature selection

Channel-Aware Domain-Adaptive Generative Adversarial Network for Robust Speech Recognition

2024-09-19 · Chien-Chun Wang, Li-Wei Chen, Cheng-Kang Chou, Hung-Shin Lee 외

While pre-trained automatic speech recognition (ASR) systems demonstrate impressive performance on matched domains, their performance often degrades when confronted with channel mismatch stemming from unseen recording en…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Generative Adversarial NetworkRobust Speech Recognition+2

Spatial-frequency channels, shape bias, and adversarial robustness

2023-09-21 · NeurIPS 2023 11

What spatial frequency information do humans and neural networks use to recognize objects? In neuroscience, critical band masking is an established tool that can reveal the frequency-selective filters used for object rec…

Adversarial Training: Enhancing Out-of-Distribution Generalization for Learning Wireless Resource Allocation

2025-06-26 · ShengJie Liu, Chenyang Yang

Deep neural networks (DNNs) have widespread applications for optimizing resource allocation. Yet, their performance is vulnerable to distribution shifts between training and test data, say channels. In this letter, we re…

Out-of-Distribution Generalization