paper-with-me

홈 › Papers

openFEAT: Improving Speaker Identification by Open-set Few-shot Embedding Adaptation with Transformer

2022-02-24 · Kishan K C, Zhenning Tan, Long Chen, Minho Jin, Eunjung Han, Andreas Stolcke, Chul Lee

Household speaker identification with few enrollment utterances is an important yet challenging problem, especially when household members share similar voice characteristics and room acoustics. A common embedding space learned from a large number of speakers is not universally applicable for the optimal identification of every speaker in a household. In this work, we first formulate household speaker identification as a few-shot open-set recognition task and then propose a novel embedding adaptation framework to adapt speaker representations from the given universal embedding space to a household-specific embedding space using a set-to-set function, yielding better household speaker identification performance. With our algorithm, Open-set Few-shot Embedding Adaptation with Transformer (openFEAT), we observe that the speaker identification equal error rate (IEER) on simulated households with 2 to 7 hard-to-discriminate speakers is reduced by 23% to 31% relative.

📄 PDF Abstract BibTeX arXiv:2202.12349

Code (0)

등록된 구현이 없습니다.

Tasks

Open Set LearningSpeaker Identification

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Residual Connection 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Centroid-based deep metric learning for speaker recognition

2019-02-06 · Jixuan Wang, Kuan-Chieh Wang, Marc Law, Frank Rudzicz 외

Speaker embedding models that utilize neural networks to map utterances to a space where distances reflect similarity between speakers have driven recent progress in the speaker recognition task. However, there is still …

Few-Shot Image ClassificationFew-Shot LearningGeneral Classificationimage-classification+5

Improved Relation Networks for End-to-End Speaker Verification and Identification

2022-03-31 · Ashutosh Chaubey, Sparsh Sinha, Susmita Ghose

Speaker identification systems in a real-world scenario are tasked to identify a speaker amongst a set of enrolled speakers given just a few samples for each enrolled speaker. This paper demonstrates the effectiveness of…

Meta-LearningRelationSpeaker IdentificationSpeaker Verification

Enhancing Open-Set Speaker Identification through Rapid Tuning with Speaker Reciprocal Points and Negative Sample

2024-09-24 · Zhiyong Chen, Zhiqi Ai, Xinnuo Li, Shugong Xu

This paper introduces a novel framework for open-set speaker identification in household environments, playing a crucial role in facilitating seamless human-computer interactions. Addressing the limitations of current sp…

Speaker IdentificationSpeaker Recognition

AccentBox: Towards High-Fidelity Zero-Shot Accent Generation

2024-09-13 · Jinzuomu Zhong, Korin Richmond, Zhiba Su, Siqi Sun

While recent Zero-Shot Text-to-Speech (ZS-TTS) models have achieved high naturalness and speaker similarity, they fall short in accent fidelity and control. To address this issue, we propose zero-shot accent generation t…

text-to-speechText to Speech

Symmetric Saliency-based Adversarial Attack To Speaker Identification

2022-10-30 · Jiadi Yao, Xing Chen, Xiao-Lei Zhang, Wei-Qiang Zhang 외

Adversarial attack approaches to speaker identification either need high computational cost or are not very effective, to our knowledge. To address this issue, in this paper, we propose a novel generation-network-based a…

Adversarial AttackDecoderSpeaker Identification