paper-with-me

Papers

Anchored Speech Recognition with Neural Transducers

2022-10-20 · Desh Raj, Junteng Jia, Jay Mahadeokar, Chunyang Wu, Niko Moritz, Xiaohui Zhang, Ozlem Kalinli

Neural transducers have achieved human level performance on standard speech recognition benchmarks. However, their performance significantly degrades in the presence of cross-talk, especially when the primary speaker has a low signal-to-noise ratio. Anchored speech recognition refers to a class of methods that use information from an anchor segment (e.g., wake-words) to recognize device-directed speech while ignoring interfering background speech. In this paper, we investigate anchored speech recognition to make neural transducers robust to background speech. We extract context information from the anchor segment with a tiny auxiliary network, and use encoder biasing and joiner gating to guide the transducer towards the target speech. Moreover, to improve the robustness of context embedding extraction, we propose auxiliary training objectives to disentangle lexical content from speaking style. We evaluate our methods on synthetic LibriSpeech-based mixtures comprising several SNR and overlap conditions; they improve relative word error rates by 19.6% over a strong baseline, when averaged over all conditions.

📄 PDF Abstract BibTeX arXiv:2210.11588

Code (0)

등록된 구현이 없습니다.

Tasks

speech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

LAMASSU: Streaming Language-Agnostic Multilingual Speech Recognition and Translation Using Neural Transducers

2022-11-05 · Peidong Wang, Eric Sun, Jian Xue, Yu Wu 외

Automatic speech recognition (ASR) and speech translation (ST) can both use neural transducers as the model structure. It is thus possible to use a single transducer model to perform both tasks. In real-world application…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language Identificationspeech-recognition+3

Transducers with Pronunciation-aware Embeddings for Automatic Speech Recognition

2024-04-04 · Hainan Xu, Zhehuai Chen, Fei Jia, Boris Ginsburg

This paper proposes Transducers with Pronunciation-aware Embeddings (PET). Unlike conventional Transducers where the decoder embeddings for different tokens are trained independently, the PET model's decoder embedding in…

Automatic Speech RecognitionDecoderspeech-recognitionSpeech Recognition

An Investigation of Monotonic Transducers for Large-Scale Automatic Speech Recognition

2022-04-19 · Niko Moritz, Frank Seide, Duc Le, Jay Mahadeokar 외

The two most popular loss functions for streaming end-to-end automatic speech recognition (ASR) are RNN-Transducer (RNN-T) and connectionist temporal classification (CTC). Between these two loss types we can classify the…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Hallucinationspeech-recognition+1

Self-Attention Transducers for End-to-End Speech Recognition

2019-09-28 · Zhengkun Tian, Jiangyan Yi, Jian-Hua Tao, Ye Bai 외

Recurrent neural network transducers (RNN-T) have been successfully applied in end-to-end speech recognition. However, the recurrent structure makes it difficult for parallelization . In this paper, we propose a self-att…

speech-recognitionSpeech Recognition

Efficient Sequence Transduction by Jointly Predicting Tokens and Durations

2023-04-13 · Hainan Xu, Fei Jia, Somshubra Majumdar, He Huang 외

This paper introduces a novel Token-and-Duration Transducer (TDT) architecture for sequence-to-sequence tasks. TDT extends conventional RNN-Transducer architectures by jointly predicting both a token and its duration, i.…

Intent ClassificationIntent Classification and Slot FillingSlot FillingSpeech Intent Classification+1