paper-with-me

Papers

Recognizing long-form speech using streaming end-to-end models

2019-10-24 · Arun Narayanan, Rohit Prabhavalkar, Chung-Cheng Chiu, David Rybach, Tara N. Sainath, Trevor Strohman

All-neural end-to-end (E2E) automatic speech recognition (ASR) systems that use a single neural network to transduce audio to word sequences have been shown to achieve state-of-the-art results on several tasks. In this work, we examine the ability of E2E models to generalize to unseen domains, where we find that models trained on short utterances fail to generalize to long-form speech. We propose two complementary solutions to address this: training on diverse acoustic data, and LSTM state manipulation to simulate long-form audio when training using short utterances. On a synthesized long-form test set, adding data diversity improves word error rate (WER) by 90% relative, while simulating long-form training improves it by 67% relative, though the combination doesn't improve over data diversity alone. On a real long-form call-center test set, adding data diversity improves WER by 40% relative. Simulating long-form training on top of data diversity improves performance by an additional 27% relative.

📄 PDF Abstract BibTeX arXiv:1910.11455

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DiversityFormspeech-recognitionSpeech Recognition

Methods 이 논문이 사용한 방법론

Test 설명 없음
Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Streaming Speaker Change Detection and Gender Classification for Transducer-Based Multi-Talker Speech Translation

2025-02-04 · Peidong Wang, Naoyuki Kanda, Jian Xue, Jinyu Li 외

Streaming multi-talker speech translation is a task that involves not only generating accurate and fluent translations with low latency but also recognizing when a speaker change occurs and what the speaker's gender is. …

Change DetectionGender Classificationtext-to-speechText to Speech+1

Streaming Parrotron for on-device speech-to-speech conversion

2022-10-25 · Oleg Rybakov, Fadi Biadsy, Xia Zhang, Liyang Jiang 외

We present a fully on-device streaming Speech2Speech conversion model that normalizes a given input speech directly to synthesized output speech. Deploying such a model on mobile devices pose significant challenges in te…

CPUDecoderQuantizationSTS

Adaptive Contextual Biasing for Transducer Based Streaming Speech Recognition

2023-06-01 · Tianyi Xu, Zhanheng Yang, Kaixun Huang, Pengcheng Guo 외

By incorporating additional contextual information, deep biasing methods have emerged as a promising solution for speech recognition of personalized words. However, for real-world voice assistants, always biasing on such…

Predictionspeech-recognitionSpeech Recognition

Qifusion-Net: Layer-adapted Stream/Non-stream Model for End-to-End Multi-Accent Speech Recognition

2024-07-03 · Jinming Chen, Jingyi Fang, Yuanzhong Zheng, Yaoxuan Wang 외

Currently, end-to-end (E2E) speech recognition methods have achieved promising performance. However, auto speech recognition (ASR) models still face challenges in recognizing multi-accent speech accurately. We propose a …

speech-recognitionSpeech Recognition

CTC-TTS: LLM-based dual-streaming text-to-speech with CTC alignment

2026-02-23 · Hanwen Liu, Saierdaer Yusuyin, Hao Huang, Zhijian Ou arxiv

Large-language-model (LLM)-based text-to-speech (TTS) systems can generate natural speech, but most are not designed for low-latency dual-streaming synthesis. High-quality dual-streaming TTS depends on accurate text--spe…