paper-with-me

Papers

Improved Robustness to Disfluencies in RNN-Transducer Based Speech Recognition

2020-12-11 · Valentin Mendelev, Tina Raissi, Guglielmo Camporese, Manuel Giollo

Automatic Speech Recognition (ASR) based on Recurrent Neural Network Transducers (RNN-T) is gaining interest in the speech community. We investigate data selection and preparation choices aiming for improved robustness of RNN-T ASR to speech disfluencies with a focus on partial words. For evaluation we use clean data, data with disfluencies and a separate dataset with speech affected by stuttering. We show that after including a small amount of data with disfluencies in the training set the recognition accuracy on the tests with disfluencies and stuttering improves. Increasing the amount of training data with disfluencies gives additional gains without degradation on the clean data. We also show that replacing partial words with a dedicated token helps to get even better accuracy on utterances with disfluencies and stutter. The evaluation of our best model shows 22.5% and 16.4% relative WER reduction on those two evaluation sets.

📄 PDF Abstract BibTeX arXiv:2012.06259

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

What Counts as an Error? Dual-Reference Benchmarking for Atypical ASR

2026-06-30 · Hawau Olamide Toyin, Srinivasan Umesh, Hanan Aldarmaki arxiv

ASR systems have been often reported to underperform on atypical speech. An often conflated compounding factor is the existence of two valid transcription references: verbatim (actual produced speech, including repetitio…

Speech Recognition

Multi-Channel Transformer Transducer for Speech Recognition

2021-08-30 · Feng-Ju Chang, Martin Radfar, Athanasios Mouchtaris, Maurizio Omologo

Multi-channel inputs offer several advantages over single-channel, to improve the robustness of on-device speech recognition systems. Recent work on multi-channel transformer, has proposed a way to incorporate such input…

speech-recognitionSpeech Recognition

Anchored Speech Recognition with Neural Transducers

2022-10-20 · Desh Raj, Junteng Jia, Jay Mahadeokar, Chunyang Wu 외

Neural transducers have achieved human level performance on standard speech recognition benchmarks. However, their performance significantly degrades in the presence of cross-talk, especially when the primary speaker has…

speech-recognitionSpeech Recognition

Weakly-supervised forced alignment of disfluent speech using phoneme-level modeling

2023-05-30 · Theodoros Kouzelis, Georgios Paraskevopoulos, Athanasios Katsamanis, Vassilis Katsouros

The study of speech disorders can benefit greatly from time-aligned data. However, audio-text mismatches in disfluent speech cause rapid performance degradation for modern speech aligners, hindering the use of automatic …

graph construction

Four-in-One: A Joint Approach to Inverse Text Normalization, Punctuation, Capitalization, and Disfluency for Automatic Speech Recognition

2022-10-26 · Sharman Tan, Piyush Behre, Nick Kibre, Issac Alphonso 외

Features such as punctuation, capitalization, and formatting of entities are important for readability, understanding, and natural language processing tasks. However, Automatic Speech Recognition (ASR) systems produce sp…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Formspeech-recognition+2