paper-with-me

Papers

A comparative analysis between Conformer-Transducer, Whisper, and wav2vec2 for improving the child speech recognition

2023-11-07 · Andrei Barcovschi, Rishabh Jain, Peter Corcoran

Automatic Speech Recognition (ASR) systems have progressed significantly in their performance on adult speech data; however, transcribing child speech remains challenging due to the acoustic differences in the characteristics of child and adult voices. This work aims to explore the potential of adapting state-of-the-art Conformer-transducer models to child speech to improve child speech recognition performance. Furthermore, the results are compared with those of self-supervised wav2vec2 models and semi-supervised multi-domain Whisper models that were previously finetuned on the same data. We demonstrate that finetuning Conformer-transducer models on child speech yields significant improvements in ASR performance on child speech, compared to the non-finetuned models. We also show Whisper and wav2vec2 adaptation on different child speech datasets. Our detailed comparative analysis shows that wav2vec2 provides the most consistent performance improvements among the three methods studied.

📄 PDF Abstract BibTeX arXiv:2311.04936

Code (3)

c3imaging/child_asr_conformer 공식 구현
MindCode-4/code-5/tree/main/wav2vec2_conformer mindspore
pwc-1/Paper-9/tree/main/5/wav2vec2_conformer mindspore

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Typhoon ASR Real-time: FastConformer-Transducer for Thai Automatic Speech Recognition

2026-01-19 · Warit Sirichotedumrong, Adisai Na-Thalang, Potsawee Manakul, Pittawat Taveekitworachai 외 arxiv

Large encoder-decoder models like Whisper achieve strong offline transcription but remain impractical for streaming applications due to high latency. However, due to the accessibility of pre-trained checkpoints, the open…

Speech Recognition

A Comparative Study on Neural Architectures and Training Methods for Japanese Speech Recognition

2021-06-09 · Shigeki Karita, Yotaro Kubo, Michiel Adriaan Unico Bacchiani, Llion Jones

End-to-end (E2E) modeling is advantageous for automatic speech recognition (ASR) especially for Japanese since word-based tokenization of Japanese is not trivial, and E2E modeling is able to model character sequences dir…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data Augmentationspeech-recognition+1

Multi-stage Progressive Compression of Conformer Transducer for On-device Speech Recognition

2022-10-01 · Jash Rathod, Nauman Dawalatabad, Shatrughan Singh, Dhananjaya Gowda

The smaller memory bandwidth in smart devices prompts development of smaller Automatic Speech Recognition (ASR) models. To obtain a smaller model, one can employ the model compression techniques. Knowledge distillation (…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Knowledge DistillationModel Compression+2

ConvRNN-T: Convolutional Augmented Recurrent Neural Network Transducers for Streaming Speech Recognition

2022-09-29 · Martin Radfar, Rohit Barnwal, Rupak Vignesh Swaminathan, Feng-Ju Chang 외

The recurrent neural network transducer (RNN-T) is a prominent streaming end-to-end (E2E) ASR technology. In RNN-T, the acoustic encoder commonly consists of stacks of LSTMs. Very recently, as an alternative to LSTM laye…

speech-recognitionSpeech Recognition

Conformer with dual-mode chunked attention for joint online and offline ASR

2022-06-22 · Felix Weninger, Marco Gaudesi, Md Akmal Haidar, Nicola Ferri 외

In this paper, we present an in-depth study on online attention mechanisms and distillation techniques for dual-mode (i.e., joint online and offline) ASR using the Conformer Transducer. In the dual-mode Conformer Transdu…

Knowledge Distillation