paper-with-me

홈 › Papers

Revisiting Acoustic Features for Robust ASR

2024-09-24 · Muhammad A. Shah, Bhiksha Raj

Automatic Speech Recognition (ASR) systems must be robust to the myriad types of noises present in real-world environments including environmental noise, room impulse response, special effects as well as attacks by malicious actors (adversarial attacks). Recent works seek to improve accuracy and robustness by developing novel Deep Neural Networks (DNNs) and curating diverse training datasets for them, while using relatively simple acoustic features. While this approach improves robustness to the types of noise present in the training data, it confers limited robustness against unseen noises and negligible robustness to adversarial attacks. In this paper, we revisit the approach of earlier works that developed acoustic features inspired by biological auditory perception that could be used to perform accurate and robust ASR. In contrast, Specifically, we evaluate the ASR accuracy and robustness of several biologically inspired acoustic features. In addition to several features from prior works, such as gammatone filterbank features (GammSpec), we also propose two new acoustic features called frequency masked spectrogram (FreqMask) and difference of gammatones spectrogram (DoGSpec) to simulate the neuro-psychological phenomena of frequency masking and lateral suppression. Experiments on diverse models and datasets show that (1) DoGSpec achieves significantly better robustness than the highly popular log mel spectrogram (LogMelSpec) with minimal accuracy degradation, and (2) GammSpec achieves better accuracy and robustness to non-adversarial noises from the Speech Robust Bench benchmark, but it is outperformed by DoGSpec against adversarial attacks.

📄 PDF Abstract BibTeX arXiv:2409.16399

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Revisiting speech segmentation and lexicon learning with better features

2024-01-31 · Herman Kamper, Benjamin van Niekerk

We revisit a self-supervised method that segments unlabelled speech into word-like segments. We start from the two-stage duration-penalised dynamic programming method that performs zero-resource segmentation without lear…

Acoustic Unit DiscoverySegmentation

Revisiting joint decoding based multi-talker speech recognition with DNN acoustic model

2021-10-31 · Martin Kocour, Kateřina Žmolíková, Lucas Ondel, Ján Švec 외

In typical multi-talker speech recognition systems, a neural network-based acoustic model predicts senone state posteriors for each speaker. These are later used by a single-talker decoder which is applied on each speake…

Decoderspeech-recognitionSpeech Recognition

Revisiting End-to-End Speech-to-Text Translation From Scratch

2022-06-09 · Biao Zhang, Barry Haddow, Rico Sennrich

End-to-end (E2E) speech-to-text translation (ST) often depends on pretraining its encoder and/or decoder using source transcripts via speech recognition or text translation tasks, without which translation performance dr…

Decoderspeech-recognitionSpeech RecognitionSpeech-to-Text+2

Deep convolutional acoustic word embeddings using word-pair side information

2015-10-05 · Herman Kamper, Weiran Wang, Karen Livescu

Recent studies have been revisiting whole words as the basic modelling unit in speech recognition and query applications, instead of phonetic units. Such whole-word segmental systems rely on a function that maps a variab…

speech-recognitionSpeech RecognitionWord Embeddings

Generating EEG features from Acoustic features

2020-02-29 · Gautam Krishna, Co Tran, Mason Carnahan, Yan Han 외

In this paper we demonstrate predicting electroencephalograpgy (EEG) features from acoustic features using recurrent neural network (RNN) based regression model and generative adversarial network (GAN). We predict variou…

EEGElectroencephalogram (EEG)Generative Adversarial Networkregression+1