Towards Improved Room Impulse Response Estimation for Speech Recognition
We propose a novel approach for blind room impulse response (RIR) estimation systems in the context of a downstream application scenario, far-field automatic speech recognition (ASR). We first draw the connection between improved RIR estimation and improved ASR performance, as a means of evaluating neural RIR estimators. We then propose a generative adversarial network (GAN) based architecture that encodes RIR features from reverberant speech and constructs an RIR from the encoded features, and uses a novel energy decay relief loss to optimize for capturing energy-based properties of the input reverberant speech. We show that our model outperforms the state-of-the-art baselines on acoustic benchmarks (by 17\% on the energy decay relief and 22\% on an early-reflection energy metric), as well as in an ASR evaluation task (by 6.9\% in word error rate).
Code (1)
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Generative Adversarial NetworkRoom Impulse Response (RIR)speech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Dereverberation using joint estimation of dry speech signal and acoustic system
The purpose of speech dereverberation is to remove quality-degrading effects of a time-invariant impulse response filter from the signal. In this report, we describe an approach to speech dereverberation that involves jo…
Room Impulse Response (RIR)Speech DereverberationRevRIR: Joint Reverberant Speech and Room Impulse Response Embedding using Contrastive Learning with Application to Room Shape Classification
This paper focuses on room fingerprinting, a task involving the analysis of an audio recording to determine the specific volume and shape of the room in which it was captured. While it is relatively straightforward to de…
Contrastive LearningdEchorate: a Calibrated Room Impulse Response Database for Echo-aware Signal Processing
This paper presents dEchorate: a new database of measured multichannel Room Impulse Responses (RIRs) including annotations of early echo timings and 3D positions of microphones, real sources and image sources under diffe…
BenchmarkingRetrievalRoom Impulse Response (RIR)Speech EnhancementBlind estimation of room acoustic parameters from speech signals based on extended model of room impulse response
The speech transmission index (STI) and room acoustic parameters (RAPs), which are derived from a room impulse response (RIR), such as reverberation time and early decay time, are essential to assess speech transmission …
Room Impulse Response (RIR)Blind Identification of Binaural Room Impulse Responses from Smart Glasses
Smart glasses are increasingly recognized as a key medium for augmented reality, offering a hands-free platform with integrated microphones and non-ear-occluding loudspeakers to seamlessly mix virtual sound sources into …