paper-with-me

Papers

Enhanced Neural Beamformer with Spatial Information for Target Speech Extraction

2023-06-28 · Aoqi Guo, Junnan Wu, Peng Gao, Wenbo Zhu, Qinwen Guo, Dazhi Gao, Yujun Wang

Recently, deep learning-based beamforming algorithms have shown promising performance in target speech extraction tasks. However, most systems do not fully utilize spatial information. In this paper, we propose a target speech extraction network that utilizes spatial information to enhance the performance of neural beamformer. To achieve this, we first use the UNet-TCN structure to model input features and improve the estimation accuracy of the speech pre-separation module by avoiding information loss caused by direct dimensionality reduction in other models. Furthermore, we introduce a multi-head cross-attention mechanism that enhances the neural beamformer's perception of spatial information by making full use of the spatial information received by the array. Experimental results demonstrate that our approach, which incorporates a more reasonable target mask estimation network and a spatial information-based cross-attention mechanism into the neural beamformer, effectively improves speech separation performance.

📄 PDF Abstract BibTeX arXiv:2306.15942

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality ReductionSpeech ExtractionSpeech Separation

Similar Papers 제목 키워드 기반

IANS: Intelligibility-aware Null-steering Beamforming for Dual-Microphone Arrays

2023-07-09 · Wen-Yuan Ting, Syu-Siang Wang, Yu Tsao, Borching Su

Beamforming techniques are popular in speech-related applications due to their effective spatial filtering capabilities. Nonetheless, conventional beamforming techniques generally depend heavily on either the target's di…

Statistical Beamformer Exploiting Non-stationarity and Sparsity with Spatially Constrained ICA for Robust Speech Recognition

2023-06-13 · Ui-Hyeop Shin, Hyung-Min Park

In this paper, we present a statistical beamforming algorithm as a pre-processing step for robust automatic speech recognition (ASR). By modeling the target speech as a non-stationary Laplacian distribution, a mask-based…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Robust Speech Recognitionspeech-recognition+1

WPD++: An Improved Neural Beamformer for Simultaneous Speech Separation and Dereverberation

2020-11-18

This paper aims at eliminating the interfering speakers' speech, additive noise, and reverberation from the noisy multi-talker speech mixture that benefits automatic speech recognition (ASR) backend. While the recently p…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+1

MIMO Self-attentive RNN Beamformer for Multi-speaker Speech Separation

2021-04-17 · Xiyun Li, Yong Xu, Meng Yu, Shi-Xiong Zhang 외

Recently, our proposed recurrent neural network (RNN) based all deep learning minimum variance distortionless response (ADL-MVDR) beamformer method yielded superior performance over the conventional MVDR by replacing the…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+1

IsoNet: Spatially-aware audio-visual target speech extraction in complex acoustic environments

2026-05-14 · Dinanath Padhya, Sajen Maharjan, Binita Adhikari, Ishwor Raj Pokharel arxiv

Target speech extraction remains difficult for compact devices because monaural neural models lack spatial evidence and classical beamformers lose resolving power when the microphone aperture is only a few centimetres. W…

Speech Extraction