Locate and Beamform: Two-dimensional Locating All-neural Beamformer for Multi-channel Speech Separation
Recently, stunning improvements on multi-channel speech separation have been achieved by neural beamformers when direction information is available. However, most of them neglect to utilize speaker's 2-dimensional (2D) location cues contained in mixture signal, which limits the performance when two sources come from close directions. In this paper, we propose an end-to-end beamforming network for 2D location guided speech separation merely given mixture signal. It first estimates discriminable direction and 2D location cues, which imply directions the sources come from in multi views of microphones and their 2D coordinates. These cues are then integrated into location-aware neural beamformer, thus allowing accurate reconstruction of two sources' speech signals. Experiments show that our proposed model not only achieves a comprehensive decent improvement compared to baseline systems, but avoids inferior performance on spatial overlapping cases.
Code (0)
등록된 구현이 없습니다.
Tasks
AllSpeech SeparationSimilar Papers 제목 키워드 기반
Hybrid Beamforming With Sub-arrayed MIMO Radar: Enabling Joint Sensing and Communication at mmWave Band
In this paper, we propose a beamforming design for dual-functional radar-communication (DFRC) systems at the millimeter wave (mmWave) band, where hybrid beamforming and sub-arrayed MIMO radar techniques are jointly explo…
Multi-Group Multicast Beamforming: Optimal Structure and Efficient Algorithms
This paper considers the multi-group multicast beamforming optimization problem, for which the optimal solution has been unknown due to the non-convex and NP-hard nature of the problem. By utilizing the successive convex…
On Interference-Rejection Using Riemannian Geometry for Direction of Arrival Estimation
We consider the problem of estimating the direction of arrival of desired acoustic sources in the presence of multiple acoustic interference sources. All the sources are located in noisy and reverberant environments and …
Direction of Arrival EstimationEnhanced Neural Beamformer with Spatial Information for Target Speech Extraction
Recently, deep learning-based beamforming algorithms have shown promising performance in target speech extraction tasks. However, most systems do not fully utilize spatial information. In this paper, we propose a target …
Dimensionality ReductionSpeech ExtractionSpeech SeparationAn Encoder-Decoder Network for Beamforming over Sparse Large-Scale MIMO Channels
We develop an end-to-end deep learning framework for downlink beamforming in large-scale sparse MIMO channels. The core is a deep EDN architecture with three modules: (i) an encoder NN, deployed at each user end, that co…
Knowledge Distillation