paper-with-me

Papers

A Multi-Stage Triple-Path Method for Speech Separation in Noisy and Reverberant Environments

2023-03-07 · Zhaoxi Mu, Xinyu Yang, Xiangyuan Yang, Wenjing Zhu

In noisy and reverberant environments, the performance of deep learning-based speech separation methods drops dramatically because previous methods are not designed and optimized for such situations. To address this issue, we propose a multi-stage end-to-end learning method that decouples the difficult speech separation problem in noisy and reverberant environments into three sub-problems: speech denoising, separation, and de-reverberation. The probability and speed of searching for the optimal solution of the speech separation model are improved by reducing the solution space. Moreover, since the channel information of the audio sequence in the time domain is crucial for speech separation, we propose a triple-path structure capable of modeling the channel dimension of audio sequences. Experimental results show that the proposed multi-stage triple-path method can improve the performance of speech separation models at the cost of little model parameter increment.

📄 PDF Abstract BibTeX arXiv:2303.03732

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingSpeech DenoisingSpeech Separation

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Speech Separation Based on Multi-Stage Elaborated Dual-Path Deep BiLSTM with Auxiliary Identity Loss

2020-08-06 · Ziqiang Shi, Rujie Liu, Jiqing Han

Deep neural network with dual-path bi-directional long short-term memory (BiLSTM) block has been proved to be very effective in sequence modeling, especially in speech separation. This work investigates how to extend dua…

Speaker SeparationSpeech Separation

Boosting Unknown-number Speaker Separation with Transformer Decoder-based Attractor

2024-01-23 · Younglo Lee, Shukjae Choi, Byeong-Yeol Kim, Zhong-Qiu Wang 외

We propose a novel speech separation model designed to separate mixtures with an unknown number of speakers. The proposed model stacks 1) a dual-path processing block that can model spectro-temporal patterns, 2) a transf…

DecoderSpeaker SeparationSpeech Separation

AmbiSep: Ambisonic-to-Ambisonic Reverberant Speech Separation Using Transformer Networks

2022-06-13 · Adrian Herzog, Srikanth Raj Chetupalli, Emanuël A. P. Habets

Consider a multichannel Ambisonic recording containing a mixture of several reverberant speech signals. Retreiving the reverberant Ambisonic signals corresponding to the individual speech sources blindly from the mixture…

Speech Separation

Regularizing End-to-End Speech Translation with Triangular Decomposition Agreement

2021-12-21 · Yichao Du, Zhirui Zhang, Weizhi Wang, Boxing Chen 외

End-to-end speech-to-text translation (E2E-ST) is becoming increasingly popular due to the potential of its less error propagation, lower latency, and fewer parameters. Given the triplet training corpus $\langle speech, …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+5

Embedding Recurrent Layers with Dual-Path Strategy in a Variant of Convolutional Network for Speaker-Independent Speech Separation

2022-03-25 · Xue Yang, Changchun Bao

Speaker-independent speech separation has achieved remarkable performance in recent years with the development of deep neural network (DNN). Various network architectures, from traditional convolutional neural network (C…

Computational EfficiencySpeech Separation