paper-with-me

Papers

Utterance-level Permutation Invariant Training with Latency-controlled BLSTM for Single-channel Multi-talker Speech Separation

2019-12-25 · Lu Huang, Gaofeng Cheng, Pengyuan Zhang, Yi Yang, Shumin Xu, Jiasong Sun

Utterance-level permutation invariant training (uPIT) has achieved promising progress on single-channel multi-talker speech separation task. Long short-term memory (LSTM) and bidirectional LSTM (BLSTM) are widely used as the separation networks of uPIT, i.e. uPIT-LSTM and uPIT-BLSTM. uPIT-LSTM has lower latency but worse performance, while uPIT-BLSTM has better performance but higher latency. In this paper, we propose using latency-controlled BLSTM (LC-BLSTM) during inference to fulfill low-latency and good-performance speech separation. To find a better training strategy for BLSTM-based separation network, chunk-level PIT (cPIT) and uPIT are compared. The experimental results show that uPIT outperforms cPIT when LC-BLSTM is used during inference. It is also found that the inter-chunk speaker tracing (ST) can further improve the separation performance of uPIT-LC-BLSTM. Evaluated on the WSJ0 two-talker mixed-speech separation task, the absolute gap of signal-to-distortion ratio (SDR) between uPIT-BLSTM and uPIT-LC-BLSTM is reduced to within 0.7 dB.

📄 PDF Abstract BibTeX arXiv:1912.11613

Code (0)

등록된 구현이 없습니다.

Tasks

Speech Separation

Methods 이 논문이 사용한 방법론

uPIT 설명 없음
Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Speeding Up Permutation Invariant Training for Source Separation

2021-07-30 · Thilo von Neumann, Christoph Boeddeker, Keisuke Kinoshita, Marc Delcroix 외

Permutation invariant training (PIT) is a widely used training criterion for neural network-based source separation, used for both utterance-level separation with utterance-level PIT (uPIT) and separation of long recordi…

Multi-talker Speech Separation with Utterance-level Permutation Invariant Training of Deep Recurrent Neural Networks

2017-03-18 · Morten Kolbæk, Dong Yu, Zheng-Hua Tan, Jesper Jensen

In this paper we propose the utterance-level Permutation Invariant Training (uPIT) technique. uPIT is a practically applicable, end-to-end, deep learning based solution for speaker independent multi-talker speech separat…

ClusteringDeep ClusteringSpeech Separation

On permutation invariant training for speech source separation

2021-02-09 · Xiaoyu Liu, Jordi Pons

We study permutation invariant training (PIT), which targets at the permutation ambiguity problem for speaker independent source separation models. We extend two state-of-the-art PIT strategies. First, we look at the two…

ClusteringSpeaker Separation

Separating Long-Form Speech with Group-Wise Permutation Invariant Training

2021-10-27 · Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu 외

Multi-talker conversational speech processing has drawn many interests for various applications such as meeting transcription. Speech separation is often required to handle overlapped speech that is commonly observed in …

FormSpeech Separation

Streaming Multi-speaker ASR with RNN-T

2020-11-23 · Ilya Sklyar, Anna Piunova, YuLan Liu

Recent research shows end-to-end ASR systems can recognize overlapped speech from multiple speakers. However, all published works have assumed no latency constraints during inference, which does not hold for most voice a…

speech-recognitionSpeech Recognition