paper-with-me

홈 › Papers

Deformable Temporal Convolutional Networks for Monaural Noisy Reverberant Speech Separation

2022-10-27 · William Ravenscroft, Stefan Goetze, Thomas Hain

Speech separation models are used for isolating individual speakers in many speech processing applications. Deep learning models have been shown to lead to state-of-the-art (SOTA) results on a number of speech separation benchmarks. One such class of models known as temporal convolutional networks (TCNs) has shown promising results for speech separation tasks. A limitation of these models is that they have a fixed receptive field (RF). Recent research in speech dereverberation has shown that the optimal RF of a TCN varies with the reverberation characteristics of the speech signal. In this work deformable convolution is proposed as a solution to allow TCN models to have dynamic RFs that can adapt to various reverberation times for reverberant speech separation. The proposed models are capable of achieving an 11.1 dB average scale-invariant signalto-distortion ratio (SISDR) improvement over the input signal on the WHAMR benchmark. A relatively small deformable TCN model of 1.3M parameters is proposed which gives comparable separation performance to larger and more computationally complex models.

📄 PDF Abstract BibTeX arXiv:2210.15305

Code (2)

jwr1995/dtcn 공식 구현 pytorch
jwr1995/pubsep pytorch

Tasks

Speech DereverberationSpeech Separation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Deformable Convolution Deformable convolutions add 2D offsets to the regular grid sampling locations in the standard convolution. It enables free…

Similar Papers 제목 키워드 기반

Online Self-Attentive Gated RNNs for Real-Time Speaker Separation

2021-06-25 · Ori Kabeli, Yossi Adi, Zhenyu Tang, Buye Xu 외

Deep neural networks have recently shown great success in the task of blind source separation, both under monaural and binaural settings. Although these methods were shown to produce high-quality separations, they were m…

blind source separationSpeaker Separation

Monaural source separation: From anechoic to reverberant environments

2021-11-15 · Tobias Cord-Landwehr, Christoph Boeddeker, Thilo von Neumann, Catalin Zorila 외

Impressive progress in neural network-based single-channel speech source separation has been made in recent years. But those improvements have been mostly reported on anechoic data, a situation that is hardly met in prac…

GLD-Net: Improving Monaural Speech Enhancement by Learning Global and Local Dependency Features with GLD Block

2022-06-30 · Xinmeng Xu, Yang Wang, Jie Jia, Binbin Chen 외

For monaural speech enhancement, contextual information is important for accurate speech estimation. However, commonly used convolution neural networks (CNNs) are weak in capturing temporal contexts since they only build…

DecoderSpeech Enhancement

On Time Domain Conformer Models for Monaural Speech Separation in Noisy Reverberant Acoustic Environments

2023-10-09 · William Ravenscroft, Stefan Goetze, Thomas Hain

Speech separation remains an important topic for multi-speaker technology researchers. Convolution augmented transformers (conformers) have performed well for many speech processing tasks but have been under-researched f…

Computational EfficiencySpeech Separation

Deformable Pose Traversal Convolution for 3D Action and Gesture Recognition

2018-09-01 · ECCV 2018 9 · Junwu Weng, Mengyuan Liu, Xudong Jiang, Junsong Yuan

The representation of 3D pose plays a critical role for 3D body action and hand gesture recognition. Rather than directly representing the 3D pose using its joint locations, in this paper, we propose Deformable Pose Trav…

Gesture RecognitionHand Gesture RecognitionHand-Gesture Recognition