paper-with-me

Papers

Monaural Speech Enhancement with Complex Convolutional Block Attention Module and Joint Time Frequency Losses

2021-02-03 · Shengkui Zhao, Trung Hieu Nguyen, Bin Ma

Deep complex U-Net structure and convolutional recurrent network (CRN) structure achieve state-of-the-art performance for monaural speech enhancement. Both deep complex U-Net and CRN are encoder and decoder structures with skip connections, which heavily rely on the representation power of the complex-valued convolutional layers. In this paper, we propose a complex convolutional block attention module (CCBAM) to boost the representation power of the complex-valued convolutional layers by constructing more informative features. The CCBAM is a lightweight and general module which can be easily integrated into any complex-valued convolutional layers. We integrate CCBAM with the deep complex U-Net and CRN to enhance their performance for speech enhancement. We further propose a mixed loss function to jointly optimize the complex models in both time-frequency (TF) domain and time domain. By integrating CCBAM and the mixed loss, we form a new end-to-end (E2E) complex speech enhancement framework. Ablation experiments and objective evaluations show the superior performance of the proposed approaches (https://github.com/modelscope/ClearerVoice-Studio).

📄 PDF Abstract BibTeX arXiv:2102.01993

Code (2)

modelscope/ClearerVoice-Studio 공식 구현 pytorch
alibabasglab/frcrn pytorch

Tasks

DecoderSpeech DenoisingSpeech Enhancement

Methods 이 논문이 사용한 방법론

CRN Conditional Relation Network, or CRN, is a building block to construct more sophisticated structures for representation and reasoning over video. CRN takes as input an…
Average Pooling 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

Rethinking complex-valued deep neural networks for monaural speech enhancement

2023-01-11 · Haibin Wu, Ke Tan, Buye Xu, Anurag Kumar 외

Despite multiple efforts made towards adopting complex-valued deep neural networks (DNNs), it remains an open question whether complex-valued DNNs are generally more effective than real-valued DNNs for monaural speech en…

Open-Ended Question AnsweringSpeech Enhancement

SE Territory: Monaural Speech Enhancement Meets the Fixed Virtual Perceptual Space Mapping

2023-11-03 · Xinmeng Xu, Yuhong Yang, Weiping tu

Monaural speech enhancement has achieved remarkable progress recently. However, its performance has been constrained by the limited spatial cues available at a single microphone. To overcome this limitation, we introduce…

Multi-Task LearningSpeech Enhancement

GLD-Net: Improving Monaural Speech Enhancement by Learning Global and Local Dependency Features with GLD Block

2022-06-30 · Xinmeng Xu, Yang Wang, Jie Jia, Binbin Chen 외

For monaural speech enhancement, contextual information is important for accurate speech estimation. However, commonly used convolution neural networks (CNNs) are weak in capturing temporal contexts since they only build…

DecoderSpeech Enhancement

Parallel Gated Neural Network With Attention Mechanism For Speech Enhancement

2022-10-26 · Jianqiao Cui, Stefan Bleeck

Deep learning algorithm are increasingly used for speech enhancement (SE). In supervised methods, global and local information is required for accurate spectral mapping. A key restriction is often poor capture of key con…

Speech Enhancement

Monaural speech enhancement on drone via Adapter based transfer learning

2024-05-16 · Xingyu Chen, Hanwen Bi, Wei-Ting Lai, Fei Ma

Monaural Speech enhancement on drones is challenging because the ego-noise from the rotating motors and propellers leads to extremely low signal-to-noise ratios at onboard microphones. Although recent masking-based deep …

Speech EnhancementTransfer Learning