paper-with-me

홈 › Papers

HD-DEMUCS: General Speech Restoration with Heterogeneous Decoders

2023-06-02 · Doyeon Kim, Soo-Whan Chung, Hyewon Han, Youna Ji, Hong-Goo Kang

This paper introduces an end-to-end neural speech restoration model, HD-DEMUCS, demonstrating efficacy across multiple distortion environments. Unlike conventional approaches that employ cascading frameworks to remove undesirable noise first and then restore missing signal components, our model performs these tasks in parallel using two heterogeneous decoder networks. Based on the U-Net style encoder-decoder framework, we attach an additional decoder so that each decoder network performs noise suppression or restoration separately. We carefully design each decoder architecture to operate appropriately depending on its objectives. Additionally, we improve performance by leveraging a learnable weighting factor, aggregating the two decoder output waveforms. Experimental results with objective metrics across various environments clearly demonstrate the effectiveness of our approach over a single decoder or multi-stage systems for general speech restoration task.

📄 PDF Abstract BibTeX arXiv:2306.01411

Code (0)

등록된 구현이 없습니다.

Tasks

Decoder

Methods 이 논문이 사용한 방법론

Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

Exploiting the compressed spectral loss for the learning of the DEMUCS speech enhancement network

2022-11-01 · ROCLING 2022 11 · Chi-En Dai, Qi-Wei Hong, Jeih-weih Hung

This study aims to improve a highly effective speech enhancement technique, DEMUCS, by revising the respective loss function in learning. DEMUCS, developed by Facebook Team, is built on the Wave-UNet and consists of conv…

Speech Enhancement

DM: Dual-path Magnitude Network for General Speech Restoration

2024-09-13 · Da-Hee Yang, Dail Kim, Joon-Hyuk Chang, Jeonghwan Choi 외

In this paper, we introduce a novel general speech restoration model: the Dual-path Magnitude (DM) network, designed to address multiple distortions including noise, reverberation, and bandwidth degradation effectively. …

Decoder

Speech Enhancement for Virtual Meetings on Cellular Networks

2023-02-02 · Hojeong Lee, Minseon Gwak, Kawon Lee, Minjeong Kim 외

We study speech enhancement using deep learning (DL) for virtual meetings on cellular devices, where transmitted speech has background noise and transmission loss that affects speech quality. Since the Deep Noise Suppres…

Deep LearningSpeech Enhancement

DDD: A Perceptually Superior Low-Response-Time DNN-based Declipper

2024-01-08 · Jayeon Yi, Junghyun Koo, Kyogu Lee

Clipping is a common nonlinear distortion that occurs whenever the input or output of an audio system exceeds the supported range. This phenomenon undermines not only the perception of speech quality but also downstream …

Music Source Separation in the Waveform Domain

2019-11-27 · Alexandre Défossez, Nicolas Usunier, Léon Bottou, Francis Bach

Source separation for music is the task of isolating contributions, or stems, from different instruments recorded individually and arranged together to form a song. Such components include voice, bass, drums and any othe…

Audio GenerationAudio SynthesisData AugmentationMulti-task Audio Source Seperation+2