paper-with-me

홈 › Papers

Exploiting the compressed spectral loss for the learning of the DEMUCS speech enhancement network

2022-11-01 · ROCLING 2022 11 · Chi-En Dai, Qi-Wei Hong, Jeih-weih Hung

This study aims to improve a highly effective speech enhancement technique, DEMUCS, by revising the respective loss function in learning. DEMUCS, developed by Facebook Team, is built on the Wave-UNet and consists of convolutional layer encoding and decoding blocks with an LSTM layer in between. Although DEMUCS processes the input speech utterance purely in the time (wave) domain, the applied loss function consists of wave-domain L1 distance and multi-scale shorttime-Fourier-transform (STFT) loss. That is, both time- and frequency-domain features are taken into consideration in the learning of DEMUCS. In this study, we present revising the STFT loss in DEMUCS by employing the compressed magnitude spectrogram. The compression is done by either the power-law operation with a positive exponent less than one, or the logarithmic operation. We evaluate the presented novel framework on the VoiceBank-DEMAND database and task. The preliminary experimental results suggest that DEMUCS containing the power-law compressed magnitude spectral loss outperforms the original DEMUCS by providing the test utterances with higher objective quality and intelligibility scores (PESQ and STOI). Relatively, the logarithm compressed magnitude spectral loss does not benefit DEMUCS. Therefore, we reveal that DEMUCS can be further improved by properly revising the STFT terms of its loss function.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Speech Enhancement

Similar Papers 제목 키워드 기반

Music Source Separation in the Waveform Domain

2019-11-27 · Alexandre Défossez, Nicolas Usunier, Léon Bottou, Francis Bach

Source separation for music is the task of isolating contributions, or stems, from different instruments recorded individually and arranged together to form a song. Such components include voice, bass, drums and any othe…

Audio GenerationAudio SynthesisData AugmentationMulti-task Audio Source Seperation+2

Speech Enhancement for Virtual Meetings on Cellular Networks

2023-02-02 · Hojeong Lee, Minseon Gwak, Kawon Lee, Minjeong Kim 외

We study speech enhancement using deep learning (DL) for virtual meetings on cellular devices, where transmitted speech has background noise and transmission loss that affects speech quality. Since the Deep Noise Suppres…

Deep LearningSpeech Enhancement

DDD: A Perceptually Superior Low-Response-Time DNN-based Declipper

2024-01-08 · Jayeon Yi, Junghyun Koo, Kyogu Lee

Clipping is a common nonlinear distortion that occurs whenever the input or output of an audio system exceeds the supported range. This phenomenon undermines not only the perception of speech quality but also downstream …

Hybrid Transformers for Music Source Separation

2022-11-15 · Simon Rouard, Francisco Massa, Alexandre Défossez

A natural question arising in Music Source Separation (MSS) is whether long range contextual information is useful, or whether local acoustic features are sufficient. In other fields, attention based Transformers have sh…

Music Source SeparationSpeech Enhancement

Hybrid Spectrogram and Waveform Source Separation

2021-11-05 · Alexandre Défossez

Source separation models either work on the spectrogram or waveform domain. In this work, we show how to perform end-to-end hybrid source separation, letting the model decide which domain is best suited for each source, …

Music Source Separation