paper-with-me

Papers

A non-causal FFTNet architecture for speech enhancement

2020-06-08 · Muhammed PV Shifas, Nagaraj Adiga, Vassilis Tsiaras, Yannis Stylianou

In this paper, we suggest a new parallel, non-causal and shallow waveform domain architecture for speech enhancement based on FFTNet, a neural network for generating high quality audio waveform. In contrast to other waveform based approaches like WaveNet, FFTNet uses an initial wide dilation pattern. Such an architecture better represents the long term correlated structure of speech in the time domain, where noise is usually highly non-correlated, and therefore it is suitable for waveform domain based speech enhancement. To further strengthen this feature of FFTNet, we suggest a non-causal FFTNet architecture, where the present sample in each layer is estimated from the past and future samples of the previous layer. By suggesting a shallow network and applying non-causality within certain limits, the suggested FFTNet for speech enhancement (SE-FFTNet) uses much fewer parameters compared to other neural network based approaches for speech enhancement like WaveNet and SEGAN. Specifically, the suggested network has considerably reduced model parameters: 32% fewer compared to WaveNet and 87% fewer compared to SEGAN. Finally, based on subjective and objective metrics, SE-FFTNet outperforms WaveNet in terms of enhanced signal quality, while it provides equally good performance as SEGAN. A Tensorflow implementation of the architecture is provided at 1 .

📄 PDF Abstract BibTeX arXiv:2006.04469

Code (1)

shifaspv/SE-FFTNet-tensorflow-implemenatation 공식 구현 tf

Tasks

Speech Enhancement

Methods 이 논문이 사용한 방법론

Mixture of Logistic Distributions 설명 없음
Dilated Causal Convolution A Dilated Causal Convolution is a causal convolution where the filter is applied over an area larger than its length by…
WaveNet WaveNet is an audio generative model based on the PixelCNN architecture. In order to deal with long-range temporal dependencies…

Similar Papers 제목 키워드 기반

An Empirical Study on the Impact of Positional Encoding in Transformer-based Monaural Speech Enhancement

2024-01-18 · Qiquan Zhang, Meng Ge, Hongxu Zhu, Eliathamby Ambikairajah 외

Transformer architecture has enabled recent progress in speech enhancement. Since Transformers are position-agostic, positional encoding is the de facto standard component used to enable Transformers to distinguish the o…

POSPositionSpeech Enhancement

Convolutional Neural Network-based Speech Enhancement for Cochlear Implant Recipients

2019-07-03 · Nursadul Mamun, Soheil Khorram, John H. L. Hansen

Attempts to develop speech enhancement algorithms with improved speech intelligibility for cochlear implant (CI) users have met with limited success. To improve speech enhancement methods for CI users, we propose to perf…

Speech Enhancement

Dense CNN with Self-Attention for Time-Domain Speech Enhancement

2020-09-03 · Ashutosh Pandey, DeLiang Wang

Speech enhancement in the time domain is becoming increasingly popular in recent years, due to its capability to jointly enhance both the magnitude and the phase of speech. In this work, we propose a dense convolutional …

DecoderSpeech Enhancement

Inference and Denoise: Causal Inference-based Neural Speech Enhancement

2022-11-02 · Tsun-An Hsieh, Chao-Han Huck Yang, Pin-Yu Chen, Sabato Marco Siniscalchi 외

This study addresses the speech enhancement (SE) task within the causal inference paradigm by modeling the noise presence as an intervention. Based on the potential outcome framework, the proposed causal inference-based …

Causal InferenceSpeech Enhancement

Real Time Speech Enhancement in the Waveform Domain

2020-06-23 · Alexandre Defossez, Gabriel Synnaeve, Yossi Adi

We present a causal speech enhancement model working on the raw waveform that runs in real-time on a laptop CPU. The proposed model is based on an encoder-decoder architecture with skip-connections. It is optimized on bo…

CPUData AugmentationDecoderSpeech Enhancement