paper-with-me

Papers

On Filter Generalization for Music Bandwidth Extension Using Deep Neural Networks

2020-11-14 · Serkan Sulun, Matthew E. P. Davies

In this paper, we address a sub-topic of the broad domain of audio enhancement, namely musical audio bandwidth extension. We formulate the bandwidth extension problem using deep neural networks, where a band-limited signal is provided as input to the network, with the goal of reconstructing a full-bandwidth output. Our main contribution centers on the impact of the choice of low pass filter when training and subsequently testing the network. For two different state of the art deep architectures, ResNet and U-Net, we demonstrate that when the training and testing filters are matched, improvements in signal-to-noise ratio (SNR) of up to 7dB can be obtained. However, when these filters differ, the improvement falls considerably and under some training conditions results in a lower SNR than the band-limited input. To circumvent this apparent overfitting to filter shape, we propose a data augmentation strategy which utilizes multiple low pass filters during training and leads to improved generalization to unseen filtering conditions at test time.

📄 PDF Abstract BibTeX arXiv:2011.07274

Code (2)

serkansulun/deep-music-enhancer 공식 구현 pytorch
serkansulun/deep-music-enhancement pytorch

Tasks

Audio Super-ResolutionBandwidth ExtensionData Augmentation

Methods 이 논문이 사용한 방법론

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Residual Connection 설명 없음
Average Pooling 설명 없음
Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…
Batch Normalization 설명 없음
Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…
Kaiming Initialization 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…

Similar Papers 제목 키워드 기반

A Diffusion-Based Generative Equalizer for Music Restoration

2024-03-27 · Eloi Moliner, Maija Turunen, Filip Elvander, Vesa Välimäki

This paper presents a novel approach to audio restoration, focusing on the enhancement of low-quality music recordings, and in particular historical ones. Building upon a previous algorithm called BABE, or Blind Audio Ba…

Bandwidth ExtensionHallucination

BEHM-GAN: Bandwidth Extension of Historical Music using Generative Adversarial Networks

2022-04-13 · Eloi Moliner, Vesa Välimäki

Audio bandwidth extension aims to expand the spectrum of narrow-band audio signals. Although this topic has been broadly studied during recent years, the particular problem of extending the bandwidth of historical music …

Bandwidth ExtensionDenoising

A2SB: Audio-to-Audio Schrodinger Bridges

2025-01-20 · Zhifeng Kong, Kevin J Shih, Weili Nie, Arash Vahdat 외

Audio in the real world may be perturbed due to numerous factors, causing the audio quality to be degraded. The following work presents an audio restoration model tailored for high-res music at 44.1kHz. Our model, Audio-…

Bandwidth Extension

Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approach

2023-06-02 · Eloi Moliner, Filip Elvander, Vesa Välimäki

Audio bandwidth extension involves the realistic reconstruction of high-frequency spectra from bandlimited observations. In cases where the lowpass degradation is unknown, such as in restoring historical audio recordings…

Bandwidth Extension

Bandwidth-Scalable Fully Mask-Based Deep FCRN Acoustic Echo Cancellation and Postfiltering

2022-05-09 · Ernst Seidel, Rasmus Kongsgaard Olsson, Karim Haddad, Zhengyang Li 외

Although today's speech communication systems support various bandwidths from narrowband to super-wideband and beyond, state-of-the art DNN methods for acoustic echo cancellation (AEC) are lacking modularity and bandwidt…

Acoustic echo cancellationBandwidth Extension