paper-with-me

홈 › Papers

Algorithms for audio inpainting based on probabilistic nonnegative matrix factorization

2022-06-28 · Ondřej Mokrý, Paul Magron, Thomas Oberlin, Cédric Févotte

Audio inpainting, i.e., the task of restoring missing or occluded audio signal samples, usually relies on sparse representations or autoregressive modeling. In this paper, we propose to structure the spectrogram with nonnegative matrix factorization (NMF) in a probabilistic framework. First, we treat the missing samples as latent variables, and derive two expectation-maximization algorithms for estimating the parameters of the model, depending on whether we formulate the problem in the time- or time-frequency domain. Then, we treat the missing samples as parameters, and we address this novel problem by deriving an alternating minimization scheme. We assess the potential of these algorithms for the task of restoring short- to middle-length gaps in music signals. Experiments reveal great convergence properties of the proposed methods, as well as competitive performance when compared to state-of-the-art audio inpainting techniques.

📄 PDF Abstract BibTeX arXiv:2206.13768

Code (2)

ondrejmokry/inpaintingnmf 공식 구현
ondrejmokry/testsignals

Tasks

Audio inpainting

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

A Provably Correct and Robust Algorithm for Convolutive Nonnegative Matrix Factorization

2019-06-17 · Anthony Degleris, Nicolas Gillis

In this paper, we propose a provably correct algorithm for convolutive nonnegative matrix factorization (CNMF) under separability assumptions. CNMF is a convolutive variant of nonnegative matrix factorization (NMF), whic…

Audio Source Separation

Probabilistic semi-nonnegative matrix factorization: a Skellam-based framework

2021-07-07 · Benoit Fuentes, Gaël Richard

We present a new probabilistic model to address semi-nonnegative matrix factorization (SNMF), called Skellam-SNMF. It is a hierarchical generative model consisting of prior components, Skellam-distributed hidden variable…

Bayesian Inference

Generalized Separable Nonnegative Matrix Factorization

2019-05-30 · Junjun Pan, Nicolas Gillis

Nonnegative matrix factorization (NMF) is a linear dimensionality technique for nonnegative data with applications such as image analysis, text mining, audio source separation and hyperspectral unmixing. Given a data mat…

Audio Source SeparationHyperspectral Unmixing

Multiple Hankel matrix rank minimization for audio inpainting

2023-03-31 · Pavel Záviška, Pavel Rajmic, Ondřej Mokrý

Sasaki et al. (2018) presented an efficient audio declipping algorithm, based on the properties of Hankel-structure matrices constructed from time-domain signal blocks. We adapt their approach to solving the audio inpain…

Audio declippingAudio inpainting

On Restricted Nonnegative Matrix Factorization

2016-05-23 · Dmitry Chistikov, Stefan Kiefer, Ines Marušić, Mahsa Shirmohammadi 외

Nonnegative matrix factorization (NMF) is the problem of decomposing a given nonnegative $n \times m$ matrix $M$ into a product of a nonnegative $n \times d$ matrix $W$ and a nonnegative $d \times m$ matrix $H$. Restrict…