paper-with-me

Papers

Fast Multichannel Source Separation Based on Jointly Diagonalizable Spatial Covariance Matrices

2019-03-08 · European Association for Signal Processing (EUSIPCO) 2019 9 · Kouhei Sekiguchi, Aditya Arie Nugraha, Yoshiaki Bando, Kazuyoshi Yoshii

This paper describes a versatile method that accelerates multichannel source separation methods based on full-rank spatial modeling. A popular approach to multichannel source separation is to integrate a spatial model with a source model for estimating the spatial covariance matrices (SCMs) and power spectral densities (PSDs) of each sound source in the time-frequency domain. One of the most successful examples of this approach is multichannel nonnegative matrix factorization (MNMF) based on a full-rank spatial model and a low-rank source model. MNMF, however, is computationally expensive and often works poorly due to the difficulty of estimating the unconstrained full-rank SCMs. Instead of restricting the SCMs to rank-1 matrices with the severe loss of the spatial modeling ability as in independent low-rank matrix analysis (ILRMA), we restrict the SCMs of each frequency bin to jointly-diagonalizable but still full-rank matrices. For such a fast version of MNMF, we propose a computationally-efficient and convergence-guaranteed algorithm that is similar in form to that of ILRMA. Similarly, we propose a fast version of a state-of-the-art speech enhancement method based on a deep speech model and a low-rank noise model. Experimental results showed that the fast versions of MNMF and the deep speech enhancement method were several times faster and performed even better than the original versions of those methods, respectively.

📄 PDF Abstract BibTeX arXiv:1903.03237

Code (3)

sekiguchi92/SpeechEnhancement pytorch
sekiguchi92/eusipco2019
tky823/ssspy

Tasks

Speech Enhancement

Similar Papers 제목 키워드 기반

Neural Fast Full-Rank Spatial Covariance Analysis for Blind Source Separation

2023-06-17 · Yoshiaki Bando, Yoshiki Masuyama, Aditya Arie Nugraha, Kazuyoshi Yoshii

This paper describes an efficient unsupervised learning method for a neural source separation model that utilizes a probabilistic generative model of observed multichannel mixtures proposed for blind source separation (B…

blind source separationVariational Inference

Joint Sound Source Separation and Speaker Recognition

2016-04-29 · Jeroen Zegers, Hugo Van hamme

Non-negative Matrix Factorization (NMF) has already been applied to learn speaker characterizations from single or non-simultaneous speech for speaker recognition applications. It is also known for its good performance i…

blind source separationSpeaker Recognition

Fast MVAE: Joint separation and classification of mixed sources based on multichannel variational autoencoder with auxiliary classifier

2018-12-16 · Li Li, Hirokazu Kameoka, Shoji Makino

This paper proposes an alternative algorithm for multichannel variational autoencoder (MVAE), a recently proposed multichannel source separation approach. While MVAE is notable in its impressive source separation perform…

ClassificationGeneral Classification

Neural Blind Source Separation and Diarization for Distant Speech Recognition

2024-06-12 · Yoshiaki Bando, Tomohiko Nakamura, Shinji Watanabe

This paper presents a neural method for distant speech recognition (DSR) that jointly separates and diarizes speech mixtures without supervision by isolated signals. A standard separation method for multi-talker DSR is a…

blind source separationDistant Speech Recognitionspeaker-diarizationSpeaker Diarization+2

Semi-blind source separation with multichannel variational autoencoder

2018-08-02 · Hirokazu Kameoka, Li Li, Shota Inoue, Shoji Makino

This paper proposes a multichannel source separation technique called the multichannel variational autoencoder (MVAE) method, which uses a conditional VAE (CVAE) to model and estimate the power spectrograms of the source…

blind source separationDecoder