paper-with-me

Papers

Microphone Array Generalization for Multichannel Narrowband Deep Speech Enhancement

2021-07-27 · Siyuan Zhang, Xiaofei Li

This paper addresses the problem of microphone array generalization for deep-learning-based end-to-end multichannel speech enhancement. We aim to train a unique deep neural network (DNN) potentially performing well on unseen microphone arrays. The microphone array geometry shapes the network's parameters when training on a fixed microphone array, and thus restricts the generalization of the trained network to another microphone array. To resolve this problem, a single network is trained using data recorded by various microphone arrays of different geometries. We design three variants of our recently proposed narrowband network to cope with the agnostic number of microphones. Overall, the goal is to make the network learn the universal information for speech enhancement that is available for any array geometry, rather than learn the one-array-dedicated characteristics. The experiments on both simulated and real room impulse responses (RIR) demonstrate the excellent across-array generalization capability of the proposed networks, in the sense that their performance measures are very close to, or even exceed the network trained with test arrays. Moreover, they notably outperform various beamforming methods and other advanced deep-learning-based methods.

📄 PDF Abstract BibTeX arXiv:2107.12601

Code (1)

RusselZHANG/Microphone-Array-Generalization-for-Multichannel-Narrowband-Deep-Speech-Enhancement pytorch

Tasks

Speech Enhancement

Similar Papers 제목 키워드 기반

Advances in Microphone Array Processing and Multichannel Speech Enhancement

2025-02-13 · Gongping Huang, Jesper R. Jensen, Jingdong Chen, Jacob Benesty 외

This paper reviews pioneering works in microphone array processing and multichannel speech enhancement, highlighting historical achievements, technological evolution, commercialization aspects, and key challenges. It pro…

Speech Enhancement

DNN-Based Distributed Multichannel Mask Estimation for Speech Enhancement in Microphone Arrays

2020-02-13 · Nicolas Furnon, Romain Serizel, Irina Illina, Slim Essid

Multichannel processing is widely used for speech enhancement but several limitations appear when trying to deploy these solutions to the real-world. Distributed sensor arrays that consider several devices with a few mic…

Speech Enhancement

Cleanformer: A multichannel array configuration-invariant neural enhancement frontend for ASR in smart speakers

2022-04-25 · Joseph Caroselli, Arun Narayanan, Nathan Howard, Tom O'Malley

This work introduces the Cleanformer, a streaming multichannel neural based enhancement frontend for automatic speech recognition (ASR). This model has a conformer-based architecture which takes as inputs a single channe…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Speech enhancement using ego-noise references with a microphone array embedded in an unmanned aerial vehicle

2022-11-04 · Elisa Tengan, Thomas Dietzen, Santiago Ruiz, Mansour Alkmim 외

A method is proposed for performing speech enhancement using ego-noise references with a microphone array embedded in an unmanned aerial vehicle (UAV). The ego-noise reference signals are captured with microphones locate…

Speech Enhancement

Spatial-Filter-Bank-Based Neural Method for Multichannel Speech Enhancement

2025-04-02 · Tianqin Zheng, Jilu Jin, Hanchen Pei, Gongping Huang 외

The performance of deep learning-based multi-channel speech enhancement methods often deteriorates when the geometric parameters of the microphone array change. Traditional approaches to mitigate this issue typically inv…

Speech Enhancement