paper-with-me

홈 › Papers

Deep Beamforming for Speech Enhancement and Speaker Localization with an Array Response-Aware Loss Function

2023-10-19 · HsinYu Chang, Yicheng Hsu, Mingsian R. Bai

Recent research advances in deep neural network (DNN)-based beamformers have shown great promise for speech enhancement under adverse acoustic conditions. Different network architectures and input features have been explored in estimating beamforming weights. In this paper, we propose a deep beamformer based on an efficient convolutional recurrent network (CRN) trained with a novel ARray RespOnse-aWare (ARROW) loss function. The ARROW loss exploits the array responses of the target and interferer by using the ground truth relative transfer functions (RTFs). The DNN-based beamforming system, trained with ARROW loss through supervised learning, is able to perform speech enhancement and speaker localization jointly. Experimental results have shown that the proposed deep beamformer, trained with the linearly weighted scale-invariant source-to-noise ratio (SI-SNR) and ARROW loss functions, achieves superior performance in speech enhancement and speaker localization compared to two baselines.

📄 PDF Abstract BibTeX arXiv:2310.12837

Code (0)

등록된 구현이 없습니다.

Tasks

Speech Enhancement

Similar Papers 제목 키워드 기반

Deep Ad-hoc Beamforming Based on Speaker Extraction for Target-Dependent Speech Separation

2020-12-01 · Ziye Yang, Shanzheng Guan, Xiao-Lei Zhang

Recently, the research on ad-hoc microphone arrays with deep learning has drawn much attention, especially in speech enhancement and separation. Because an ad-hoc microphone array may cover such a large area that multipl…

channel selectionDeep LearningSpeech EnhancementSpeech Separation

Visual-Informed Speech Enhancement Using Attention-Based Beamforming

2026-03-05 · Chihyun Liu, Jiaxuan Fan, Mingtung Sun, Michael Anthony 외 arxiv

Recent studies have demonstrated that incorporating auxiliary information, such as speaker voiceprint or visual cues, can substantially improve Speech Enhancement (SE) performance. However, single-channel methods often y…

Visual Speech RecognitionSpeaker IdentificationSpeech EnhancementActivity Detection

Array Geometry-Robust Attention-Based Neural Beamformer for Moving Speakers

2024-02-05 · Marvin Tammen, Tsubasa Ochiai, Marc Delcroix, Tomohiro Nakatani 외

Although mask-based beamforming is a powerful speech enhancement approach, it often requires manual parameter tuning to handle moving speakers. Recently, this approach was augmented with an attention-based spatial covari…

Speech Enhancement

ASoBO: Attentive Beamformer Selection for Distant Speaker Diarization in Meetings

2024-06-05 · Theo Mariotte, Anthony Larcher, Silvio Montresor, Jean-Hugh Thomas

Speaker Diarization (SD) aims at grouping speech segments that belong to the same speaker. This task is required in many speech-processing applications, such as rich meeting transcription. In this context, distant microp…

speaker-diarizationSpeaker Diarization

Microphone Array Geometry Independent Multi-Talker Distant ASR: NTT System for the DASR Task of the CHiME-8 Challenge

2025-02-14 · Naoyuki Kamo, Naohiro Tawara, Atsushi Ando, Takatomo Kano 외

In this paper, we introduce a multi-talker distant automatic speech recognition (DASR) system we designed for the DASR task 1 of the CHiME-8 challenge. Our system performs speaker counting, diarization, and ASR. It handl…

Action DetectionActivity DetectionAutomatic Speech Recognitionspeaker-diarization+4