paper-with-me

Papers

Sub-Band Knowledge Distillation Framework for Speech Enhancement

2020-05-29 · Xiang Hao, Shixue Wen, Xiangdong Su, Yun Liu, Guanglai Gao, Xiaofei Li

In single-channel speech enhancement, methods based on full-band spectral features have been widely studied. However, only a few methods pay attention to non-full-band spectral features. In this paper, we explore a knowledge distillation framework based on sub-band spectral mapping for single-channel speech enhancement. Specifically, we divide the full frequency band into multiple sub-bands and pre-train an elite-level sub-band enhancement model (teacher model) for each sub-band. These teacher models are dedicated to processing their own sub-bands. Next, under the teacher models' guidance, we train a general sub-band enhancement model (student model) that works for all sub-bands. Without increasing the number of model parameters and computational complexity, the student model's performance is further improved. To evaluate our proposed method, we conducted a large number of experiments on an open-source data set. The final experimental results show that the guidance from the elite-level teacher models dramatically improves the student model's performance, which exceeds the full-band model by employing fewer parameters.

📄 PDF Abstract BibTeX arXiv:2005.14435

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge DistillationSpeech Enhancement

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Incorporating Ultrasound Tongue Images for Audio-Visual Speech Enhancement through Knowledge Distillation

2023-05-24 · Rui-Chen Zheng, Yang Ai, Zhen-Hua Ling

Audio-visual speech enhancement (AV-SE) aims to enhance degraded speech along with extra visual information such as lip videos, and has been shown to be more effective than audio-only speech enhancement. This paper propo…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Knowledge DistillationSpeech Enhancement+2

Breaking the trade-off in personalized speech enhancement with cross-task knowledge distillation

2022-11-05 · Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka

Personalized speech enhancement (PSE) models achieve promising results compared with unconditional speech enhancement models due to their ability to remove interfering speech in addition to background noise. Unlike uncon…

Knowledge DistillationSpeech Enhancement

Multi-View Attention Transfer for Efficient Speech Enhancement

2022-08-22 · WooSeok Shin, Hyun Joon Park, Jin Sob Kim, Byung Hoon Lee 외

Recent deep learning models have achieved high performance in speech enhancement; however, it is still challenging to obtain a fast and low-complexity model without significant performance degradation. Previous knowledge…

Knowledge DistillationSpeech Enhancement

Injecting Spatial Information for Monaural Speech Enhancement via Knowledge Distillation

2022-12-02 · Xinmeng Xu, Weiping tu, Yuhong Yang

Monaural speech enhancement (SE) provides a versatile and cost-effective approach to SE tasks by utilizing recordings from a single microphone. However, the monaural SE lags performance behind multi-channel SE as the mon…

Knowledge DistillationSpeech Enhancement

A two-step backward compatible fullband speech enhancement system

2022-01-26 · Xu Zhang, LianWu Chen, Xiguang Zheng, Xinlei Ren 외

Speech enhancement methods based on deep learning have surpassed traditional methods. While many of these new approaches are operating on the wideband (16kHz) sample rate, a new fullband (48kHz) speech enhancement system…

Speech EnhancementVocal Bursts Valence Prediction