Few-Shot Meta-Denoising
We study the problem of few-shot learning-based denoising where the training set contains just a handful of clean and noisy samples. A solution to mitigate the small training set issue is to pre-train a denoising model with small training sets containing pairs of clean and synthesized noisy signals, produced from empirical noise priors, and fine-tune on the available small training set. While such transfer learning seems effective, it may not generalize well because of the limited amount of training data. In this work, we propose a new meta-learning training approach for few-shot learning-based denoising problems. Our model is meta-trained using known synthetic noise models, and then fine-tuned with the small training set, with the real noise, as a few-shot learning task. Meta-learning from small training sets of synthetically generated data during meta-training enables us to not only generate an infinite number of training tasks, but also train a model to learn with small training sets -- both advantages have the potential to improve the generalisation of the denoising model. Our approach is empirically shown to produce more accurate denoising results than supervised learning and transfer learning in three denoising evaluations for images and 1-D signals. Interestingly, our study provides strong indications that meta-learning has the potential to become the main learning algorithm for denoising.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingFew-Shot LearningMeta-LearningTransfer LearningSimilar Papers 제목 키워드 기반
MetaDiff: Meta-Learning with Conditional Diffusion for Few-Shot Learning
Equipping a deep model the abaility of few-shot learning, i.e., learning quickly from only few examples, is a core challenge for artificial intelligence. Gradient-based meta-learning approaches effectively address the ch…
DenoisingFew-Shot LearningMeta-LearningGenerating Classification Weights with GNN Denoising Autoencoders for Few-Shot Learning
Given an initial recognition model already trained on a set of base classes, the goal of this work is to develop a meta-model for few-shot learning. The meta-model, given as input some novel classes with few training exa…
ClassificationDenoisingFew-Shot LearningGeneral Classification+1Improving Graph Few-shot Learning with Hyperbolic Space and Denoising Diffusion
Graph few-shot learning, which focuses on effectively learning from only a small number of labeled nodes to quickly adapt to new tasks, has garnered significant research attention. Despite recent advances in graph few-sh…
Representation LearningFew-Shot LearningWhen Denoising Hinders: Revisiting Zero-Shot ASR with SAM-Audio and Whisper
Recent advances in automatic speech recognition (ASR) and speech enhancement have led to a widespread assumption that improving perceptual audio quality should directly benefit recognition accuracy. In this work, we rigo…
Speech RecognitionSpeech EnhancementMeta-Optimization of Deep CNN for Image Denoising Using LSTM
The recent application of deep learning (DL) to various tasks has seen the performance of classical techniques surpassed by their DL-based counterparts. As a result, DL has equally seen application in the removal of nois…
DenoisingImage Denoising