Domino Denoise: An Accurate Blind Zero-Shot Denoiser using Domino Tilings
Because noise can interfere with downstream analysis, image denoising has come to occupy an important place in the image processing toolbox. The most accurate state-of-the-art denoisers typically train on a representative dataset. But gathering a training set is not always feasible, so interest has grown in blind zero-shot denoisers that train only on the image they are denoising. The most accurate blind-zero shot methods are blind-spot networks, which mask pixels and attempt to infer them from their surroundings. Other methods exist where all neurons participate in forward inference, however they are not as accurate and are susceptible to overfitting. Here we present a hybrid approach. We first introduce a semi blind-spot network where the network can see only a small percentage of inputs during gradient update. We then resolve overfitting by introducing a validation scheme where we split pixels into two groups and fill in pixel gaps using domino tilings. Our method achieves an average PSNR increase of $0.28$ and a three fold increase in speed over the current gold standard blind zero-shot denoiser Self2Self on synthetic Gaussian noise. We demonstrate the broader applicability of Pixel Domino Tiling by inserting it into a preciously published method.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingImage DenoisingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Zero-Shot Blind-spot Image Denoising via Implicit Neural Sampling
The blind-spot principle has been a widely used tool in zero-shot image denoising but faces challenges with real-world noise that exhibits strong local correlations. Existing methods focus on reducing noise correlati…
DenoisingImage DenoisingDomain-Aware Fine-Tuning of Foundation Models
Foundation models (FMs) have revolutionized computer vision, enabling effective learning across different domains. However, their performance under domain shift is yet underexplored. This paper investigates the zero-shot…
Domain AdaptationZero-Shot Color Image Manipulation Localization via Noise Residual Artifact Pattern Analysis
Digital cameras embed device-specific artifacts into every acquired image through demosaicing, in-camera post-processing, and lossy compression. These traces constitute a forensic signal that can be exploited to assess i…
Image Manipulation LocalizationImproving Noise Robustness of LLM-based Zero-shot TTS via Discrete Acoustic Token Denoising
Large language model (LLM) based zero-shot text-to-speech (TTS) methods tend to preserve the acoustic environment of the audio prompt, leading to degradation in synthesized speech quality when the audio prompt contains n…
DecoderDenoisingLanguage ModelingLanguage Modelling+4Zero-Shot CFC: Fast Real-World Image Denoising based on Cross-Frequency Consistency
Zero-shot denoisers address the dataset dependency of deep-learning-based denoisers, enabling the denoising of unseen single images. Nonetheless, existing zero-shot methods suffer from long training times and rely on the…
Computational EfficiencyImage Denoising