paper-with-me

홈 › Papers

Masked Image Training for Generalizable Deep Image Denoising

2023-03-23 · CVPR 2023 1 · Haoyu Chen, Jinjin Gu, Yihao Liu, Salma Abdel Magid, Chao Dong, Qiong Wang, Hanspeter Pfister, Lei Zhu

When capturing and storing images, devices inevitably introduce noise. Reducing this noise is a critical task called image denoising. Deep learning has become the de facto method for image denoising, especially with the emergence of Transformer-based models that have achieved notable state-of-the-art results on various image tasks. However, deep learning-based methods often suffer from a lack of generalization ability. For example, deep models trained on Gaussian noise may perform poorly when tested on other noise distributions. To address this issue, we present a novel approach to enhance the generalization performance of denoising networks, known as masked training. Our method involves masking random pixels of the input image and reconstructing the missing information during training. We also mask out the features in the self-attention layers to avoid the impact of training-testing inconsistency. Our approach exhibits better generalization ability than other deep learning models and is directly applicable to real-world scenarios. Additionally, our interpretability analysis demonstrates the superiority of our method.

📄 PDF Abstract BibTeX arXiv:2303.13132

Code (1)

haoyuc/maskeddenoising 공식 구현 pytorch

Tasks

Deep LearningDenoisingImage Denoising

Similar Papers 제목 키워드 기반

Masked Pre-training Enables Universal Zero-shot Denoiser

2024-01-26 · Xiaoxiao Ma, Zhixiang Wei, Yi Jin, Pengyang Ling 외

In this work, we observe that model trained on vast general images via masking strategy, has been naturally embedded with their distribution knowledge, thus spontaneously attains the underlying potential for strong image…

DenoisingImage Denoisingvalid

MaskedCLIP: Bridging the Masked and CLIP Space for Semi-Supervised Medical Vision-Language Pre-training

2025-07-23 · Lei Zhu, Jun Zhou, Rick Siow Mong Goh, Yong Liu arxiv

Foundation models have recently gained tremendous popularity in medical image analysis. State-of-the-art methods leverage either paired image-text data via vision-language pre-training or unpaired image data via self-sup…

Knowledge Distillation

Masked Image Modeling with Denoising Contrast

2022-05-19 · Kun Yi, Yixiao Ge, Xiaotong Li, Shusheng Yang 외

Since the development of self-supervised visual representation learning from contrastive learning to masked image modeling (MIM), there is no significant difference in essence, that is, how to design proper pretext tasks…

Contrastive LearningDenoisingimage-classificationImage Classification+5

Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpainting

2024-03-29 · CVPR 2024 1 · Haipeng Liu, Yang Wang, Biao Qian, Meng Wang 외

Denoising diffusion probabilistic models for image inpainting aim to add the noise to the texture of image during the forward process and recover masked regions with unmasked ones of the texture via the reverse denoising…

DenoisingImage Inpainting

Transfer CLIP for Generalizable Image Denoising

2024-03-22 · CVPR 2024 1 · Jun Cheng, Dong Liang, Shan Tan

Image denoising is a fundamental task in computer vision. While prevailing deep learning-based supervised and self-supervised methods have excelled in eliminating in-distribution noise, their susceptibility to out-of-dis…

DecoderDenoisingImage Denoising