paper-with-me

Papers

Multi-view Self-supervised Disentanglement for General Image Denoising

2023-09-10 · ICCV 2023 1 · Hao Chen, Chenyuan Qu, Yu Zhang, Chen Chen, Jianbo Jiao

With its significant performance improvements, the deep learning paradigm has become a standard tool for modern image denoisers. While promising performance has been shown on seen noise distributions, existing approaches often suffer from generalisation to unseen noise types or general and real noise. It is understandable as the model is designed to learn paired mapping (e.g. from a noisy image to its clean version). In this paper, we instead propose to learn to disentangle the noisy image, under the intuitive assumption that different corrupted versions of the same clean image share a common latent space. A self-supervised learning framework is proposed to achieve the goal, without looking at the latent clean image. By taking two different corrupted versions of the same image as input, the proposed Multi-view Self-supervised Disentanglement (MeD) approach learns to disentangle the latent clean features from the corruptions and recover the clean image consequently. Extensive experimental analysis on both synthetic and real noise shows the superiority of the proposed method over prior self-supervised approaches, especially on unseen novel noise types. On real noise, the proposed method even outperforms its supervised counterparts by over 3 dB.

📄 PDF Abstract BibTeX arXiv:2309.05049

Code (1)

chqwer2/multi-view-self-supervised-disentanglement-denoising 공식 구현 pytorch

Tasks

DenoisingDisentanglementImage DenoisingSelf-Supervised Learning

Similar Papers 제목 키워드 기반

VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactment

2023-12-07 · CVPR 2024 1 · Phong Tran, Egor Zakharov, Long-Nhat Ho, Anh Tuan Tran 외

We present a 3D-aware one-shot head reenactment method based on a fully volumetric neural disentanglement framework for source appearance and driver expressions. Our method is real-time and produces high-fidelity and vie…

DisentanglementSelf-Supervised Learning

Adapting Self-Supervised Representations to Multi-Domain Setups

2023-09-07 · Neha Kalibhat, Sam Sharpe, Jeremy Goodsitt, Bayan Bruss 외

Current state-of-the-art self-supervised approaches, are effective when trained on individual domains but show limited generalization on unseen domains. We observe that these models poorly generalize even when trained on…

DisentanglementRepresentation Learning

Sample and Predict Your Latent: Modality-free Sequential Disentanglement via Contrastive Estimation

2023-05-25 · Ilan Naiman, Nimrod Berman, Omri Azencot

Unsupervised disentanglement is a long-standing challenge in representation learning. Recently, self-supervised techniques achieved impressive results in the sequential setting, where data is time-dependent. However, the…

DisentanglementRepresentation LearningTime Series

SCADI: Self-supervised Causal Disentanglement in Latent Variable Models

2023-11-11 · Heejeong Nam

Causal disentanglement has great potential for capturing complex situations. However, there is a lack of practical and efficient approaches. It is already known that most unsupervised disentangling methods are unable to …

DisentanglementPseudo Label

DualContrast: Unsupervised Disentangling of Content and Transformations with Implicit Parameterization

2024-05-27 · Mostofa Rafid Uddin, Min Xu

Unsupervised disentanglement of content and transformation has recently drawn much research, given their efficacy in solving downstream unsupervised tasks like clustering, alignment, and shape analysis. This problem is p…

Data AugmentationDisentanglement