Unsupervised Adversarial Image Reconstruction
We address the problem of recovering an underlying signal from lossy, inaccurate observations in an unsupervised setting. Typically, we consider situations where there is little to no background knowledge on the structure of the underlying signal, no access to signal-measurement pairs, nor even unpaired signal-measurement data. The only available information is provided by the observations and the measurement process statistics. We cast the problem as finding the \textit{maximum a posteriori} estimate of the signal given each measurement, and propose a general framework for the reconstruction problem. We use a formulation of generative adversarial networks, where the generator takes as input a corrupted observation in order to produce realistic reconstructions, and add a penalty term tying the reconstruction to the associated observation. We evaluate our reconstructions on several image datasets with different types of corruptions. The proposed approach yields better results than alternative baselines, and comparable performance with model variants trained with additional supervision.
Code (1)
Tasks
Image ReconstructionSimilar Papers 제목 키워드 기반
Masked GANs for Unsupervised Depth and Pose Prediction with Scale Consistency
Previous work has shown that adversarial learning can be used for unsupervised monocular depth and visual odometry (VO) estimation, in which the adversarial loss and the geometric image reconstruction loss are utilized a…
Generative Adversarial NetworkImage ReconstructionPose PredictionTrajectory Prediction+1Nowhere to Hide: A Lightweight Unsupervised Detector against Adversarial Examples
Although deep neural networks (DNNs) have shown impressive performance on many perceptual tasks, they are vulnerable to adversarial examples that are generated by adding slight but maliciously crafted perturbations to be…
Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers
Supervised reconstruction models are characteristically trained on matched pairs of undersampled and fully-sampled data to capture an MRI prior, along with supervision regarding the imaging operator to enforce data consi…
Image ReconstructionMRI ReconstructionUnsupervised Style-based Explicit 3D Face Reconstruction from Single Image
Inferring 3D object structures from a single image is an ill-posed task due to depth ambiguity and occlusion. Typical resolutions in the literature include leveraging 2D or 3D ground truth for supervised learning, as wel…
3D Face Reconstruction3D ReconstructionFace ModelFace Reconstruction+2Adversarial Self-Defense for Cycle-Consistent GANs
The goal of unsupervised image-to-image translation is to map images from one domain to another without the ground truth correspondence between the two domains. State-of-art methods learn the correspondence using large n…
Adversarial AttackImage-to-Image TranslationTranslationUnsupervised Image-To-Image Translation