Style Agnostic 3D Reconstruction via Adversarial Style Transfer
Reconstructing the 3D geometry of an object from an image is a major challenge in computer vision. Recently introduced differentiable renderers can be leveraged to learn the 3D geometry of objects from 2D images, but those approaches require additional supervision to enable the renderer to produce an output that can be compared to the input image. This can be scene information or constraints such as object silhouettes, uniform backgrounds, material, texture, and lighting. In this paper, we propose an approach that enables a differentiable rendering-based learning of 3D objects from images with backgrounds without the need for silhouette supervision. Instead of trying to render an image close to the input, we propose an adversarial style-transfer and domain adaptation pipeline that allows to translate the input image domain to the rendered image domain. This allows us to directly compare between a translated image and the differentiable rendering of a 3D object reconstruction in order to train the 3D object reconstruction network. We show that the approach learns 3D geometry from images with backgrounds and provides a better performance than constrained methods for single-view 3D object reconstruction on this task.
Code (0)
등록된 구현이 없습니다.
Tasks
3D geometry3D Object Reconstruction3D ReconstructionDomain AdaptationObjectObject ReconstructionStyle TransferSimilar Papers 제목 키워드 기반
Style-Agnostic Reinforcement Learning
We present a novel method of learning style-agnostic representation using both style transfer and adversarial learning in the reinforcement learning framework. The style, here, refers to task-irrelevant details such as t…
Data Augmentationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1StyleAdv: Meta Style Adversarial Training for Cross-Domain Few-Shot Learning
Cross-Domain Few-Shot Learning (CD-FSL) is a recently emerging task that tackles few-shot learning across different domains. It aims at transferring prior knowledge learned on the source dataset to novel target datasets.…
Adversarial AttackCross-Domain Few-Shotcross-domain few-shot learningFew-Shot LearningEfficient Style-Corpus Constrained Learning for Photorealistic Style Transfer
Photorealistic style transfer is a challenging task, which demands the stylized image remains real. Existing methods are still suffering from unrealistic artifacts and heavy computational cost. In this paper, we propose …
Style TransferAdversarial Defense by Latent Style Transformations
Machine learning models have demonstrated vulnerability to adversarial attacks, more specifically misclassification of adversarial examples. In this paper, we investigate an attack-agnostic defense against adversarial at…
Adversarial DefenseAnimeGAN: A Novel Lightweight GAN for Photo Animation
In this paper, a novel approach for transforming photos of real-world scenes into anime style images is proposed, which is a meaningful and challenging task in computer vision and artistic style transfer. The approach we…
Generative Adversarial NetworkStyle Transfer