ViewNet: Unsupervised Viewpoint Estimation from Conditional Generation
Understanding the 3D world without supervision is currently a major challenge in computer vision as the annotations required to supervise deep networks for tasks in this domain are expensive to obtain on a large scale. In this paper, we address the problem of unsupervised viewpoint estimation. We formulate this as a self-supervised learning task, where image reconstruction provides the supervision needed to predict the camera viewpoint. Specifically, we make use of pairs of images of the same object at training time, from unknown viewpoints, to self-supervise training by combining the viewpoint information from one image with the appearance information from the other. We demonstrate that using a perspective spatial transformer allows efficient viewpoint learning, outperforming existing unsupervised approaches on synthetic data, and obtains competitive results on the challenging PASCAL3D+ dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Image ReconstructionSelf-Supervised LearningViewpoint EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Viewpoint Textual Inversion: Discovering Scene Representations and 3D View Control in 2D Diffusion Models
Text-to-image diffusion models generate impressive and realistic images, but do they learn to represent the 3D world from only 2D supervision? We demonstrate that yes, certain 3D scene representations are encoded in the …
Image GenerationNovel View SynthesisText to Image GenerationText-to-Image GenerationWeakly Supervised Keypoint Discovery
In this paper, we propose a method for keypoint discovery from a 2D image using image-level supervision. Recent works on unsupervised keypoint discovery reliably discover keypoints of aligned instances. However, when the…
Conditional Image GenerationImage GenerationKeypoint EstimationWeakly-supervised LearningViewNeRF: Unsupervised Viewpoint Estimation Using Category-Level Neural Radiance Fields
We introduce ViewNeRF, a Neural Radiance Field-based viewpoint estimation method that learns to predict category-level viewpoints directly from images during training. While NeRF is usually trained with ground-truth came…
NeRFViewpoint EstimationSemi-supervised Viewpoint Estimation with Geometry-aware Conditional Generation
There is a growing interest in developing computer vision methods that can learn from limited supervision. In this paper, we consider the problem of learning to predict camera viewpoints, where obtaining ground-truth ann…
Viewpoint EstimationPerceptual Loss for Robust Unsupervised Homography Estimation
Homography estimation is often an indispensable step in many computer vision tasks. The existing approaches, however, are not robust to illumination and/or larger viewpoint changes. In this paper, we propose bidirectiona…
Dataset GenerationHomography EstimationRepresentation Learning