Semi-supervised Viewpoint Estimation with Geometry-aware Conditional Generation
There is a growing interest in developing computer vision methods that can learn from limited supervision. In this paper, we consider the problem of learning to predict camera viewpoints, where obtaining ground-truth annotations are expensive and require special equipment, from a limited number of labeled images. We propose a semi-supervised viewpoint estimation method that can learn to infer viewpoint information from unlabeled image pairs, where two images differ by a viewpoint change. In particular our method learns to synthesize the second image by combining the appearance from the first one and viewpoint from the second one. We demonstrate that our method significantly improves the supervised techniques, especially in the low-label regime and outperforms the state-of-the-art semi-supervised methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Viewpoint EstimationSimilar Papers 제목 키워드 기반
Unsupervised Geometry-Aware Representation for 3D Human Pose Estimation
Modern 3D human pose estimation techniques rely on deep networks, which require large amounts of training data. While weakly-supervised methods require less supervision, by utilizing 2D poses or multi-view imagery withou…
3D geometry3D Human Pose EstimationDecoderPose Estimation+1Geometry meets semantics for semi-supervised monocular depth estimation
Depth estimation from a single image represents a very exciting challenge in computer vision. While other image-based depth sensing techniques leverage on the geometry between different viewpoints (e.g., stereo or struct…
DecoderDepth EstimationDepth PredictionMonocular Depth Estimation+1GARF:Geometry-Aware Generalized Neural Radiance Field
Neural Radiance Field (NeRF) has revolutionized free viewpoint rendering tasks and achieved impressive results. However, the efficiency and accuracy problems hinder its wide applications. To address these issues, we prop…
3D geometryDecoderDepth EstimationNeRF+2Weakly-Supervised Discovery of Geometry-Aware Representation for 3D Human Pose Estimation
Recent studies have shown remarkable advances in 3D human pose estimation from monocular images, with the help of large-scale in-door 3D datasets and sophisticated network architectures. However, the generalizability to …
3D geometry3D Human Pose EstimationDecoderPose EstimationSemi-Supervised Monocular 3D Face Reconstruction With End-to-End Shape-Preserved Domain Transfer
Monocular face reconstruction is a challenging task in computer vision, which aims to recover 3D face geometry from a single RGB face image. Recently, deep learning based methods have achieved great improvements on monoc…
3D Face ReconstructionFace ReconstructionMonocular Reconstruction