Implicit Mesh Reconstruction from Unannotated Image Collections
We present an approach to infer the 3D shape, texture, and camera pose for an object from a single RGB image, using only category-level image collections with foreground masks as supervision. We represent the shape as an image-conditioned implicit function that transforms the surface of a sphere to that of the predicted mesh, while additionally predicting the corresponding texture. To derive supervisory signal for learning, we enforce that: a) our predictions when rendered should explain the available image evidence, and b) the inferred 3D structure should be geometrically consistent with learned pixel to surface mappings. We empirically show that our approach improves over prior work that leverages similar supervision, and in fact performs competitively to methods that use stronger supervision. Finally, as our method enables learning with limited supervision, we qualitatively demonstrate its applicability over a set of about 30 object categories.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
BAT3R: Bootstrapping Articulated 3D Reconstruction from 2D Image Collections
3D reconstruction of articulated objects from a single image is challenging because large training datasets with paired image and 3D supervision are difficult to obtain. Recent point map-based methods achieve strong perf…
3D ReconstructionLocal Deep Implicit Functions for 3D Shape
The goal of this project is to learn a 3D shape representation that enables accurate surface reconstruction, compact storage, efficient computation, consistency for similar shapes, generalization across diverse shape cat…
3D Shape RepresentationSurface ReconstructionCity-Mesh3R: Simulation-Ready City-Scale 3D Mesh Reconstruction from Multi-View Images
City-scale 3D surface reconstruction from multiview images for downstream 3D simulation, poses highly challenging problems due to the scale and complexity of urban scenes. Existing city-scale 3D reconstruction methods ba…
3D ReconstructionImage ClusteringShelf-Supervised Mesh Prediction in the Wild
We aim to infer 3D shape and pose of object from a single image and propose a learning-based approach that can train from unstructured image collections, supervised by only segmentation outputs from off-the-shelf recogni…
PredictionLearning to Predict Scene-Level Implicit 3D from Posed RGBD Data
We introduce a method that can learn to predict scene-level implicit functions for 3D reconstruction from posed RGBD data. At test time, our system maps a previously unseen RGB image to a 3D reconstruction of a scene via…
3D Reconstruction