An Efficient Background Term for 3D Reconstruction and Tracking With Smooth Surface Models
We present a novel strategy to shrink and constrain a 3D model, represented as a smooth spline-like surface, within the visual hull of an object observed from one or multiple views. This new 'background' or 'silhouette' term combines the efficiency of previous approaches based on an image-plane distance transform with the accuracy of formulations based on raycasting or ray potentials. The overall formulation is solved by alternating an inner nonlinear minization (raycasting) with a joint optimization of the surface geometry, the camera poses and the data correspondences. Experiments on 3D reconstruction and object tracking show that the new formulation corrects several deficiencies of existing approaches, for instance when modelling non-convex shapes. Moreover, our proposal is more robust against defects in the object segmentation and inherently handles the presence of uncertainty in the measurements (e.g. null depth values in images provided by RGB-D cameras).
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionObjectObject TrackingSemantic SegmentationSimilar Papers 제목 키워드 기반
HRBF-Fusion: Accurate 3D reconstruction from RGB-D data using on-the-fly implicits
Reconstruction of high-fidelity 3D objects or scenes is a fundamental research problem. Recent advances in RGB-D fusion have demonstrated the potential of producing 3D models from consumer-level RGB-D cameras. However, d…
3D ReconstructionRICO: Regularizing the Unobservable for Indoor Compositional Reconstruction
Recently, neural implicit surfaces have become popular for multi-view reconstruction. To facilitate practical applications like scene editing and manipulation, some works extend the framework with semantic masks input fo…
DisentanglementObjectObject ReconstructionAugmented Reality for Depth Cues in Monocular Minimally Invasive Surgery
One of the major challenges in Minimally Invasive Surgery (MIS) such as laparoscopy is the lack of depth perception. In recent years, laparoscopic scene tracking and surface reconstruction has been a focus of investigati…
Simultaneous Localization and MappingSurface ReconstructionFinite Element Based Tracking of Deforming Surfaces
We present an approach to robustly track the geometry of an object that deforms over time from a set of input point clouds captured from a single viewpoint. The deformations we consider are caused by applying forces to k…
ObjectDense Variational Reconstruction of Non-rigid Surfaces from Monocular Video
This paper offers the first variational approach to the problem of dense 3D reconstruction of non-rigid surfaces from a monocular video sequence. We formulate nonrigid structure from motion ( NRS f M ) as a global variat…
3D ReconstructionGPU