paper-with-me

Papers

SDFDiff: Differentiable Rendering of Signed Distance Fields for 3D Shape Optimization

2019-12-15 · CVPR 2020 6 · Yue Jiang, Dantong Ji, Zhizhong Han, Matthias Zwicker

We propose SDFDiff, a novel approach for image-based shape optimization using differentiable rendering of 3D shapes represented by signed distance functions (SDFs). Compared to other representations, SDFs have the advantage that they can represent shapes with arbitrary topology, and that they guarantee watertight surfaces. We apply our approach to the problem of multi-view 3D reconstruction, where we achieve high reconstruction quality and can capture complex topology of 3D objects. In addition, we employ a multi-resolution strategy to obtain a robust optimization algorithm. We further demonstrate that our SDF-based differentiable renderer can be integrated with deep learning models, which opens up options for learning approaches on 3D objects without 3D supervision. In particular, we apply our method to single-view 3D reconstruction and achieve state-of-the-art results.

📄 PDF Abstract BibTeX arXiv:1912.07109

Code (1)

YueJiang-nj/CVPR2020-SDFDiff 공식 구현 pytorch

Tasks

3D ReconstructionMulti-View 3D ReconstructionSingle-View 3D Reconstruction

Similar Papers 제목 키워드 기반

A Simple Approach to Differentiable Rendering of SDFs

2024-05-14 · Zichen Wang, Xi Deng, Ziyi Zhang, Wenzel Jakob 외

We present a simple algorithm for differentiable rendering of surfaces represented by Signed Distance Fields (SDF), which makes it easy to integrate rendering into gradient-based optimization pipelines. To tackle visibil…

Inverse Rendering

DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scaling

2024-02-14 · CVPR 2024 1 · Miguel Fainstein, Viviana Siless, Emmanuel Iarussi

In recent years, there has been a growing interest in training Neural Networks to approximate Unsigned Distance Fields (UDFs) for representing open surfaces in the context of 3D reconstruction. However, UDFs are non-diff…

3D Reconstruction

Representing 3D Shapes with Probabilistic Directed Distance Fields

2021-12-10 · CVPR 2022 1 · Tristan Aumentado-Armstrong, Stavros Tsogkas, Sven Dickinson, Allan Jepson

Differentiable rendering is an essential operation in modern vision, allowing inverse graphics approaches to 3D understanding to be utilized in modern machine learning frameworks. Explicit shape representations (voxels, …

3D Reconstruction

Learning Unsigned Distance Functions from Multi-view Images with Volume Rendering Priors

2024-07-23 · Wenyuan Zhang, Kanle Shi, Yu-Shen Liu, Zhizhong Han

Unsigned distance functions (UDFs) have been a vital representation for open surfaces. With different differentiable renderers, current methods are able to train neural networks to infer a UDF by minimizing the rendering…

Depth Reconstruction with Neural Signed Distance Fields in Structured Light Systems

2024-05-20 · Rukun Qiao, Hiroshi Kawasaki, Hongbin Zha

We introduce a novel depth estimation technique for multi-frame structured light setups using neural implicit representations of 3D space. Our approach employs a neural signed distance field (SDF), trained through self-s…

Depth Estimation