paper-with-me

Papers

Neural Marching Cubes

2021-06-21 · Zhiqin Chen, Hao Zhang

We introduce Neural Marching Cubes (NMC), a data-driven approach for extracting a triangle mesh from a discretized implicit field. Classical MC is defined by coarse tessellation templates isolated to individual cubes. While more refined tessellations have been proposed, they all make heuristic assumptions, such as trilinearity, when determining the vertex positions and local mesh topologies in each cube. In principle, none of these approaches can reconstruct geometric features that reveal coherence or dependencies between nearby cubes (e.g., a sharp edge), as such information is unaccounted for, resulting in poor estimates of the true underlying implicit field. To tackle these challenges, we re-cast MC from a deep learning perspective, by designing tessellation templates more apt at preserving geometric features, and learning the vertex positions and mesh topologies from training meshes, to account for contextual information from nearby cubes. We develop a compact per-cube parameterization to represent the output triangle mesh, while being compatible with neural processing, so that a simple 3D convolutional network can be employed for the training. We show that all topological cases in each cube that are applicable to our design can be easily derived using our representation, and the resulting tessellations can also be obtained naturally and efficiently by following a few design guidelines. In addition, our network learns local features with limited receptive fields, hence it generalizes well to new shapes and new datasets. We evaluate our neural MC approach by quantitative and qualitative comparisons to all well-known MC variants. In particular, we demonstrate the ability of our network to recover sharp features such as edges and corners, a long-standing issue of MC and its variants. Our network also reconstructs local mesh topologies more accurately than previous approaches.

📄 PDF Abstract BibTeX arXiv:2106.11272

Code (1)

czq142857/NMC 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Deep Marching Cubes: Learning Explicit Surface Representations

2018-06-01 · CVPR 2018 6 · Yiyi Liao, Simon Donné, Andreas Geiger

Existing learning based solutions to 3D surface prediction cannot be trained end-to-end as they operate on intermediate representations (e.g., TSDF) from which 3D surface meshes must be extracted in a post-processing ste…

Analytic Marching: An Analytic Meshing Solution from Deep Implicit Surface Networks

2020-02-16 · ICML 2020 1 · Jiabao Lei, Kui Jia

This paper studies a problem of learning surface mesh via implicit functions in an emerging field of deep learning surface reconstruction, where implicit functions are popularly implemented as multi-layer perceptrons (ML…

Surface Reconstruction

Directional TSDF: Modeling Surface Orientation for Coherent Meshes

2019-08-14 · Malte Splietker, Sven Behnke

Real-time 3D reconstruction from RGB-D sensor data plays an important role in many robotic applications, such as object modeling and mapping. The popular method of fusing depth information into a truncated signed distanc…

3D Reconstruction

Flexible Isosurface Extraction for Gradient-Based Mesh Optimization

2023-08-10 · Tianchang Shen, Jacob Munkberg, Jon Hasselgren, Kangxue Yin 외

This work considers gradient-based mesh optimization, where we iteratively optimize for a 3D surface mesh by representing it as the isosurface of a scalar field, an increasingly common paradigm in applications including …

Accelerated Probabilistic Marching Cubes by Deep Learning for Time-Varying Scalar Ensembles

2022-07-15 · Mengjiao Han, Tushar M. Athawale, David Pugmire, Chris R. Johnson

Visualizing the uncertainty of ensemble simulations is challenging due to the large size and multivariate and temporal features of ensemble data sets. One popular approach to studying the uncertainty of ensembles is anal…

Uncertainty Visualization