Geometry-Consistent Neural Shape Representation with Implicit Displacement Fields
We present implicit displacement fields, a novel representation for detailed 3D geometry. Inspired by a classic surface deformation technique, displacement mapping, our method represents a complex surface as a smooth base surface plus a displacement along the base's normal directions, resulting in a frequency-based shape decomposition, where the high frequency signal is constrained geometrically by the low frequency signal. Importantly, this disentanglement is unsupervised thanks to a tailored architectural design that has an innate frequency hierarchy by construction. We explore implicit displacement field surface reconstruction and detail transfer and demonstrate superior representational power, training stability and generalizability.
Code (1)
Tasks
3D geometryDisentanglementSurface ReconstructionSimilar Papers 제목 키워드 기반
Single-view 3D Body and Cloth Reconstruction under Complex Poses
Recent advances in 3D human shape reconstruction from single images have shown impressive results, leveraging on deep networks that model the so-called implicit function to learn the occupancy status of arbitrarily dense…
3D ReconstructionQUADify: Extracting Meshes with Pixel-level Details and Materials from Images
Despite exciting progress in automatic 3D reconstruction from images excessive and irregular triangular faces in the resulting meshes still constitute a significant challenge when it comes to adoption in practical ar…
3D ReconstructionImage ReconstructionHigh-Quality Mesh Blendshape Generation from Face Videos via Neural Inverse Rendering
Readily editable mesh blendshapes have been widely used in animation pipelines, while recent advancements in neural geometry and appearance representations have enabled high-quality inverse rendering. Building upon these…
Inverse RenderingReliable Modeling of Distribution Shifts via Displacement-Reshaped Optimal Transport
Optimal transport (OT) is a central framework for modeling distribution shifts. Because OT compares distributions directly in input space, a well-designed ground metric between observations is essential to ensure that th…
FourierHandFlow: Neural 4D Hand Representation Using Fourier Query Flow
Recent 4D shape representations model continuous temporal evolution of implicit shapes by (1) learning query flows without leveraging shape and articulation priors or (2) decoding shape occupancies separately for each ti…
4D reconstruction