Nuvo: Neural UV Mapping for Unruly 3D Representations
Existing UV mapping algorithms are designed to operate on well-behaved meshes, instead of the geometry representations produced by state-of-the-art 3D reconstruction and generation techniques. As such, applying these methods to the volume densities recovered by neural radiance fields and related techniques (or meshes triangulated from such fields) results in texture atlases that are too fragmented to be useful for tasks such as view synthesis or appearance editing. We present a UV mapping method designed to operate on geometry produced by 3D reconstruction and generation techniques. Instead of computing a mapping defined on a mesh's vertices, our method Nuvo uses a neural field to represent a continuous UV mapping, and optimizes it to be a valid and well-behaved mapping for just the set of visible points, i.e. only points that affect the scene's appearance. We show that our model is robust to the challenges posed by ill-behaved geometry, and that it produces editable UV mappings that can represent detailed appearance.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionvalidMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
My Art My Choice: Adversarial Protection Against Unruly AI
Generative AI is on the rise, enabling everyone to produce realistic content via publicly available interfaces. Especially for guided image generation, diffusion models are changing the creator economy by producing high …
Image GenerationEvents in Noise-Driven Oscillators: Markov Renewal Processes and the "Unruly" Breakdown of Phase-Reduction Theory
We introduce an extension to the standard reduction of oscillatory systems to a single phase variable. The standard reduction is often insufficient, particularly when the oscillations have variable amplitude and the magn…
Seeing Implicit Neural Representations as Fourier Series
Implicit Neural Representations (INR) use multilayer perceptrons to represent high-frequency functions in low-dimensional problem domains. Recently these representations achieved state-of-the-art results on tasks related…
Novel View SynthesisDecomposition of Neural Discrete Representations for Large-Scale 3D Mapping
Learning efficient representations of local features is a key challenge in feature volume-based 3D neural mapping, especially in large-scale environments. In this paper, we introduce Decomposition-based Neural Mapping (D…
SHINE-Mapping: Large-Scale 3D Mapping Using Sparse Hierarchical Implicit Neural Representations
Accurate mapping of large-scale environments is an essential building block of most outdoor autonomous systems. Challenges of traditional mapping methods include the balance between memory consumption and mapping accurac…
3D ReconstructionContinual Learning