paper-with-me

홈 › Papers

Efficient Encoding of Graphics Primitives with Simplex-based Structures

2023-11-26 · Yibo Wen, Yunfan Yang

Grid-based structures are commonly used to encode explicit features for graphics primitives such as images, signed distance functions (SDF), and neural radiance fields (NeRF) due to their simple implementation. However, in $n$-dimensional space, calculating the value of a sampled point requires interpolating the values of its $2^n$ neighboring vertices. The exponential scaling with dimension leads to significant computational overheads. To address this issue, we propose a simplex-based approach for encoding graphics primitives. The number of vertices in a simplex-based structure increases linearly with dimension, making it a more efficient and generalizable alternative to grid-based representations. Using the non-axis-aligned simplicial structure property, we derive and prove a coordinate transformation, simplicial subdivision, and barycentric interpolation scheme for efficient sampling, which resembles transformation procedures in the simplex noise algorithm. Finally, we use hash tables to store multiresolution features of all interest points in the simplicial grid, which are passed into a tiny fully connected neural network to parameterize graphics primitives. We implemented a detailed simplex-based structure encoding algorithm in C++ and CUDA using the methods outlined in our approach. In the 2D image fitting task, the proposed method is capable of fitting a giga-pixel image with 9.4% less time compared to the baseline method proposed by instant-ngp, while maintaining the same quality and compression rate. In the volumetric rendering setup, we observe a maximum 41.2% speedup when the samples are dense enough.

📄 PDF Abstract BibTeX arXiv:2311.15439

Code (0)

등록된 구현이 없습니다.

Tasks

NeRF

Similar Papers 제목 키워드 기반

Instant Neural Graphics Primitives with a Multiresolution Hash Encoding

2022-01-16 · Thomas Müller, Alex Evans, Christoph Schied, Alexander Keller

Neural graphics primitives, parameterized by fully connected neural networks, can be costly to train and evaluate. We reduce this cost with a versatile new input encoding that permits the use of a smaller network without…

3D Reconstruction3D Shape ReconstructionNeural Radiance CachingNeural Rendering+1

SAT-NGP : Unleashing Neural Graphics Primitives for Fast Relightable Transient-Free 3D reconstruction from Satellite Imagery

2024-03-27 · Camille Billouard, Dawa Derksen, Emmanuelle Sarrazin, Bruno Vallet

Current stereo-vision pipelines produce high accuracy 3D reconstruction when using multiple pairs or triplets of satellite images. However, these pipelines are sensitive to the changes between images that can occur as a …

3D ReconstructionNeRF

Learning to Infer Graphics Programs from Hand-Drawn Images

2017-07-30 · ICLR 2018 1 · Kevin Ellis, Daniel Ritchie, Armando Solar-Lezama, Joshua B. Tenenbaum

We introduce a model that learns to convert simple hand drawings into graphics programs written in a subset of \LaTeX. The model combines techniques from deep learning and program synthesis. We learn a convolutional neur…

Program Synthesis

Compact Neural Graphics Primitives with Learned Hash Probing

2023-12-28 · Towaki Takikawa, Thomas Müller, Merlin Nimier-David, Alex Evans 외

Neural graphics primitives are faster and achieve higher quality when their neural networks are augmented by spatial data structures that hold trainable features arranged in a grid. However, existing feature grids either…

Quantization

Incremental Multi-Scene Modeling via Continual Neural Graphics Primitives

2024-11-29 · Prajwal Singh, Ashish Tiwari, Gautam Vashishtha, Shanmuganathan Raman

Neural radiance fields (NeRF) have revolutionized photorealistic rendering of novel views for 3D scenes. Despite their growing popularity and efficiency as 3D resources, NeRFs face scalability challenges due to the need …

Continual LearningNeRF