paper-with-me

홈 › Papers

HollowNeRF: Pruning Hashgrid-Based NeRFs with Trainable Collision Mitigation

2023-08-19 · ICCV 2023 1 · Xiufeng Xie, Riccardo Gherardi, Zhihong Pan, Stephen Huang

Neural radiance fields (NeRF) have garnered significant attention, with recent works such as Instant-NGP accelerating NeRF training and evaluation through a combination of hashgrid-based positional encoding and neural networks. However, effectively leveraging the spatial sparsity of 3D scenes remains a challenge. To cull away unnecessary regions of the feature grid, existing solutions rely on prior knowledge of object shape or periodically estimate object shape during training by repeated model evaluations, which are costly and wasteful. To address this issue, we propose HollowNeRF, a novel compression solution for hashgrid-based NeRF which automatically sparsifies the feature grid during the training phase. Instead of directly compressing dense features, HollowNeRF trains a coarse 3D saliency mask that guides efficient feature pruning, and employs an alternating direction method of multipliers (ADMM) pruner to sparsify the 3D saliency mask during training. By exploiting the sparsity in the 3D scene to redistribute hash collisions, HollowNeRF improves rendering quality while using a fraction of the parameters of comparable state-of-the-art solutions, leading to a better cost-accuracy trade-off. Our method delivers comparable rendering quality to Instant-NGP, while utilizing just 31% of the parameters. In addition, our solution can achieve a PSNR accuracy gain of up to 1dB using only 56% of the parameters.

📄 PDF Abstract BibTeX arXiv:2308.10122

Code (0)

등록된 구현이 없습니다.

Tasks

NeRF

Similar Papers 제목 키워드 기반

BoostMVSNeRFs: Boosting MVS-based NeRFs to Generalizable View Synthesis in Large-scale Scenes

2024-07-22 · Chih-Hai Su, Chih-Yao Hu, Shr-Ruei Tsai, Jie-Ying Lee 외

While Neural Radiance Fields (NeRFs) have demonstrated exceptional quality, their protracted training duration remains a limitation. Generalizable and MVS-based NeRFs, although capable of mitigating training time, often …

NeRF

Hardware Acceleration of Neural Graphics

2023-03-10 · Muhammad Husnain Mubarik, Ramakrishna Kanungo, Tobias Zirr, Rakesh Kumar

Rendering and inverse-rendering algorithms that drive conventional computer graphics have recently been superseded by neural representations (NR). NRs have recently been used to learn the geometric and the material prope…

4k8kInverse RenderingNeRF

Neural radiance fields in the industrial and robotics domain: applications, research opportunities and use cases

2023-08-14 · Eugen Šlapak, Enric Pardo, Matúš Dopiriak, Taras Maksymyuk 외

The proliferation of technologies, such as extended reality (XR), has increased the demand for high-quality three-dimensional (3D) graphical representations. Industrial 3D applications encompass computer-aided design (CA…

Collision AvoidanceMotion EstimationNeRFSSIM+1

Waste not, Want not: All-Alive Pruning for Extremely Sparse Networks

2021-01-01 · Daejin Kim, Hyunjung Shim, Jongwuk Lee

Network pruning has been widely adopted for reducing computational cost and memory consumption in low-resource devices. Recent studies show that saliency-based pruning can achieve high compression ratios (e.g., 80-90% of…

AllNetwork Pruning

A Framework For Pruning Deep Neural Networks Using Energy-Based Models

2021-02-25 · Hojjat Salehinejad, Shahrokh Valaee

A typical deep neural network (DNN) has a large number of trainable parameters. Choosing a network with proper capacity is challenging and generally a larger network with excessive capacity is trained. Pruning is an esta…

global-optimization