paper-with-me

홈 › Papers

SlimmeRF: Slimmable Radiance Fields

2023-12-15 · Shiran Yuan, Hao Zhao

Neural Radiance Field (NeRF) and its variants have recently emerged as successful methods for novel view synthesis and 3D scene reconstruction. However, most current NeRF models either achieve high accuracy using large model sizes, or achieve high memory-efficiency by trading off accuracy. This limits the applicable scope of any single model, since high-accuracy models might not fit in low-memory devices, and memory-efficient models might not satisfy high-quality requirements. To this end, we present SlimmeRF, a model that allows for instant test-time trade-offs between model size and accuracy through slimming, thus making the model simultaneously suitable for scenarios with different computing budgets. We achieve this through a newly proposed algorithm named Tensorial Rank Incrementation (TRaIn) which increases the rank of the model's tensorial representation gradually during training. We also observe that our model allows for more effective trade-offs in sparse-view scenarios, at times even achieving higher accuracy after being slimmed. We credit this to the fact that erroneous information such as floaters tend to be stored in components corresponding to higher ranks. Our implementation is available at https://github.com/Shiran-Yuan/SlimmeRF.

📄 PDF Abstract BibTeX arXiv:2312.10034

Code (1)

shiran-yuan/slimmerf 공식 구현 pytorch

Tasks

3D Scene ReconstructionNeRFNovel View Synthesis

Similar Papers 제목 키워드 기반

Universally Slimmable Networks and Improved Training Techniques

2019-03-12 · ICCV 2019 10 · Jiahui Yu, Thomas Huang

Slimmable networks are a family of neural networks that can instantly adjust the runtime width. The width can be chosen from a predefined widths set to adaptively optimize accuracy-efficiency trade-offs at runtime. In th…

Deep Reinforcement LearningImage Super-ResolutionReinforcement LearningSuper-Resolution

Small-footprint slimmable networks for keyword spotting

2023-04-21 · Zuhaib Akhtar, Mohammad Omar Khursheed, Dongsu Du, Yuzong Liu

In this work, we present Slimmable Neural Networks applied to the problem of small-footprint keyword spotting. We show that slimmable neural networks allow us to create super-nets from Convolutioanl Neural Networks and T…

Keyword SpottingSmall-Footprint Keyword Spotting

Joslim: Joint Widths and Weights Optimization for Slimmable Neural Networks

2020-07-23 · Ting-Wu Chin, Ari S. Morcos, Diana Marculescu

Slimmable neural networks provide a flexible trade-off front between prediction error and computational requirement (such as the number of floating-point operations or FLOPs) with the same storage requirement as a single…

Slimmable Video Codec

2022-05-13 · Zhaocheng Liu, Luis Herranz, Fei Yang, Saiping Zhang 외

Neural video compression has emerged as a novel paradigm combining trainable multilayer neural networks and machine learning, achieving competitive rate-distortion (RD) performances, but still remaining impractical due t…

Video Compression

Cross-Guided Optimization of Radiance Fields With Multi-View Image Super-Resolution for High-Resolution Novel View Synthesis

2023-01-01 · CVPR 2023 1 · Youngho Yoon, Kuk-Jin Yoon

Novel View Synthesis (NVS) aims at synthesizing an image from an arbitrary viewpoint using multi-view images and camera poses. Among the methods for NVS, Neural Radiance Fields (NeRF) is capable of NVS for an arbitra…

Image Super-ResolutionNeRFNovel View SynthesisSuper-Resolution