K-Buffers: A Plug-in Method for Enhancing Neural Fields with Multiple Buffers
Neural fields are now the central focus of research in 3D vision and computer graphics. Existing methods mainly focus on various scene representations, such as neural points and 3D Gaussians. However, few works have studied the rendering process to enhance the neural fields. In this work, we propose a plug-in method named K-Buffers that leverages multiple buffers to improve the rendering performance. Our method first renders K buffers from scene representations and constructs K pixel-wise feature maps. Then, We introduce a K-Feature Fusion Network (KFN) to merge the K pixel-wise feature maps. Finally, we adopt a feature decoder to generate the rendering image. We also introduce an acceleration strategy to improve rendering speed and quality. We apply our method to well-known radiance field baselines, including neural point fields and 3D Gaussian Splatting (3DGS). Extensive experiments demonstrate that our method effectively enhances the rendering performance of neural point fields and 3DGS.
Code (1)
Tasks
3DGSDecoderMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
BufferSearch: Generating Black-Box Adversarial Texts With Lower Queries
Machine learning security has recently become a prominent topic in the natural language processing (NLP) area. The existing black-box adversarial attack suffers prohibitively from the high model querying complexity, resu…
Adversarial Attacktext-classificationText ClassificationPixel-wise Guidance for Utilizing Auxiliary Features in Monte Carlo Denoising
Auxiliary features such as geometric buffers (G-buffers) and path descriptors (P-buffers) have been shown to significantly improve Monte Carlo (MC) denoising. However, recent approaches implicitly learn to exploit auxili…
DenoisingUsing Curiosity for an Even Representation of Tasks in Continual Offline Reinforcement Learning
In this work, we investigate the means of using curiosity on replay buffers to improve offline multi-task continual reinforcement learning when tasks, which are defined by the non-stationarity in the environment, are non…
Boundary Detectionreinforcement-learningReinforcement LearningRGBX-Next: Towards Realistic Generative Rendering from G-Buffers
Diffusion models have achieved impressive results in image, video, and streaming generation. However, compared to traditional 3D rendering, they still lack precise control over the generated output. We believe a viable p…
Inverse RenderingB2RL: An open-source Dataset for Building Batch Reinforcement Learning
Batch reinforcement learning (BRL) is an emerging research area in the RL community. It learns exclusively from static datasets (i.e. replay buffers) without interaction with the environment. In the offline settings, exi…
Managementreinforcement-learningReinforcement LearningReinforcement Learning (RL)