paper-with-me

홈 › Papers

GVP: Generative Volumetric Primitives

2023-03-31 · Mallikarjun B R, Xingang Pan, Mohamed Elgharib, Christian Theobalt

Advances in 3D-aware generative models have pushed the boundary of image synthesis with explicit camera control. To achieve high-resolution image synthesis, several attempts have been made to design efficient generators, such as hybrid architectures with both 3D and 2D components. However, such a design compromises multiview consistency, and the design of a pure 3D generator with high resolution is still an open problem. In this work, we present Generative Volumetric Primitives (GVP), the first pure 3D generative model that can sample and render 512-resolution images in real-time. GVP jointly models a number of volumetric primitives and their spatial information, both of which can be efficiently generated via a 2D convolutional network. The mixture of these primitives naturally captures the sparsity and correspondence in the 3D volume. The training of such a generator with a high degree of freedom is made possible through a knowledge distillation technique. Experiments on several datasets demonstrate superior efficiency and 3D consistency of GVP over the state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2303.18193

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationKnowledge Distillation

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

LinPrim: Linear Primitives for Differentiable Volumetric Rendering

2025-01-27 · Nicolas von Lützow, Matthias Nießner

Volumetric rendering has become central to modern novel view synthesis methods, which use differentiable rendering to optimize 3D scene representations directly from observed views. While many recent works build on NeRF …

NeRFNovel View Synthesis

Mixture of Volumetric Primitives for Efficient Neural Rendering

2021-03-02 · Stephen Lombardi, Tomas Simon, Gabriel Schwartz, Michael Zollhoefer 외

Real-time rendering and animation of humans is a core function in games, movies, and telepresence applications. Existing methods have a number of drawbacks we aim to address with our work. Triangle meshes have difficulty…

Neural Rendering

PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generation

2023-12-07 · NeurIPS 2023 11 · Zhaoxi Chen, Fangzhou Hong, Haiyi Mei, Guangcong Wang 외

We present PrimDiffusion, the first diffusion-based framework for 3D human generation. Devising diffusion models for 3D human generation is difficult due to the intensive computational cost of 3D representations and the …

3D InpaintingDecoderDenoising

Representing Long Volumetric Video with Temporal Gaussian Hierarchy

2024-12-12 · Zhen Xu, Yinghao Xu, Zhiyuan Yu, Sida Peng 외

This paper aims to address the challenge of reconstructing long volumetric videos from multi-view RGB videos. Recent dynamic view synthesis methods leverage powerful 4D representations, like feature grids or point cloud …

GPU

Learning Shape Abstractions by Assembling Volumetric Primitives

2016-12-01 · CVPR 2017 7 · Shubham Tulsiani, Hao Su, Leonidas J. Guibas, Alexei A. Efros 외

We present a learning framework for abstracting complex shapes by learning to assemble objects using 3D volumetric primitives. In addition to generating simple and geometrically interpretable explanations of 3D objects, …