paper-with-me

Papers

SDF-3DGAN: A 3D Object Generative Method Based on Implicit Signed Distance Function

2023-03-13 · Lutao Jiang, Ruyi Ji, Libo Zhang

In this paper, we develop a new method, termed SDF-3DGAN, for 3D object generation and 3D-Aware image synthesis tasks, which introduce implicit Signed Distance Function (SDF) as the 3D object representation method in the generative field. We apply SDF for higher quality representation of 3D object in space and design a new SDF neural renderer, which has higher efficiency and higher accuracy. To train only on 2D images, we first generate the objects, which are represented by SDF, from Gaussian distribution. Then we render them to 2D images and use them to apply GAN training method together with 2D images in the dataset. In the new rendering method, we relieve all the potential of SDF mathematical property to alleviate computation pressure in the previous SDF neural renderer. In specific, our new SDF neural renderer can solve the problem of sampling ambiguity when the number of sampling point is not enough, \ie use the less points to finish higher quality sampling task in the rendering pipeline. And in this rendering pipeline, we can locate the surface easily. Therefore, we apply normal loss on it to control the smoothness of generated object surface, which can make our method enjoy the much higher generation quality. Quantitative and qualitative experiments conducted on public benchmarks demonstrate favorable performance against the state-of-the-art methods in 3D object generation task and 3D-Aware image synthesis task. Our codes will be released at https://github.com/lutao2021/SDF-3DGAN.

📄 PDF Abstract BibTeX arXiv:2303.06821

Code (0)

등록된 구현이 없습니다.

Tasks

3D-Aware Image SynthesisImage GenerationObject

Similar Papers 제목 키워드 기반

Semi-Implicit Denoising Diffusion Models (SIDDMs)

2023-06-21 · NeurIPS 2023 11

Despite the proliferation of generative models, achieving fast sampling during inference without compromising sample diversity and quality remains challenging. Existing models such as Denoising Diffusion Probabilistic Mo…

Denoising

CDGAN: Cyclic Discriminative Generative Adversarial Networks for Image-to-Image Transformation

2020-01-15 · Kancharagunta Kishan Babu, Shiv Ram Dubey

Generative Adversarial Networks (GANs) have facilitated a new direction to tackle the image-to-image transformation problem. Different GANs use generator and discriminator networks with different losses in the objective …

Ambient Denoising Diffusion Generative Adversarial Networks for Establishing Stochastic Object Models from Noisy Image Data

2025-01-31 · Xichen Xu, Wentao Chen, Weimin Zhou

It is widely accepted that medical imaging systems should be objectively assessed via task-based image quality (IQ) measures that ideally account for all sources of randomness in the measured image data, including the va…

Computed Tomography (CT)DenoisingGenerative Adversarial NetworkImage Generation

BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generation

2021-10-22 · NeurIPS 2021 12 · Mingcong Liu, Qiang Li, Zekui Qin, Guoxin Zhang 외

Generative Adversarial Networks (GANs) have made a dramatic leap in high-fidelity image synthesis and stylized face generation. Recently, a layer-swapping mechanism has been developed to improve the stylization performan…

DiversityFace GenerationImage Generation

MO-PaDGAN: Reparameterizing Engineering Designs for Augmented Multi-objective Optimization

2020-09-15 · Wei Chen, Faez Ahmed

Multi-objective optimization is key to solving many Engineering Design problems, where design parameters are optimized for several performance indicators. However, optimization results are highly dependent on how the des…

Generative Adversarial NetworkPoint Processes