paper-with-me

Papers

Diffuse Map Guiding Unsupervised Generative Adversarial Network for SVBRDF Estimation

2022-05-24 · Zhiyao Luo, Hongnan Chen

Reconstructing materials in the real world has always been a difficult problem in computer graphics. Accurately reconstructing the material in the real world is critical in the field of realistic rendering. Traditionally, materials in computer graphics are mapped by an artist, then mapped onto a geometric model by coordinate transformation, and finally rendered with a rendering engine to get realistic materials. For opaque objects, the industry commonly uses physical-based bidirectional reflectance distribution function (BRDF) rendering models for material modeling. The commonly used physical-based rendering models are Cook-Torrance BRDF, Disney BRDF. In this paper, we use the Cook-Torrance model to reconstruct the materials. The SVBRDF material parameters include Normal, Diffuse, Specular and Roughness. This paper presents a Diffuse map guiding material estimation method based on the Generative Adversarial Network(GAN). This method can predict plausible SVBRDF maps with global features using only a few pictures taken by the mobile phone. The main contributions of this paper are: 1) We preprocess a small number of input pictures to produce a large number of non-repeating pictures for training to reduce over-fitting. 2) We use a novel method to directly obtain the guessed diffuse map with global characteristics, which provides more prior information for the training process. 3) We improve the network architecture of the generator so that it can generate fine details of normal maps and reduce the possibility to generate over-flat normal maps. The method used in this paper can obtain prior knowledge without using dataset training, which greatly reduces the difficulty of material reconstruction and saves a lot of time to generate and calibrate datasets.

📄 PDF Abstract BibTeX arXiv:2205.11951

Code (0)

등록된 구현이 없습니다.

Tasks

Generative Adversarial NetworkSVBRDF Estimation

Similar Papers 제목 키워드 기반

SVBRDF Recovery From a Single Image With Highlights using a Pretrained Generative Adversarial Network

2021-10-29 · Tao Wen, Beibei Wang, Lei Zhang, Jie Guo 외

Spatially-varying bi-directional reflectance distribution functions (SVBRDFs) are crucial for designers to incorporate new materials in virtual scenes, making them look more realistic. Reconstruction of SVBRDFs is a long…

Generative Adversarial Network

SurfaceNet: Adversarial SVBRDF Estimation from a Single Image

2021-07-23 · ICCV 2021 10 · Giuseppe Vecchio, Simone Palazzo, Concetto Spampinato

In this paper we present SurfaceNet, an approach for estimating spatially-varying bidirectional reflectance distribution function (SVBRDF) material properties from a single image. We pose the problem as an image translat…

Generative Adversarial NetworkSVBRDF EstimationTranslation

Sparse Ellipsometry: Portable Acquisition of Polarimetric SVBRDF and Shape with Unstructured Flash Photography

2022-07-09 · Inseung Hwang, Daniel S. Jeon, Adolfo Muñoz, Diego Gutierrez 외

Ellipsometry techniques allow to measure polarization information of materials, requiring precise rotations of optical components with different configurations of lights and sensors. This results in cumbersome capture de…

Data AugmentationInverse Rendering

MatFusion: A Generative Diffusion Model for SVBRDF Capture

2024-04-24 · Sam Sartor, Pieter Peers

We formulate SVBRDF estimation from photographs as a diffusion task. To model the distribution of spatially varying materials, we first train a novel unconditional SVBRDF diffusion backbone model on a large set of 312,16…

modelSVBRDF Estimation

An evaluation of SVBRDF Prediction from Generative Image Models for Appearance Modeling of 3D Scenes

2025-12-15 · Alban Gauthier, Valentin Deschaintre, Alexandre Lanvin, Fredo Durand 외 arxiv

Digital content creation is experiencing a profound change with the advent of deep generative models. For texturing, conditional image generators now allow the synthesis of realistic RGB images of a 3D scene that align w…