SurfaceNet: Adversarial SVBRDF Estimation from a Single Image
In this paper we present SurfaceNet, an approach for estimating spatially-varying bidirectional reflectance distribution function (SVBRDF) material properties from a single image. We pose the problem as an image translation task and propose a novel patch-based generative adversarial network (GAN) that is able to produce high-quality, high-resolution surface reflectance maps. The employment of the GAN paradigm has a twofold objective: 1) allowing the model to recover finer details than standard translation models; 2) reducing the domain shift between synthetic and real data distributions in an unsupervised way. An extensive evaluation, carried out on a public benchmark of synthetic and real images under different illumination conditions, shows that SurfaceNet largely outperforms existing SVBRDF reconstruction methods, both quantitatively and qualitatively. Furthermore, SurfaceNet exhibits a remarkable ability in generating high-quality maps from real samples without any supervision at training time.
Code (2)
Tasks
Generative Adversarial NetworkSVBRDF EstimationTranslationSimilar Papers 제목 키워드 기반
SVBRDF Recovery From a Single Image With Highlights using a Pretrained Generative Adversarial Network
Spatially-varying bi-directional reflectance distribution functions (SVBRDFs) are crucial for designers to incorporate new materials in virtual scenes, making them look more realistic. Reconstruction of SVBRDFs is a long…
Generative Adversarial NetworkAn evaluation of SVBRDF Prediction from Generative Image Models for Appearance Modeling of 3D Scenes
Digital content creation is experiencing a profound change with the advent of deep generative models. For texturing, conditional image generators now allow the synthesis of realistic RGB images of a 3D scene that align w…
SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsis
This paper proposes an end-to-end learning framework for multiview stereopsis. We term the network SurfaceNet. It takes a set of images and their corresponding camera parameters as input and directly infers the 3D model.…
MatFusion: A Generative Diffusion Model for SVBRDF Capture
We formulate SVBRDF estimation from photographs as a diffusion task. To model the distribution of spatially varying materials, we first train a novel unconditional SVBRDF diffusion backbone model on a large set of 312,16…
modelSVBRDF EstimationSingle-Shot Neural Relighting and SVBRDF Estimation
We present a novel physically-motivated deep network for joint shape and material estimation, as well as relighting under novel illumination conditions, using a single image captured by a mobile phone camera. Our physica…
Inverse RenderingSVBRDF Estimation