paper-with-me

Papers

SurfaceNet: Adversarial SVBRDF Estimation from a Single Image

2021-07-23 · ICCV 2021 10 · Giuseppe Vecchio, Simone Palazzo, Concetto Spampinato

In this paper we present SurfaceNet, an approach for estimating spatially-varying bidirectional reflectance distribution function (SVBRDF) material properties from a single image. We pose the problem as an image translation task and propose a novel patch-based generative adversarial network (GAN) that is able to produce high-quality, high-resolution surface reflectance maps. The employment of the GAN paradigm has a twofold objective: 1) allowing the model to recover finer details than standard translation models; 2) reducing the domain shift between synthetic and real data distributions in an unsupervised way. An extensive evaluation, carried out on a public benchmark of synthetic and real images under different illumination conditions, shows that SurfaceNet largely outperforms existing SVBRDF reconstruction methods, both quantitatively and qualitatively. Furthermore, SurfaceNet exhibits a remarkable ability in generating high-quality maps from real samples without any supervision at training time.

📄 PDF Abstract BibTeX arXiv:2107.11298

Code (2)

perceivelab/surfacenet 공식 구현 pytorch
perceivelab/trf-sg2im pytorch

Tasks

Generative Adversarial NetworkSVBRDF EstimationTranslation

Similar Papers 제목 키워드 기반

SVBRDF Recovery From a Single Image With Highlights using a Pretrained Generative Adversarial Network

2021-10-29 · Tao Wen, Beibei Wang, Lei Zhang, Jie Guo 외

Spatially-varying bi-directional reflectance distribution functions (SVBRDFs) are crucial for designers to incorporate new materials in virtual scenes, making them look more realistic. Reconstruction of SVBRDFs is a long…

Generative Adversarial Network

An evaluation of SVBRDF Prediction from Generative Image Models for Appearance Modeling of 3D Scenes

2025-12-15 · Alban Gauthier, Valentin Deschaintre, Alexandre Lanvin, Fredo Durand 외 arxiv

Digital content creation is experiencing a profound change with the advent of deep generative models. For texturing, conditional image generators now allow the synthesis of realistic RGB images of a 3D scene that align w…

SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsis

2017-08-05 · ICCV 2017 10 · Mengqi Ji, Juergen Gall, Haitian Zheng, Yebin Liu 외

This paper proposes an end-to-end learning framework for multiview stereopsis. We term the network SurfaceNet. It takes a set of images and their corresponding camera parameters as input and directly infers the 3D model.…

MatFusion: A Generative Diffusion Model for SVBRDF Capture

2024-04-24 · Sam Sartor, Pieter Peers

We formulate SVBRDF estimation from photographs as a diffusion task. To model the distribution of spatially varying materials, we first train a novel unconditional SVBRDF diffusion backbone model on a large set of 312,16…

modelSVBRDF Estimation

Single-Shot Neural Relighting and SVBRDF Estimation

2020-08-01 · ECCV 2020 8 · Shen Sang, Manmohan Chandraker

We present a novel physically-motivated deep network for joint shape and material estimation, as well as relighting under novel illumination conditions, using a single image captured by a mobile phone camera. Our physica…

Inverse RenderingSVBRDF Estimation