paper-with-me

Papers

Deep SVBRDF Estimation on Real Materials

2020-10-08 · Louis-Philippe Asselin, Denis Laurendeau, Jean-François Lalonde

Recent work has demonstrated that deep learning approaches can successfully be used to recover accurate estimates of the spatially-varying BRDF (SVBRDF) of a surface from as little as a single image. Closer inspection reveals, however, that most approaches in the literature are trained purely on synthetic data, which, while diverse and realistic, is often not representative of the richness of the real world. In this paper, we show that training such networks exclusively on synthetic data is insufficient to achieve adequate results when tested on real data. Our analysis leverages a new dataset of real materials obtained with a novel portable multi-light capture apparatus. Through an extensive series of experiments and with the use of a novel deep learning architecture, we explore two strategies for improving results on real data: finetuning, and a per-material optimization procedure. We show that adapting network weights to real data is of critical importance, resulting in an approach which significantly outperforms previous methods for SVBRDF estimation on real materials. Dataset and code are available at https://lvsn.github.io/real-svbrdf

📄 PDF Abstract BibTeX arXiv:2010.04143

Code (0)

등록된 구현이 없습니다.

Tasks

SVBRDF Estimation

Methods 이 논문이 사용한 방법론

Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
U-Net 설명 없음
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Weight Demodulation 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
HuMan(Expedia)||How do I get a human at Expedia? How do I get a human at Expedia? How Do I Get a Human at Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Real-Time Help & Exclusive…
StyleGAN2 StyleGAN2 is a generative adversarial network that builds on StyleGAN with several improvements. First, [adaptive instance…

Similar Papers 제목 키워드 기반

MatFusion: A Generative Diffusion Model for SVBRDF Capture

2024-04-24 · Sam Sartor, Pieter Peers

We formulate SVBRDF estimation from photographs as a diffusion task. To model the distribution of spatially varying materials, we first train a novel unconditional SVBRDF diffusion backbone model on a large set of 312,16…

modelSVBRDF Estimation

Diffuse Map Guiding Unsupervised Generative Adversarial Network for SVBRDF Estimation

2022-05-24 · Zhiyao Luo, Hongnan Chen

Reconstructing materials in the real world has always been a difficult problem in computer graphics. Accurately reconstructing the material in the real world is critical in the field of realistic rendering. Traditionally…

Generative Adversarial NetworkSVBRDF Estimation

Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Image

2018-04-16 · ECCV 2018 9 · Zhengqin Li, Kalyan Sunkavalli, Manmohan Chandraker

We propose a material acquisition approach to recover the spatially-varying BRDF and normal map of a near-planar surface from a single image captured by a handheld mobile phone camera. Our method images the surface under…

Two-shot Spatially-varying BRDF and Shape Estimation

2020-04-01 · CVPR 2020 6 · Mark Boss, Varun Jampani, Kihwan Kim, Hendrik P. A. Lensch 외

Capturing the shape and spatially-varying appearance (SVBRDF) of an object from images is a challenging task that has applications in both computer vision and graphics. Traditional optimization-based approaches often nee…

Vocal Bursts Valence Prediction

Guided Fine-Tuning for Large-Scale Material Transfer

2020-07-06 · Valentin Deschaintre, George Drettakis, Adrien Bousseau

We present a method to transfer the appearance of one or a few exemplar SVBRDFs to a target image representing similar materials. Our solution is extremely simple: we fine-tune a deep appearance-capture network on the pr…