paper-with-me

홈 › Papers

Tree-Structured Shading Decomposition

2023-09-13 · ICCV 2023 1 · Chen Geng, Hong-Xing Yu, Sharon Zhang, Maneesh Agrawala, Jiajun Wu

We study inferring a tree-structured representation from a single image for object shading. Prior work typically uses the parametric or measured representation to model shading, which is neither interpretable nor easily editable. We propose using the shade tree representation, which combines basic shading nodes and compositing methods to factorize object surface shading. The shade tree representation enables novice users who are unfamiliar with the physical shading process to edit object shading in an efficient and intuitive manner. A main challenge in inferring the shade tree is that the inference problem involves both the discrete tree structure and the continuous parameters of the tree nodes. We propose a hybrid approach to address this issue. We introduce an auto-regressive inference model to generate a rough estimation of the tree structure and node parameters, and then we fine-tune the inferred shade tree through an optimization algorithm. We show experiments on synthetic images, captured reflectance, real images, and non-realistic vector drawings, allowing downstream applications such as material editing, vectorized shading, and relighting. Project website: https://chen-geng.com/inv-shade-trees

📄 PDF Abstract BibTeX arXiv:2309.07122

Code (0)

등록된 구현이 없습니다.

Tasks

Object

Similar Papers 제목 키워드 기반

IDT: A Physically Grounded Transformer for Feed-Forward Multi-View Intrinsic Decomposition

2025-12-29 · Kang Du, Yirui Guan, Zeyu Wang arxiv

Intrinsic image decomposition is fundamental for visual understanding, as RGB images entangle material properties, illumination, and view-dependent effects. Recent diffusion-based methods have achieved strong results for…

ShadingNet: Image Intrinsics by Fine-Grained Shading Decomposition

2019-12-09 · Anil S. Baslamisli, Partha Das, Hoang-An Le, Sezer Karaoglu 외

In general, intrinsic image decomposition algorithms interpret shading as one unified component including all photometric effects. As shading transitions are generally smoother than reflectance (albedo) changes, these me…

DisentanglementIntrinsic Image Decomposition

Shading Annotations in the Wild

2017-05-02 · CVPR 2017 7 · Balazs Kovacs, Sean Bell, Noah Snavely, Kavita Bala

Understanding shading effects in images is critical for a variety of vision and graphics problems, including intrinsic image decomposition, shadow removal, image relighting, and inverse rendering. As is the case with oth…

Image RelightingIntrinsic Image DecompositionInverse RenderingShadow Removal

Intrinsic Image Decomposition via Ordinal Shading

2023-11-21 · ACM Transactions on Graphics 2023 10 · Chris Careaga, Yağız Aksoy

Intrinsic decomposition is a fundamental mid-level vision problem that plays a crucial role in various inverse rendering and computational photography pipelines. Generating highly accurate intrinsic decompositions is an …

Intrinsic Image DecompositionInverse Rendering

Physics-based Shading Reconstruction for Intrinsic Image Decomposition

2020-09-03 · Anil S. Baslamisli, Yang Liu, Sezer Karaoglu, Theo Gevers

We investigate the use of photometric invariance and deep learning to compute intrinsic images (albedo and shading). We propose albedo and shading gradient descriptors which are derived from physics-based models. Using t…

Intrinsic Image Decomposition