Leveraging Multi-view Image Sets for Unsupervised Intrinsic Image Decomposition and Highlight Separation
We present an unsupervised approach for factorizing object appearance into highlight, shading, and albedo layers, trained by multi-view real images. To do so, we construct a multi-view dataset by collecting numerous customer product photos online, which exhibit large illumination variations that make them suitable for training of reflectance separation and can facilitate object-level decomposition. The main contribution of our approach is a proposed image representation based on local color distributions that allows training to be insensitive to the local misalignments of multi-view images. In addition, we present a new guidance cue for unsupervised training that exploits synergy between highlight separation and intrinsic image decomposition. Over a broad range of objects, our technique is shown to yield state-of-the-art results for both of these tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Intrinsic Image DecompositionObjectSimilar Papers 제목 키워드 기반
Classifier-guided CLIP Distillation for Unsupervised Multi-label Classification
Multi-label classification is crucial for comprehensive image understanding, yet acquiring accurate annotations is challenging and costly. To address this, a recent study suggests exploiting unsupervised multi-label …
ClassificationLanguage ModelingLanguage ModellingMulti-Label Classification+1PatchMVSNet: Patch-wise Unsupervised Multi-View Stereo for Weakly-Textured Surface Reconstruction
Learning-based multi-view stereo (MVS) has gained fine reconstructions on popular datasets. However, supervised learning methods require ground truth for training, which is hard to be collected, especially for the large-…
Depth EstimationSurface ReconstructionTowards a unified view of unsupervised non-local methods for image denoising: the NL-Ridge approach
We propose a unified view of unsupervised non-local methods for image denoising that linearily combine noisy image patches. The best methods, established in different modeling and estimation frameworks, are two-step algo…
Deep LearningDenoisingImage DenoisingLearning TheorySelf-supervised Learning of Depth Inference for Multi-view Stereo
Recent supervised multi-view depth estimation networks have achieved promising results. Similar to all supervised approaches, these networks require ground-truth data during training. However, collecting a large amount o…
Depth EstimationImage ReconstructionSelf-Supervised LearningUnsupervised Pixel-Level Semantic Left-Right Understanding of In-the-Wild Images
While various works address reflective symmetry understanding in 3D data and images, pixel-level semantic left-right prediction of in-the-wild images remains challenging, due to certain difficulties including the lack of…