Intrinsic Image Decomposition Using Point Cloud Representation
The purpose of intrinsic decomposition is to separate an image into its albedo (reflective properties) and shading components (illumination properties). This is challenging because it's an ill-posed problem. Conventional approaches primarily concentrate on 2D imagery and fail to fully exploit the capabilities of 3D data representation. 3D point clouds offer a more comprehensive format for representing scenes, as they combine geometric and color information effectively. To this end, in this paper, we introduce Point Intrinsic Net (PoInt-Net), which leverages 3D point cloud data to concurrently estimate albedo and shading maps. The merits of PoInt-Net include the following aspects. First, the model is efficient, achieving consistent performance across point clouds of any size with training only required on small-scale point clouds. Second, it exhibits remarkable robustness; even when trained exclusively on datasets comprising individual objects, PoInt-Net demonstrates strong generalization to unseen objects and scenes. Third, it delivers superior accuracy over conventional 2D approaches, demonstrating enhanced performance across various metrics on different datasets. (Code Released)
Code (1)
Tasks
Intrinsic Image DecompositionSimilar Papers 제목 키워드 기반
IPCD: Intrinsic Point-Cloud Decomposition
Point clouds are widely used in various fields, including augmented reality (AR) and robotics, where relighting and texture editing are crucial for realistic visualization. Achieving these tasks requires accurately separ…
Point CloudsNeural Intrinsic Embedding for Non-rigid Point Cloud Matching
As a primitive 3D data representation, point clouds are prevailing in 3D sensing, yet short of intrinsic structural information of the underlying objects. Such discrepancy poses great challenges on directly establishing …
Point Cloud RegistrationWeakly-supervised LearningLabel-Efficient Learning on Point Clouds using Approximate Convex Decompositions
The problems of shape classification and part segmentation from 3D point clouds have garnered increasing attention in the last few years. Both of these problems, however, suffer from relatively small training sets, creat…
General ClassificationRepresentation LearningSegmentationIntrinsic PAPR for Point-level 3D Scene Albedo and Shading Editing
Recent advancements in neural rendering have excelled at novel view synthesis from multi-view RGB images. However, they often lack the capability to edit the shading or colour of the scene at a detailed point-level, whil…
Inverse RenderingNeRFNeural RenderingNovel View SynthesisABD-Net: Attention Based Decomposition Network for 3D Point Cloud Decomposition
In this paper, we propose Attention Based Decomposition Network (ABD-Net), for point cloud decomposition into basic geometric shapes namely, plane, sphere, cone and cylinder. We show improved performance of 3D object cla…
3D Object Classification