paper-with-me

Papers

A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completion

2021-12-07 · ICLR 2022 4 · Zhaoyang Lyu, Zhifeng Kong, Xudong Xu, Liang Pan, Dahua Lin

3D point cloud is an important 3D representation for capturing real world 3D objects. However, real-scanned 3D point clouds are often incomplete, and it is important to recover complete point clouds for downstream applications. Most existing point cloud completion methods use Chamfer Distance (CD) loss for training. The CD loss estimates correspondences between two point clouds by searching nearest neighbors, which does not capture the overall point density distribution on the generated shape, and therefore likely leads to non-uniform point cloud generation. To tackle this problem, we propose a novel Point Diffusion-Refinement (PDR) paradigm for point cloud completion. PDR consists of a Conditional Generation Network (CGNet) and a ReFinement Network (RFNet). The CGNet uses a conditional generative model called the denoising diffusion probabilistic model (DDPM) to generate a coarse completion conditioned on the partial observation. DDPM establishes a one-to-one pointwise mapping between the generated point cloud and the uniform ground truth, and then optimizes the mean squared error loss to realize uniform generation. The RFNet refines the coarse output of the CGNet and further improves quality of the completed point cloud. Furthermore, we develop a novel dual-path architecture for both networks. The architecture can (1) effectively and efficiently extract multi-level features from partially observed point clouds to guide completion, and (2) accurately manipulate spatial locations of 3D points to obtain smooth surfaces and sharp details. Extensive experimental results on various benchmark datasets show that our PDR paradigm outperforms previous state-of-the-art methods for point cloud completion. Remarkably, with the help of the RFNet, we can accelerate the iterative generation process of the DDPM by up to 50 times without much performance drop.

📄 PDF Abstract BibTeX arXiv:2112.03530

Code (1)

zhaoyanglyu/point_diffusion_refinement 공식 구현 pytorch

Tasks

DenoisingPoint Cloud CompletionPoint Cloud Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

CP3: Unifying Point Cloud Completion by Pretrain-Prompt-Predict Paradigm

2022-07-12 · Mingye Xu, Yali Wang, Yihao Liu, Tong He 외

Point cloud completion aims to predict complete shape from its partial observation. Current approaches mainly consist of generation and refinement stages in a coarse-to-fine style. However, the generation stage often lac…

Point Cloud CompletionPoint Cloud Generation

DexDiffuser: Generating Dexterous Grasps with Diffusion Models

2024-02-05 · Zehang Weng, Haofei Lu, Danica Kragic, Jens Lundell

We introduce DexDiffuser, a novel dexterous grasping method that generates, evaluates, and refines grasps on partial object point clouds. DexDiffuser includes the conditional diffusion-based grasp sampler DexSampler and …

DenoisingGrasp GenerationObject

DiffRef3D: A Diffusion-based Proposal Refinement Framework for 3D Object Detection

2023-10-25 · Se-Ho Kim, Inyong Koo, Inyoung Lee, Byeongjun Park 외

Denoising diffusion models show remarkable performances in generative tasks, and their potential applications in perception tasks are gaining interest. In this paper, we introduce a novel framework named DiffRef3D which …

3D Object DetectionDenoisingObjectobject-detection+1

Guidance for Low-Level Perceptual Editing in Unconditional Diffusion Models

2026-05-29 · Shreyansh Modi, Akshat Tomar, Aarush Aggarwal arxiv

Unconditional diffusion models offer powerful generative priors, yet steering them toward aesthetically enhanced outputs remains largely unexplored. We show that h-space patching, the dominant paradigm for training-free …

Large Intestine 3D Shape Refinement Using Point Diffusion Models for Digital Phantom Generation

2023-09-15 · Kaouther Mouheb, Mobina Ghojogh Nejad, Lavsen Dahal, Ehsan Samei 외

Accurate 3D modeling of human organs plays a crucial role in building computational phantoms for virtual imaging trials. However, generating anatomically plausible reconstructions of organ surfaces from computed tomograp…

DenoisingSegmentationSurface Reconstruction