paper-with-me

홈 › Papers

Loss Distillation via Gradient Matching for Point Cloud Completion with Weighted Chamfer Distance

2024-09-10 · Fangzhou Lin, Haotian Liu, Haoying Zhou, Songlin Hou, Kazunori D Yamada, Gregory S. Fischer, Yanhua Li, Haichong K. Zhang, Ziming Zhang

3D point clouds enhanced the robot's ability to perceive the geometrical information of the environments, making it possible for many downstream tasks such as grasp pose detection and scene understanding. The performance of these tasks, though, heavily relies on the quality of data input, as incomplete can lead to poor results and failure cases. Recent training loss functions designed for deep learning-based point cloud completion, such as Chamfer distance (CD) and its variants (\eg HyperCD ), imply a good gradient weighting scheme can significantly boost performance. However, these CD-based loss functions usually require data-related parameter tuning, which can be time-consuming for data-extensive tasks. To address this issue, we aim to find a family of weighted training losses ({\em weighted CD}) that requires no parameter tuning. To this end, we propose a search scheme, {\em Loss Distillation via Gradient Matching}, to find good candidate loss functions by mimicking the learning behavior in backpropagation between HyperCD and weighted CD. Once this is done, we propose a novel bilevel optimization formula to train the backbone network based on the weighted CD loss. We observe that: (1) with proper weighted functions, the weighted CD can always achieve similar performance to HyperCD, and (2) the Landau weighted CD, namely {\em Landau CD}, can outperform HyperCD for point cloud completion and lead to new state-of-the-art results on several benchmark datasets. {\it Our demo code is available at \url{https://github.com/Zhang-VISLab/IROS2024-LossDistillationWeightedCD}.}

📄 PDF Abstract BibTeX arXiv:2409.06171

Code (1)

zhang-vislab/iros2024-lossdistillationweightedcd 공식 구현 pytorch

Tasks

Bilevel OptimizationPoint Cloud CompletionScene Understanding

Similar Papers 제목 키워드 기반

MedPCFM-TED: One-Step Point Cloud Flow Matching for Implant Generation via Teacher-Guided Endpoint Distillation

2026-09-15 · Kamil Kwarciak, Marek Wodzinski arxiv

Cranial implant generation is an important task in medical imaging. Recent point cloud based generative methods, particularly flow matching, offer strong reconstruction quality and efficient sampling, but still require m…

Geometric MatchingPoint Clouds

Permutation-Invariant and Orientation-Aware Dataset Distillation for 3D Point Clouds

2025-03-28 · Jae-Young Yim, DongWook Kim, Jae-Young Sim

We should collect large amount of data to train deep neural networks for various applications. Recently, the dataset distillation for images and texts has been attracting a lot of attention, that reduces the original dat…

Dataset Distillation

Feature Adversarial Distillation for Point Cloud Classification

2023-06-25 · YuXing Lee, Wei Wu

Due to the point cloud's irregular and unordered geometry structure, conventional knowledge distillation technology lost a lot of information when directly used on point cloud tasks. In this paper, we propose Feature Adv…

ClassificationFADKnowledge DistillationModel Compression+2

DeepEMD: A Transformer-based Fast Estimation of the Earth Mover's Distance

2023-11-16 · Atul Kumar Sinha, Francois Fleuret

The Earth Mover's Distance (EMD) is the measure of choice between point clouds. However the computational cost to compute it makes it prohibitive as a training loss, and the standard approach is to use a surrogate such a…

Searching Dense Point Correspondences via Permutation Matrix Learning

2022-10-26 · Zhiyuan Zhang, Jiadai Sun, Yuchao Dai, Bin Fan 외

Although 3D point cloud data has received widespread attentions as a general form of 3D signal expression, applying point clouds to the task of dense correspondence estimation between 3D shapes has not been investigated …