paper-with-me

Papers

Transferable 3D Adversarial Shape Completion using Diffusion Models

2024-07-14 · Xuelong Dai, Bin Xiao

Recent studies that incorporate geometric features and transformers into 3D point cloud feature learning have significantly improved the performance of 3D deep-learning models. However, their robustness against adversarial attacks has not been thoroughly explored. Existing attack methods primarily focus on white-box scenarios and struggle to transfer to recently proposed 3D deep-learning models. Even worse, these attacks introduce perturbations to 3D coordinates, generating unrealistic adversarial examples and resulting in poor performance against 3D adversarial defenses. In this paper, we generate high-quality adversarial point clouds using diffusion models. By using partial points as prior knowledge, we generate realistic adversarial examples through shape completion with adversarial guidance. The proposed adversarial shape completion allows for a more reliable generation of adversarial point clouds. To enhance attack transferability, we delve into the characteristics of 3D point clouds and employ model uncertainty for better inference of model classification through random down-sampling of point clouds. We adopt ensemble adversarial guidance for improved transferability across different network architectures. To maintain the generation quality, we limit our adversarial guidance solely to the critical points of the point clouds by calculating saliency scores. Extensive experiments demonstrate that our proposed attacks outperform state-of-the-art adversarial attack methods against both black-box models and defenses. Our black-box attack establishes a new baseline for evaluating the robustness of various 3D point cloud classification models.

📄 PDF Abstract BibTeX arXiv:2407.10077

Code (1)

EricDai0/3DASC 공식 구현 pytorch

Tasks

3D Point Cloud ClassificationAdversarial AttackPoint Cloud Classification

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

SC-Diff: 3D Shape Completion with Latent Diffusion Models

2024-03-19 · Juan D. Galvis, Xingxing Zuo, Simon Schaefer, Stefan Leutengger

This paper introduces a 3D shape completion approach using a 3D latent diffusion model optimized for completing shapes, represented as Truncated Signed Distance Functions (TSDFs), from partial 3D scans. Our method combin…

Object

3D Shape Generation and Completion through Point-Voxel Diffusion

2021-04-08 · ICCV 2021 10 · Linqi Zhou, Yilun Du, Jiajun Wu

We propose a novel approach for probabilistic generative modeling of 3D shapes. Unlike most existing models that learn to deterministically translate a latent vector to a shape, our model, Point-Voxel Diffusion (PVD), is…

3D Shape GenerationDenoising

Repurposing 2D Diffusion Models for 3D Shape Completion

2025-12-16 · Yao He, Youngjoong Kwon, Tiange Xiang, Wenxiao Cai 외 arxiv

We present a framework that adapts 2D diffusion models for 3D shape completion from incomplete point clouds. While text-to-image diffusion models have achieved remarkable success with abundant 2D data, 3D diffusion model…

Point Clouds

DiffComplete: Diffusion-based Generative 3D Shape Completion

2023-06-28 · NeurIPS 2023 11

We introduce a new diffusion-based approach for shape completion on 3D range scans. Compared with prior deterministic and probabilistic methods, we strike a balance between realism, multi-modality, and high fidelity. We …

Diverse Shape Completion via Style Modulated Generative Adversarial Networks

2023-11-18 · NeurIPS 2023 11

Shape completion aims to recover the full 3D geometry of an object from a partial observation. This problem is inherently multi-modal since there can be many ways to plausibly complete the missing regions of a shape. Suc…

3D geometryDiversityGenerative Adversarial Network