paper-with-me

홈 › Papers

GAPrompt: Geometry-Aware Point Cloud Prompt for 3D Vision Model

2025-05-07 · Zixiang Ai, Zichen Liu, Yuanhang Lei, Zhenyu Cui, Xu Zou, Jiahuan Zhou

Pre-trained 3D vision models have gained significant attention for their promising performance on point cloud data. However, fully fine-tuning these models for downstream tasks is computationally expensive and storage-intensive. Existing parameter-efficient fine-tuning (PEFT) approaches, which focus primarily on input token prompting, struggle to achieve competitive performance due to their limited ability to capture the geometric information inherent in point clouds. To address this challenge, we propose a novel Geometry-Aware Point Cloud Prompt (GAPrompt) that leverages geometric cues to enhance the adaptability of 3D vision models. First, we introduce a Point Prompt that serves as an auxiliary input alongside the original point cloud, explicitly guiding the model to capture fine-grained geometric details. Additionally, we present a Point Shift Prompter designed to extract global shape information from the point cloud, enabling instance-specific geometric adjustments at the input level. Moreover, our proposed Prompt Propagation mechanism incorporates the shape information into the model's feature extraction process, further strengthening its ability to capture essential geometric characteristics. Extensive experiments demonstrate that GAPrompt significantly outperforms state-of-the-art PEFT methods and achieves competitive results compared to full fine-tuning on various benchmarks, while utilizing only 2.19% of trainable parameters. Our code is available at https://github.com/zhoujiahuan1991/ICML2025-VGP.

📄 PDF Abstract BibTeX arXiv:2505.04119

Code (1)

zhoujiahuan1991/icml2025-gaprompt 공식 구현 pytorch

Tasks

parameter-efficient fine-tuning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

P2M2-Net: Part-Aware Prompt-Guided Multimodal Point Cloud Completion

2023-12-29 · Linlian Jiang, Pan Chen, Ye Wang, Tieru Wu 외

Inferring missing regions from severely occluded point clouds is highly challenging. Especially for 3D shapes with rich geometry and structure details, inherent ambiguities of the unknown parts are existing. Existing app…

Point Cloud Completion

P2P: Tuning Pre-trained Image Models for Point Cloud Analysis with Point-to-Pixel Prompting

2022-08-04 · Ziyi Wang, Xumin Yu, Yongming Rao, Jie zhou 외

Nowadays, pre-training big models on large-scale datasets has become a crucial topic in deep learning. The pre-trained models with high representation ability and transferability achieve a great success and dominate many…

3D Part Segmentation3D Point Cloud Classification

Point-PEFT: Parameter-Efficient Fine-Tuning for 3D Pre-trained Models

2023-10-04 · Yiwen Tang, Ray Zhang, Zoey Guo, Dong Wang 외

The popularity of pre-trained large models has revolutionized downstream tasks across diverse fields, such as language, vision, and multi-modality. To minimize the adaption cost for downstream tasks, many Parameter-Effic…

parameter-efficient fine-tuning

MAGE: View-guided Point Cloud Completion with Efficient Modality Alignment and Adaptive Geometry Enhancement

2026-06-30 · Weize Quan, Zhengwei Wu, Kai Wang, Dong-Ming Yan arxiv

View-based point cloud completion aims to recover a complete 3D shape from a partial point cloud, guided by a single-view image. However, existing approaches often suffer from limited performance due to weak modality ali…

Point Cloud Completion

TransPose: 6D Object Pose Estimation with Geometry-Aware Transformer

2023-10-25 · Xiao Lin, Deming Wang, Guangliang Zhou, Chengju Liu 외

Estimating the 6D object pose is an essential task in many applications. Due to the lack of depth information, existing RGB-based methods are sensitive to occlusion and illumination changes. How to extract and utilize th…

6D Pose Estimation using RGBObjectPose Estimation