paper-with-me

홈 › Papers

CLIPoint3D: Language-Grounded Few-Shot Unsupervised 3D Point Cloud Domain Adaptation

2026-02-23 · Mainak Singha, Sarthak Mehrotra, Paolo Casari, Subhasis Chaudhuri, Elisa Ricci, Biplab Banerjee arxiv

Recent vision-language models (VLMs) such as CLIP demonstrate impressive cross-modal reasoning, extending beyond images to 3D perception. Yet, these models remain fragile under domain shifts, especially when adapting from synthetic to real-world point clouds. Conventional 3D domain adaptation approaches rely on heavy trainable encoders, yielding strong accuracy but at the cost of efficiency. We introduce CLIPoint3D, the first framework for few-shot unsupervised 3D point cloud domain adaptation built upon CLIP. Our approach projects 3D samples into multiple depth maps and exploits the frozen CLIP backbone, refined through a knowledge-driven prompt tuning scheme that integrates high-level language priors with geometric cues from a lightweight 3D encoder. To adapt task-specific features effectively, we apply parameter-efficient fine-tuning to CLIP's encoders and design an entropy-guided view sampling strategy for selecting confident projections. Furthermore, an optimal transport-based alignment loss and an uncertainty-aware prototype alignment loss collaboratively bridge source-target distribution gaps while maintaining class separability. Extensive experiments on PointDA-10 and GraspNetPC-10 benchmarks show that CLIPoint3D achieves consistent 3-16% accuracy gains over both CLIP-based and conventional encoder-based baselines. Project page: https://sarthakm320.github.io/CLIPoint3D.

📄 PDF Abstract BibTeX arXiv:2602.20409

Code (0)

등록된 구현이 없습니다.

Tasks

parameter-efficient fine-tuningDomain AdaptationPoint Clouds

Similar Papers 제목 키워드 기반

Language in a (Search) Box: Grounding Language Learning in Real-World Human-Machine Interaction

2021-04-18 · NAACL 2021 4 · Federico Bianchi, Ciro Greco, Jacopo Tagliabue

We investigate grounded language learning through real-world data, by modelling a teacher-learner dynamics through the natural interactions occurring between users and search engines; in particular, we explore the emerge…

Grounded language learning

Visually grounded few-shot word acquisition with fewer shots

2023-05-25 · Leanne Nortje, Benjamin van Niekerk, Herman Kamper

We propose a visually grounded speech model that acquires new words and their visual depictions from just a few word-image example pairs. Given a set of test images and a spoken query, we ask the model which image depict…

Visually grounded few-shot word learning in low-resource settings

2023-06-20 · Leanne Nortje, Dan Oneata, Herman Kamper

We propose a visually grounded speech model that learns new words and their visual depictions from just a few word-image example pairs. Given a set of test images and a spoken query, we ask the model which image depicts …

Few-Shot Learning

ZSG-IAD: A Multimodal Framework for Zero-Shot Grounded Industrial Anomaly Detection

2026-04-20 · Qiuhui Chen, Jiaxiang Song, Shuai Tan, Weimin Zhong arxiv

Deep learning-based industrial anomaly detectors often behave as black boxes, making it hard to justify decisions with physically meaningful defect evidence. We propose ZSG-IAD, a multimodal vision-language framework for…

Anomaly DetectionPoint Clouds

I2DFormer: Learning Image to Document Attention for Zero-Shot Image Classification

2022-09-21 · Muhammad Ferjad Naeem, Yongqin Xian, Luc van Gool, Federico Tombari

Despite the tremendous progress in zero-shot learning(ZSL), the majority of existing methods still rely on human-annotated attributes, which are difficult to annotate and scale. An unsupervised alternative is to represen…

Generalized Zero-Shot Learningimage-classificationImage ClassificationWord Embeddings+2