paper-with-me

홈 › Papers

PartSeg: Few-shot Part Segmentation via Part-aware Prompt Learning

2023-08-24 · Mengya Han, Heliang Zheng, Chaoyue Wang, Yong Luo, Han Hu, Jing Zhang, Yonggang Wen

In this work, we address the task of few-shot part segmentation, which aims to segment the different parts of an unseen object using very few labeled examples. It is found that leveraging the textual space of a powerful pre-trained image-language model (such as CLIP) can be beneficial in learning visual features. Therefore, we develop a novel method termed PartSeg for few-shot part segmentation based on multimodal learning. Specifically, we design a part-aware prompt learning method to generate part-specific prompts that enable the CLIP model to better understand the concept of ``part'' and fully utilize its textual space. Furthermore, since the concept of the same part under different object categories is general, we establish relationships between these parts during the prompt learning process. We conduct extensive experiments on the PartImageNet and Pascal$\_$Part datasets, and the experimental results demonstrated that our proposed method achieves state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2308.12757

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingPrompt LearningSegmentation

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

Similar Papers 제목 키워드 기반

PARTE: Part-Guided Texturing for 3D Human Reconstruction from a Single Image

2025-07-23 · Hyeongjin Nam, Donghwan Kim, Gyeongsik Moon, Kyoung Mu Lee arxiv

The misaligned human texture across different human parts is one of the main limitations of existing 3D human reconstruction methods. Each human part, such as a jacket or pants, should maintain a distinct texture without…

3D Human Reconstruction3D Part SegmentationImage Generation

Part-aware Prototype Network for Few-shot Semantic Segmentation

2020-07-13 · ECCV 2020 8 · Yongfei Liu, Xiangyi Zhang, Songyang Zhang, Xuming He

Few-shot semantic segmentation aims to learn to segment new object classes with only a few annotated examples, which has a wide range of real-world applications. Most existing methods either focus on the restrictive sett…

Few-Shot Semantic SegmentationGraph Neural NetworkObjectSegmentation+2

Context-aware Feature Generation for Zero-shot Semantic Segmentation

2020-08-16 · Zhangxuan Gu, Siyuan Zhou, Li Niu, Zihan Zhao 외

Existing semantic segmentation models heavily rely on dense pixel-wise annotations. To reduce the annotation pressure, we focus on a challenging task named zero-shot semantic segmentation, which aims to segment unseen ob…

SegmentationSemantic SegmentationWord EmbeddingsZero Shot Segmentation+1

SAMPart3D: Segment Any Part in 3D Objects

2024-11-11 · Yunhan Yang, Yukun Huang, Yuan-Chen Guo, Liangjun Lu 외

3D part segmentation is a crucial and challenging task in 3D perception, playing a vital role in applications such as robotics, 3D generation, and 3D editing. Recent methods harness the powerful Vision Language Models (V…

3D Generation3D Part SegmentationInteractive SegmentationKnowledge Distillation+1

Part-aware Personalized Segment Anything Model for Patient-Specific Segmentation

2024-03-08 · Chenhui Zhao, Liyue Shen

Precision medicine, such as patient-adaptive treatments utilizing medical images, poses new challenges for image segmentation algorithms due to (1) the large variability across different patients and (2) the limited avai…

Patient-Specific SegmentationPersonalized Segmentation