PartSeg: Few-shot Part Segmentation via Part-aware Prompt Learning
In this work, we address the task of few-shot part segmentation, which aims to segment the different parts of an unseen object using very few labeled examples. It is found that leveraging the textual space of a powerful pre-trained image-language model (such as CLIP) can be beneficial in learning visual features. Therefore, we develop a novel method termed PartSeg for few-shot part segmentation based on multimodal learning. Specifically, we design a part-aware prompt learning method to generate part-specific prompts that enable the CLIP model to better understand the concept of ``part'' and fully utilize its textual space. Furthermore, since the concept of the same part under different object categories is general, we establish relationships between these parts during the prompt learning process. We conduct extensive experiments on the PartImageNet and Pascal$\_$Part datasets, and the experimental results demonstrated that our proposed method achieves state-of-the-art performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingPrompt LearningSegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PARTE: Part-Guided Texturing for 3D Human Reconstruction from a Single Image
The misaligned human texture across different human parts is one of the main limitations of existing 3D human reconstruction methods. Each human part, such as a jacket or pants, should maintain a distinct texture without…
3D Human Reconstruction3D Part SegmentationImage GenerationPart-aware Prototype Network for Few-shot Semantic Segmentation
Few-shot semantic segmentation aims to learn to segment new object classes with only a few annotated examples, which has a wide range of real-world applications. Most existing methods either focus on the restrictive sett…
Few-Shot Semantic SegmentationGraph Neural NetworkObjectSegmentation+2Context-aware Feature Generation for Zero-shot Semantic Segmentation
Existing semantic segmentation models heavily rely on dense pixel-wise annotations. To reduce the annotation pressure, we focus on a challenging task named zero-shot semantic segmentation, which aims to segment unseen ob…
SegmentationSemantic SegmentationWord EmbeddingsZero Shot Segmentation+1SAMPart3D: Segment Any Part in 3D Objects
3D part segmentation is a crucial and challenging task in 3D perception, playing a vital role in applications such as robotics, 3D generation, and 3D editing. Recent methods harness the powerful Vision Language Models (V…
3D Generation3D Part SegmentationInteractive SegmentationKnowledge Distillation+1Part-aware Personalized Segment Anything Model for Patient-Specific Segmentation
Precision medicine, such as patient-adaptive treatments utilizing medical images, poses new challenges for image segmentation algorithms due to (1) the large variability across different patients and (2) the limited avai…
Patient-Specific SegmentationPersonalized Segmentation