paper-with-me

홈 › Papers

Few-shot Shape Recognition by Learning Deep Shape-aware Features

2023-12-03 · Wenlong Shi, Changsheng Lu, Ming Shao, Yinjie Zhang, Siyu Xia, Piotr Koniusz

Traditional shape descriptors have been gradually replaced by convolutional neural networks due to their superior performance in feature extraction and classification. The state-of-the-art methods recognize object shapes via image reconstruction or pixel classification. However , these methods are biased toward texture information and overlook the essential shape descriptions, thus, they fail to generalize to unseen shapes. We are the first to propose a fewshot shape descriptor (FSSD) to recognize object shapes given only one or a few samples. We employ an embedding module for FSSD to extract transformation-invariant shape features. Secondly, we develop a dual attention mechanism to decompose and reconstruct the shape features via learnable shape primitives. In this way, any shape can be formed through a finite set basis, and the learned representation model is highly interpretable and extendable to unseen shapes. Thirdly, we propose a decoding module to include the supervision of shape masks and edges and align the original and reconstructed shape features, enforcing the learned features to be more shape-aware. Lastly, all the proposed modules are assembled into a few-shot shape recognition scheme. Experiments on five datasets show that our FSSD significantly improves the shape classification compared to the state-of-the-art under the few-shot setting.

📄 PDF Abstract BibTeX arXiv:2312.01315

Code (0)

등록된 구현이 없습니다.

Tasks

Image Reconstruction

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Delving into Shape-aware Zero-shot Semantic Segmentation

2023-04-17 · CVPR 2023 1 · Xinyu Liu, Beiwen Tian, Zhen Wang, Rui Wang 외

Thanks to the impressive progress of large-scale vision-language pretraining, recent recognition models can classify arbitrary objects in a zero-shot and open-set manner, with a surprisingly high accuracy. However, trans…

Image SegmentationSegmentationSemantic SegmentationZero-Shot Semantic Segmentation

PEVA-Net: Prompt-Enhanced View Aggregation Network for Zero/Few-Shot Multi-View 3D Shape Recognition

2024-04-30 · Dongyun Lin, Yi Cheng, Shangbo Mao, Aiyuan Guo 외

Large vision-language models have impressively promote the performance of 2D visual recognition under zero/few-shot scenarios. In this paper, we focus on exploiting the large vision-language model, i.e., CLIP, to address…

3D Shape RecognitionFew-Shot LearningLanguage ModellingZero-Shot Learning

Is Rotation a Nuisance in Shape Recognition?

2014-06-01 · CVPR 2014 6 · Qiuhong Ke, Yi Li

Rotation in closed contour recognition is a puzzling nuisance in most algorithms. In this paper we address three fundamental issues brought by rotation in shapes: 1) is alignment among shapes necessary? If the answer is …

Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Bias

2021-01-18 · CVPR 2021 1 · Stefan Stojanov, Anh Thai, James M. Rehg

It is widely accepted that reasoning about object shape is important for object recognition. However, the most powerful object recognition methods today do not explicitly make use of object shape during learning. In this…

ObjectObject Recognition

A ``Shape Aware'' Model for semi-supervised Learning of Objects and its Context

2008-12-01 · NeurIPS 2008 12 · Abhinav Gupta, Jianbo Shi, Larry S. Davis

Integrating semantic and syntactic analysis is essential for document analysis. Using an analogous reasoning, we present an approach that combines bag-of-words and spatial models to perform semantic and syntactic analysi…

ObjectObject Recognition