Fine-grained Few-shot Recognition by Deep Object Parsing
We propose a new method for fine-grained few-shot recognition via deep object parsing. In our framework, an object is made up of K distinct parts and for each part, we learn a dictionary of templates, which is shared across all instances and categories. An object is parsed by estimating the locations of these K parts and a set of active templates that can reconstruct the part features. We recognize test instances by comparing its active templates and the relative geometry of its part locations against those of the presented few-shot instances. Our method is end-to-end trainable to learn part templates on-top of a convolutional backbone. To combat visual distortions such as orientation, pose and size, we learn templates at multiple scales, and at test-time parse and match instances across these scales. We show that our method is competitive with the state-of-the-art, and by virtue of parsing enjoys interpretability as well.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningObjectMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Parsing Objects at a Finer Granularity: A Survey
Fine-grained visual parsing, including fine-grained part segmentation and fine-grained object recognition, has attracted considerable critical attention due to its importance in many real-world applications, e.g., agricu…
Fine-Grained Visual RecognitionHuman Part SegmentationObject RecognitionSegmentation+1End-to-end One-shot Human Parsing
Previous human parsing methods are limited to parsing humans into pre-defined classes, which is inflexible for practical fashion applications that often have new fashion item classes. In this paper, we define a novel one…
Human ParsingMetric LearningOne-Shot SegmentationProgressively Parsing Interactional Objects for Fine Grained Action Detection
Fine grained video action analysis often requires reliable detection and tracking of various interacting objects and human body parts, denoted as interactional object parsing. However, most of the previous methods based …
Action AnalysisAction DetectionAction RecognitionFine-Grained Action Detection+4Learning the Redundancy-free Features for Generalized Zero-Shot Object Recognition
Zero-shot object recognition or zero-shot learning aims to transfer the object recognition ability among the semantically related categories, such as fine-grained animal or bird species. However, the images of different …
Generalized Zero-Shot LearningObjectObject RecognitionZero-Shot LearningMOMA-LRG: Language-Refined Graphs for Multi-Object Multi-Actor Activity Parsing
Video-language models (VLMs), large models pre-trained on numerous but noisy video-text pairs from the internet, have revolutionized activity recognition through their remarkable generalization and open-vocabulary capabi…
Activity RecognitionFew Shot Action RecognitionGraph GenerationVideo Understanding