Learning Instance and Task-Aware Dynamic Kernels for Few Shot Learning
Learning and generalizing to novel concepts with few samples (Few-Shot Learning) is still an essential challenge to real-world applications. A principle way of achieving few-shot learning is to realize a model that can rapidly adapt to the context of a given task. Dynamic networks have been shown capable of learning content-adaptive parameters efficiently, making them suitable for few-shot learning. In this paper, we propose to learn the dynamic kernels of a convolution network as a function of the task at hand, enabling faster generalization. To this end, we obtain our dynamic kernels based on the entire task and each sample and develop a mechanism further conditioning on each individual channel and position independently. This results in dynamic kernels that simultaneously attend to the global information whilst also considering minuscule details available. We empirically show that our model improves performance on few-shot classification and detection tasks, achieving a tangible improvement over several baseline models. This includes state-of-the-art results on 4 few-shot classification benchmarks: mini-ImageNet, tiered-ImageNet, CUB and FC100 and competitive results on a few-shot detection dataset: MS COCO-PASCAL-VOC.
Code (1)
Tasks
Few-Shot LearningNovel ConceptsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolution
Existing 3D instance segmentation methods are predominated by the bottom-up design -- manually fine-tuned algorithm to group points into clusters followed by a refinement network. However, by relying on the quality of th…
3D Instance SegmentationInstance SegmentationSemantic SegmentationGeodesic-Former: a Geodesic-Guided Few-shot 3D Point Cloud Instance Segmenter
This paper introduces a new problem in 3D point cloud: few-shot instance segmentation. Given a few annotated point clouds exemplified a target class, our goal is to segment all instances of this target class in a query p…
Few-shot Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation3D Instances as 1D Kernels
We introduce a 3D instance representation, termed instance kernels, where instances are represented by one-dimensional vectors that encode the semantic, positional, and shape information of 3D instances. We show that ins…
3D Instance SegmentationInstance SegmentationSemantic SegmentationCalibNet: Dual-branch Cross-modal Calibration for RGB-D Salient Instance Segmentation
We propose a novel approach for RGB-D salient instance segmentation using a dual-branch cross-modal feature calibration architecture called CalibNet. Our method simultaneously calibrates depth and RGB features in the ker…
Instance SegmentationSemantic SegmentationISDA: Position-Aware Instance Segmentation with Deformable Attention
Most instance segmentation models are not end-to-end trainable due to either the incorporation of proposal estimation (RPN) as a pre-processing or non-maximum suppression (NMS) as a post-processing. Here we propose a nov…
Instance SegmentationPositionSegmentationSemantic Segmentation