paper-with-me

Papers

Learning Instance and Task-Aware Dynamic Kernels for Few Shot Learning

2021-12-07 · Rongkai Ma, Pengfei Fang, Gil Avraham, Yan Zuo, Tianyu Zhu, Tom Drummond, Mehrtash Harandi

Learning and generalizing to novel concepts with few samples (Few-Shot Learning) is still an essential challenge to real-world applications. A principle way of achieving few-shot learning is to realize a model that can rapidly adapt to the context of a given task. Dynamic networks have been shown capable of learning content-adaptive parameters efficiently, making them suitable for few-shot learning. In this paper, we propose to learn the dynamic kernels of a convolution network as a function of the task at hand, enabling faster generalization. To this end, we obtain our dynamic kernels based on the entire task and each sample and develop a mechanism further conditioning on each individual channel and position independently. This results in dynamic kernels that simultaneously attend to the global information whilst also considering minuscule details available. We empirically show that our model improves performance on few-shot classification and detection tasks, achieving a tangible improvement over several baseline models. This includes state-of-the-art results on 4 few-shot classification benchmarks: mini-ImageNet, tiered-ImageNet, CUB and FC100 and competitive results on a few-shot detection dataset: MS COCO-PASCAL-VOC.

📄 PDF Abstract BibTeX arXiv:2112.03494

Code (1)

RongKaiWeskerMA/INSTA 공식 구현 pytorch

Tasks

Few-Shot LearningNovel Concepts

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolution

2023-03-01 · CVPR 2023 1 · Tuan Duc Ngo, Binh-Son Hua, Khoi Nguyen

Existing 3D instance segmentation methods are predominated by the bottom-up design -- manually fine-tuned algorithm to group points into clusters followed by a refinement network. However, by relying on the quality of th…

3D Instance SegmentationInstance SegmentationSemantic Segmentation

Geodesic-Former: a Geodesic-Guided Few-shot 3D Point Cloud Instance Segmenter

2022-07-22 · Tuan Ngo, Khoi Nguyen

This paper introduces a new problem in 3D point cloud: few-shot instance segmentation. Given a few annotated point clouds exemplified a target class, our goal is to segment all instances of this target class in a query p…

Few-shot Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation

3D Instances as 1D Kernels

2022-07-15 · Yizheng Wu, Min Shi, Shuaiyuan Du, Hao Lu 외

We introduce a 3D instance representation, termed instance kernels, where instances are represented by one-dimensional vectors that encode the semantic, positional, and shape information of 3D instances. We show that ins…

3D Instance SegmentationInstance SegmentationSemantic Segmentation

CalibNet: Dual-branch Cross-modal Calibration for RGB-D Salient Instance Segmentation

2023-07-16 · Jialun Pei, Tao Jiang, He Tang, Nian Liu 외

We propose a novel approach for RGB-D salient instance segmentation using a dual-branch cross-modal feature calibration architecture called CalibNet. Our method simultaneously calibrates depth and RGB features in the ker…

Instance SegmentationSemantic Segmentation

ISDA: Position-Aware Instance Segmentation with Deformable Attention

2022-02-23 · Kaining Ying, Zhenhua Wang, Cong Bai, Pengfei Zhou

Most instance segmentation models are not end-to-end trainable due to either the incorporation of proposal estimation (RPN) as a pre-processing or non-maximum suppression (NMS) as a post-processing. Here we propose a nov…

Instance SegmentationPositionSegmentationSemantic Segmentation