paper-with-me

홈 › Papers

Decoupled DETR For Few-shot Object Detection

2023-11-20 · Zeyu Shangguan, Lian Huai, Tong Liu, Xingqun Jiang

Few-shot object detection (FSOD), an efficient method for addressing the severe data-hungry problem, has been extensively discussed. Current works have significantly advanced the problem in terms of model and data. However, the overall performance of most FSOD methods still does not fulfill the desired accuracy. In this paper we improve the FSOD model to address the severe issue of sample imbalance and weak feature propagation. To alleviate modeling bias from data-sufficient base classes, we examine the effect of decoupling the parameters for classes with sufficient data and classes with few samples in various ways. We design a base-novel categories decoupled DETR (DeDETR) for FSOD. We also explore various types of skip connection between the encoder and decoder for DETR. Besides, we notice that the best outputs could come from the intermediate layer of the decoder instead of the last layer; therefore, we build a unified decoder module that could dynamically fuse the decoder layers as the output feature. We evaluate our model on commonly used datasets such as PASCAL VOC and MSCOCO. Our results indicate that our proposed module could achieve stable improvements of 5% to 10% in both fine-tuning and meta-learning paradigms and has outperformed the highest score in recent works.

📄 PDF Abstract BibTeX arXiv:2311.11570

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderFew-Shot Object DetectionMeta-LearningObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

DeCo-DETR: Decoupled Cognition DETR for efficient Open-Vocabulary Object Detection

2026-04-03 · Siheng Wang, Yanshu Li, Bohan Hu, Zhengdao Li 외 arxiv

Open-vocabulary object detection (OVOD) enables models to recognize objects beyond predefined categories, but existing approaches remain limited in practical deployment. On the one hand, multimodal designs often incur su…

Object Detection

DPDETR: Decoupled Position Detection Transformer for Infrared-Visible Object Detection

2024-08-12 · Junjie Guo, Chenqiang Gao, Fangcen Liu, Deyu Meng

Infrared-visible object detection aims to achieve robust object detection by leveraging the complementary information of infrared and visible image pairs. However, the commonly existing modality misalignment problem pres…

DecoderObjectobject-detectionObject Detection+2

Decoupled DETR: Spatially Disentangling Localization and Classification for Improved End-to-End Object Detection

2023-10-24 · ICCV 2023 1 · Manyuan Zhang, Guanglu Song, Yu Liu, Hongsheng Li

The introduction of DETR represents a new paradigm for object detection. However, its decoder conducts classification and box localization using shared queries and cross-attention layers, leading to suboptimal results. W…

ClassificationDecoderobject-detectionObject Detection

Meta-DETR: Image-Level Few-Shot Object Detection with Inter-Class Correlation Exploitation

2021-03-22 · Gongjie Zhang, Zhipeng Luo, Kaiwen Cui, Shijian Lu

Few-shot object detection has been extensively investigated by incorporating meta-learning into region-based detection frameworks. Despite its success, the said paradigm is constrained by several factors, such as (i) low…

Few-Shot Object DetectionMeta-Learningobject-detectionObject Detection+1

Incremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learning

2022-05-09 · Na Dong, Yongqiang Zhang, Mingli Ding, Gim Hee Lee

Incremental few-shot object detection aims at detecting novel classes without forgetting knowledge of the base classes with only a few labeled training data from the novel classes. Most related prior works are on increme…

Few-Shot Object DetectionKnowledge DistillationObjectobject-detection+2