paper-with-me

홈 › Papers

Decoupled Self Attention for Accurate One Stage Object Detection

2020-12-14 · Kehe WU, Zuge Chen, Qi Ma, Xiaoliang Zhang, Wei Li

As the scale of object detection dataset is smaller than that of image recognition dataset ImageNet, transfer learning has become a basic training method for deep learning object detection models, which will pretrain the backbone network of object detection model on ImageNet dataset to extract features for classification and localization subtasks. However, the classification task focuses on the salient region features of object, while the location task focuses on the edge features of object, so there is certain deviation between the features extracted by pretrained backbone network and the features used for localization task. In order to solve this problem, a decoupled self attention(DSA) module is proposed for one stage object detection models in this paper. DSA includes two decoupled self-attention branches, so it can extract appropriate features for different tasks. It is located between FPN and head networks of subtasks, so it is used to extract global features based on FPN fused features for different tasks independently. Although the network of DSA module is simple, but it can effectively improve the performance of object detection, also it can be easily embedded in many detection models. Our experiments are based on the representative one-stage detection model RetinaNet. In COCO dataset, when ResNet50 and ResNet101 are used as backbone networks, the detection performances can be increased by 0.4% AP and 0.5% AP respectively. When DSA module and object confidence task are applied in RetinaNet together, the detection performances based on ResNet50 and ResNet101 can be increased by 1.0% AP and 1.4% AP respectively. The experiment results show the effectiveness of DSA module. Code is at: https://github.com/chenzuge1/DSANet.git.

📄 PDF Abstract BibTeX arXiv:2012.07630

Code (1)

chenzuge1/DSANet 공식 구현

Tasks

Objectobject-detectionObject DetectionTransfer Learning

Methods 이 논문이 사용한 방법론

Focal Loss A Focal Loss function addresses class imbalance during training in tasks like object detection. Focal loss applies a modulating term to the cross entropy loss in order to…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
FPN 설명 없음
RetinaNet RetinaNet is a one-stage object detection model that utilizes a focal loss function to address class imbalance during training.…

Similar Papers 제목 키워드 기반

YOLOSA: Object detection based on 2D local feature superimposed self-attention

2022-06-23 · Weisheng Li, Lin Huang

We analyzed the network structure of real-time object detection models and found that the features in the feature concatenation stage are very rich. Applying an attention module here can effectively improve the detection…

object-detectionObject DetectionReal-Time Object Detection

SceneMaker: Open-set 3D Scene Generation with Decoupled De-occlusion and Pose Estimation Model

2025-12-11 · Yukai Shi, Weiyu Li, Zihao Wang, Hongyang Li 외 arxiv

We propose a decoupled 3D scene generation framework called SceneMaker in this work. Due to the lack of sufficient open-set de-occlusion and pose estimation priors, existing methods struggle to simultaneously produce hig…

Scene GenerationPose Estimation

DPDETR: Decoupled Position Detection Transformer for Infrared-Visible Object Detection

2024-08-12 · Junjie Guo, Chenqiang Gao, Fangcen Liu, Deyu Meng

Infrared-visible object detection aims to achieve robust object detection by leveraging the complementary information of infrared and visible image pairs. However, the commonly existing modality misalignment problem pres…

DecoderObjectobject-detectionObject Detection+2

CAMPA: Efficient and Aligned Multimodal Graph Learning via Decoupled Propagation and Aggregation

2026-05-12 · Daohan Su, Hao Liu, Xunkai Li, Yinlin Zhu 외 arxiv

Multimodal Graph Neural Networks (MGNNs) have shown strong potential for learning from multimodal attributed graphs, yet most existing approaches rely on tightly coupled architectures that suffer from prohibitive computa…

Representation LearningGraph Learning

Grasp, See, and Place: Efficient Unknown Object Rearrangement with Policy Structure Prior

2024-02-23 · Kechun Xu, Zhongxiang Zhou, Jun Wu, Haojian Lu 외

We focus on the task of unknown object rearrangement, where a robot is supposed to re-configure the objects into a desired goal configuration specified by an RGB-D image. Recent works explore unknown object rearrangement…

ObjectObject Rearrangement