paper-with-me

Papers

UniHead: Unifying Multi-Perception for Detection Heads

2023-09-23 · Hantao Zhou, Rui Yang, Yachao Zhang, Haoran Duan, Yawen Huang, Runze Hu, Xiu Li, Yefeng Zheng

The detection head constitutes a pivotal component within object detectors, tasked with executing both classification and localization functions. Regrettably, the commonly used parallel head often lacks omni perceptual capabilities, such as deformation perception, global perception and cross-task perception. Despite numerous methods attempting to enhance these abilities from a single aspect, achieving a comprehensive and unified solution remains a significant challenge. In response to this challenge, we develop an innovative detection head, termed UniHead, to unify three perceptual abilities simultaneously. More precisely, our approach (1) introduces deformation perception, enabling the model to adaptively sample object features; (2) proposes a Dual-axial Aggregation Transformer (DAT) to adeptly model long-range dependencies, thereby achieving global perception; and (3) devises a Cross-task Interaction Transformer (CIT) that facilitates interaction between the classification and localization branches, thus aligning the two tasks. As a plug-and-play method, the proposed UniHead can be conveniently integrated with existing detectors. Extensive experiments on the COCO dataset demonstrate that our UniHead can bring significant improvements to many detectors. For instance, the UniHead can obtain +2.7 AP gains in RetinaNet, +2.9 AP gains in FreeAnchor, and +2.1 AP gains in GFL. The code is available at https://github.com/zht8506/UniHead.

📄 PDF Abstract BibTeX arXiv:2309.13242

Code (1)

zht8506/unihead 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
FPN 설명 없음
Focal Loss A Focal Loss function addresses class imbalance during training in tasks like object detection. Focal loss applies a modulating term to the cross entropy loss in order to…
RetinaNet RetinaNet is a one-stage object detection model that utilizes a focal loss function to address class imbalance during training.…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Unifying Visual Perception by Dispersible Points Learning

2022-08-18 · Jianming Liang, Guanglu Song, Biao Leng, Yu Liu

We present a conceptually simple, flexible, and universal visual perception head for variant visual tasks, e.g., classification, object detection, instance segmentation and pose estimation, and different frameworks, such…

Instance SegmentationObjectobject-detectionObject Detection+3

Dynamic Head: Unifying Object Detection Heads with Attentions

2021-06-15 · CVPR 2021 1 · Xiyang Dai, Yinpeng Chen, Bin Xiao, Dongdong Chen 외

The complex nature of combining localization and classification in object detection has resulted in the flourished development of methods. Previous works tried to improve the performance in various object detection heads…

Objectobject-detectionObject Detection

HEAD: A Bandwidth-Efficient Cooperative Perception Approach for Heterogeneous Connected and Autonomous Vehicles

2024-08-27 · Deyuan Qu, Qi Chen, Yongqi Zhu, Yihao Zhu 외

In cooperative perception studies, there is often a trade-off between communication bandwidth and perception performance. While current feature fusion solutions are known for their excellent object detection performance,…

3D Object DetectionAutonomous Vehiclesobject-detectionObject Detection+1

LiDAR-BEVMTN: Real-Time LiDAR Bird's-Eye View Multi-Task Perception Network for Autonomous Driving

2023-07-17 · Sambit Mohapatra, Senthil Yogamani, Varun Ravi Kumar, Stefan Milz 외

LiDAR is crucial for robust 3D scene perception in autonomous driving. LiDAR perception has the largest body of literature after camera perception. However, multi-task learning across tasks like detection, segmentation, …

3D Object DetectionAutonomous DrivingMotion EstimationMotion Segmentation+6

LidarMultiNet: Towards a Unified Multi-Task Network for LiDAR Perception

2022-09-19 · Dongqiangzi Ye, Zixiang Zhou, Weijia Chen, Yufei Xie 외

LiDAR-based 3D object detection, semantic segmentation, and panoptic segmentation are usually implemented in specialized networks with distinctive architectures that are difficult to adapt to each other. This paper prese…

3D Object Detection3D Semantic Segmentationobject-detectionObject Detection+3