Parallel Residual Bi-Fusion Feature Pyramid Network for Accurate Single-Shot Object Detection
This paper proposes the Parallel Residual Bi-Fusion Feature Pyramid Network (PRB-FPN) for fast and accurate single-shot object detection. Feature Pyramid (FP) is widely used in recent visual detection, however the top-down pathway of FP cannot preserve accurate localization due to pooling shifting. The advantage of FP is weakened as deeper backbones with more layers are used. In addition, it cannot keep up accurate detection of both small and large objects at the same time. To address these issues, we propose a new parallel FP structure with bi-directional (top-down and bottom-up) fusion and associated improvements to retain high-quality features for accurate localization. We provide the following design improvements: (1) A parallel bifusion FP structure with a bottom-up fusion module (BFM) to detect both small and large objects at once with high accuracy. (2) A concatenation and re-organization (CORE) module provides a bottom-up pathway for feature fusion, which leads to the bi-directional fusion FP that can recover lost information from lower-layer feature maps. (3) The CORE feature is further purified to retain richer contextual information. Such CORE purification in both top-down and bottom-up pathways can be finished in only a few iterations. (4) The adding of a residual design to CORE leads to a new Re-CORE module that enables easy training and integration with a wide range of deeper or lighter backbones. The proposed network achieves state-of-the-art performance on the UAVDT17 and MS COCO datasets. Code is available at https://github.com/pingyang1117/PRBNet_PyTorch.
Code (1)
Tasks
Multi-Object Trackingobject-detectionObject DetectionReal-Time Object DetectionSimilar Papers 제목 키워드 기반
FF-PNet: A Pyramid Network Based on Feature and Field for Brain Image Registration
In recent years, deformable medical image registration techniques have made significant progress. However, existing models still lack efficiency in parallel extraction of coarse and fine-grained features. To address this…
Deformable Medical Image RegistrationImage RegistrationMedical Image RegistrationResidual Bi-Fusion Feature Pyramid Network for Accurate Single-shot Object Detection
State-of-the-art (SoTA) models have improved the accuracy of object detection with a large margin via a FP (feature pyramid). FP is a top-down aggregation to collect semantically strong features to improve scale invarian…
Objectobject-detectionObject DetectionStructure-Aware Residual Pyramid Network for Monocular Depth Estimation
Monocular depth estimation is an essential task for scene understanding. The underlying structure of objects and stuff in a complex scene is critical to recovering accurate and visually-pleasing depth maps. Global struct…
DecoderDepth EstimationDepth PredictionMonocular Depth Estimation+1$P^2$ Net: Augmented Parallel-Pyramid Net for Attention Guided Pose Estimation
We propose an augmented Parallel-Pyramid Net ($P^2~Net$) with feature refinement by dilated bottleneck and attention module. During data preprocessing, we proposed a differentiable auto data augmentation ($DA^2$) method.…
Data AugmentationPose EstimationAugFPN: Improving Multi-scale Feature Learning for Object Detection
Current state-of-the-art detectors typically exploit feature pyramid to detect objects at different scales. Among them, FPN is one of the representative works that build a feature pyramid by multi-scale features summatio…
Objectobject-detectionObject Detection