paper-with-me

홈 › Papers

Gradient Harmonized Single-stage Detector

2018-11-13 · Buyu Li, Yu Liu, Xiaogang Wang

Despite the great success of two-stage detectors, single-stage detector is still a more elegant and efficient way, yet suffers from the two well-known disharmonies during training, i.e. the huge difference in quantity between positive and negative examples as well as between easy and hard examples. In this work, we first point out that the essential effect of the two disharmonies can be summarized in term of the gradient. Further, we propose a novel gradient harmonizing mechanism (GHM) to be a hedging for the disharmonies. The philosophy behind GHM can be easily embedded into both classification loss function like cross-entropy (CE) and regression loss function like smooth-$L_1$ ($SL_1$) loss. To this end, two novel loss functions called GHM-C and GHM-R are designed to balancing the gradient flow for anchor classification and bounding box refinement, respectively. Ablation study on MS COCO demonstrates that without laborious hyper-parameter tuning, both GHM-C and GHM-R can bring substantial improvement for single-stage detector. Without any whistles and bells, our model achieves 41.6 mAP on COCO test-dev set which surpasses the state-of-the-art method, Focal Loss (FL) + $SL_1$, by 0.8.

📄 PDF Abstract BibTeX arXiv:1811.05181

Code (9)

libuyu/GHM_Detection 공식 구현 pytorch
ForrestPi/GHM_Loss tf
GXYM/GHM_Loss tf
JennyVanessa/Paddle-GHM paddle
open-mmlab/mmdetection pytorch
peteryuX/tensorflow-GHM-loss tf
thisisi3/Paddle-GHM paddle
tsdlrh/GHM_paddle paddle
xialuxi/GHMLoss-caffe

Tasks

General ClassificationObject DetectionPhilosophy

Methods 이 논문이 사용한 방법론

GHM-R GHM-R is a loss function designed to balance the gradient flow for bounding box refinement. The GHM first performs statistics on the number of examples with similar attributes…
GHM-C GHM-C is a loss function designed to balance the gradient flow for anchor classification. The GHM first performs statistics on the number of examples with similar attributes…
Average Pooling 설명 없음
ResNeXt Block A ResNeXt Block is a type of residual block used as part of the ResNeXt CNN…
Grouped Convolution A Grouped Convolution uses a group of convolutions - multiple kernels per layer - resulting in multiple channel outputs per layer. This leads to wider networks helping a…
Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…

Similar Papers 제목 키워드 기반

IoU-balanced Loss Functions for Single-stage Object Detection

2019-08-15 · Shengkai Wu, Jinrong Yang, Xinggang Wang, Xiaoping Li

Single-stage object detectors have been widely applied in computer vision applications due to their high efficiency. However, we find that the loss functions adopted by single-stage object detectors hurt the localization…

ClassificationGeneral ClassificationObjectobject-detection+1

Learning Harmonized Representations for Speculative Sampling

2024-08-28 · Lefan Zhang, Xiaodan Wang, Yanhua Huang, Ruiwen Xu

Speculative sampling is a promising approach to accelerate the decoding stage for Large Language Models (LLMs). Recent advancements that leverage target LLM's contextual information, such as hidden states and KV cache, h…

S4OD: Semi-Supervised learning for Single-Stage Object Detection

2022-04-09 · Yueming Zhang, Xingxu Yao, Chao Liu, Feng Chen 외

Single-stage detectors suffer from extreme foreground-background class imbalance, while two-stage detectors do not. Therefore, in semi-supervised object detection, two-stage detectors can deliver remarkable performance b…

Objectobject-detectionObject Detectionregression+1

GRACE: Gradient Harmonized and Cascaded Labeling for Aspect-based Sentiment Analysis

2020-09-22 · Findings of the Association for Computational Linguistics 2020 · Huaishao Luo, Lei Ji, Tianrui Li, Nan Duan 외

In this paper, we focus on the imbalance issue, which is rarely studied in aspect term extraction and aspect sentiment classification when regarding them as sequence labeling tasks. Besides, previous works usually ignore…

Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)object-detectionObject Detection+3

SS3D: Single Shot 3D Object Detector

2020-04-30 · Aniket Limaye, Manu Mathew, Soyeb Nagori, Pramod Kumar Swami 외

Single stage deep learning algorithm for 2D object detection was made popular by Single Shot MultiBox Detector (SSD) and it was heavily adopted in several embedded applications. PointPillars is a state of the art 3D obje…

2D Object Detection3D Object DetectionObjectobject-detection+2