paper-with-me

Papers

Deep Dive Into Gradients: Better Optimization for 3D Object Detection With Gradient-Corrected IoU Supervision

2023-01-01 · CVPR 2023 1 · Qi Ming, Lingjuan Miao, Zhe Ma, Lin Zhao, Zhiqiang Zhou, Xuhui Huang, Yuanpei Chen, Yufei Guo

Intersection-over-Union (IoU) is the most popular metric to evaluate regression performance in 3D object detection. Recently, there are also some methods applying IoU to the optimization of 3D bounding box regression. However, we demonstrate through experiments and mathematical proof that the 3D IoU loss suffers from abnormal gradient w.r.t. angular error and object scale, which further leads to slow convergence and suboptimal regression process, respectively. In this paper, we propose a Gradient-Corrected IoU (GCIoU) loss to achieve fast and accurate 3D bounding box regression. Specifically, a gradient correction strategy is designed to endow 3D IoU loss with a reasonable gradient. It ensures that the model converges quickly in the early stage of training, and helps to achieve fine-grained refinement of bounding boxes in the later stage. To solve suboptimal regression of 3D IoU loss for objects at different scales, we introduce a gradient rescaling strategy to adaptively optimize the step size. Finally, we integrate GCIoU Loss into multiple models to achieve stable performance gains and faster model convergence. Experiments on KITTI dataset demonstrate superiority of the proposed method. The code is available at https://github.com/ming71/GCIoU-loss.

📄 PDF Abstract BibTeX

Code (1)

ming71/gciou-loss 공식 구현 pytorch

Tasks

3D Object Detectionobject-detectionObject Detectionregression

Similar Papers 제목 키워드 기반

Diversity-Aware Reverse Kullback-Leibler Divergence for Large Language Model Distillation

2026-03-31 · Hoang-Chau Luong, Dat Ba Tran, Lingwei Chen arxiv

Reverse Kullback-Leibler (RKL) divergence has recently emerged as the preferred objective for large language model (LLM) distillation, consistently outperforming forward KL (FKL), particularly in regimes with large vocab…

$f$-Policy Gradients: A General Framework for Goal Conditioned RL using $f$-Divergences

2023-10-10 · Siddhant Agarwal, Ishan Durugkar, Peter Stone, Amy Zhang

Goal-Conditioned Reinforcement Learning (RL) problems often have access to sparse rewards where the agent receives a reward signal only when it has achieved the goal, making policy optimization a difficult problem. Sever…

Efficient ExplorationPolicy Gradient MethodsReinforcement Learning (RL)

f-Policy Gradients: A General Framework for Goal-Conditioned RL using f-Divergences

2023-09-21 · NeurIPS 2023 11

Goal-Conditioned Reinforcement Learning (RL) problems often have access to sparse rewards where the agent receives a reward signal only when it has achieved the goal, making policy optimization a difficult problem. Sev…

Dual Student Networks for Data-Free Model Stealing

2023-09-18 · James Beetham, Navid Kardan, Ajmal Mian, Mubarak Shah

Existing data-free model stealing methods use a generator to produce samples in order to train a student model to match the target model outputs. To this end, the two main challenges are estimating gradients of the targe…

model

Nonlinear Kalman Filtering with Reparametrization Gradients

2023-03-08 · San Gultekin, Brendan Kitts, Aaron Flores, John Paisley

We introduce a novel nonlinear Kalman filter that utilizes reparametrization gradients. The widely used parametric approximation is based on a jointly Gaussian assumption of the state-space model, which is in turn equiva…