Reconcile Prediction Consistency for Balanced Object Detection
Classification and regression are two pillars of object detectors. In most CNN-based detectors, these two pillars are optimized independently. Without direct interactions between them, the classification loss and the regression loss can not be optimized synchronously toward the optimal direction in the training phase. This clearly leads to lots of inconsistent predictions with high classification score but low localization accuracy or low classification score but high localization accuracy in the inference phase, especially for the objects of irregular shape and occlusion, which severely hurts the detection performance of existing detectors after NMS. To reconcile prediction consistency for balanced object detection, we propose a Harmonic loss to harmonize the optimization of classification branch and localization branch. The Harmonic loss enables these two branches to supervise and promote each other during training, thereby producing consistent predictions with high co-occurrence of top classification and localization in the inference phase. Furthermore, in order to prevent the localization loss from being dominated by outliers during training phase, a Harmonic IoU loss is proposed to harmonize the weight of the localization loss of different IoU-level samples. Comprehensive experiments on benchmarks PASCAL VOC and MS COCO demonstrate the generality and effectiveness of our model for facilitating existing object detectors to state-of-the-art accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationObjectobject-detectionObject DetectionPredictionregressionSimilar Papers 제목 키워드 기반
FedPylot: Navigating Federated Learning for Real-Time Object Detection in Internet of Vehicles
The Internet of Vehicles (IoV) emerges as a pivotal component for autonomous driving and intelligent transportation systems (ITS), by enabling low-latency big data processing in a dense interconnected network that compri…
Autonomous DrivingAutonomous VehiclesFederated LearningObject Detection+1Decoupled Sensitivity-Consistency Learning for Weakly Supervised Video Anomaly Detection
Recent weakly supervised video anomaly detection methods have achieved significant advances by employing unified frameworks for joint optimization. However, this paradigm is limited by a fundamental sensitivity-stability…
Video Anomaly DetectionCT Scans As Video: Efficient Intracranial Hemorrhage Detection Using Multi-Object Tracking
Automated analysis of volumetric medical imaging on edge devices is severely constrained by the high memory and computational demands of 3D Convolutional Neural Networks (CNNs). This paper develops a lightweight computer…
Multi-Object TrackingTest-Time Intensity Consistency Adaptation for Shadow Detection
Shadow detection is crucial for accurate scene understanding in computer vision, yet it is challenged by the diverse appearances of shadows caused by variations in illumination, object geometry, and scene context. Deep l…
DecoderDiversityScene UnderstandingShadow Detection+1Reconciling Object-Level and Global-Level Objectives for Long-Tail Detection
Large vocabulary object detectors are often faced with the long-tailed label distributions, seriously degrading their ability to detect rarely seen categories. On one hand, the rare objects are prone to be misclassif…
Multi-Task LearningObject