paper-with-me

Papers

Multiclass Confidence and Localization Calibration for Object Detection

2023-06-14 · CVPR 2023 1 · Bimsara Pathiraja, Malitha Gunawardhana, Muhammad Haris Khan

Albeit achieving high predictive accuracy across many challenging computer vision problems, recent studies suggest that deep neural networks (DNNs) tend to make overconfident predictions, rendering them poorly calibrated. Most of the existing attempts for improving DNN calibration are limited to classification tasks and restricted to calibrating in-domain predictions. Surprisingly, very little to no attempts have been made in studying the calibration of object detection methods, which occupy a pivotal space in vision-based security-sensitive, and safety-critical applications. In this paper, we propose a new train-time technique for calibrating modern object detection methods. It is capable of jointly calibrating multiclass confidence and box localization by leveraging their predictive uncertainties. We perform extensive experiments on several in-domain and out-of-domain detection benchmarks. Results demonstrate that our proposed train-time calibration method consistently outperforms several baselines in reducing calibration error for both in-domain and out-of-domain predictions. Our code and models are available at https://github.com/bimsarapathiraja/MCCL.

📄 PDF Abstract BibTeX arXiv:2306.08271

Code (2)

bimsarapathiraja/mccl 공식 구현 pytorch
ravindu-yasas-nagasinghe/kepp pytorch

Tasks

Objectobject-detectionObject Detection

Similar Papers 제목 키워드 기반

Top-label calibration and multiclass-to-binary reductions

2021-07-18 · ICLR 2022 4 · Chirag Gupta, Aaditya Ramdas

A multiclass classifier is said to be top-label calibrated if the reported probability for the predicted class -- the top-label -- is calibrated, conditioned on the top-label. This conditioning on the top-label is absent…

Decision Making

Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibration

2019-10-28 · Meelis Kull, Miquel Perello-Nieto, Markus Kängsepp, Telmo Silva Filho 외

Class probabilities predicted by most multiclass classifiers are uncalibrated, often tending towards over-confidence. With neural networks, calibration can be improved by temperature scaling, a method to learn a single c…

Binary Classification

Scalable Utility-Aware Multiclass Calibration

2025-10-29 · Mahmoud Hegazy, Michael I. Jordan, Aymeric Dieuleveut arxiv

Ensuring that classifiers are well-calibrated, i.e., their predictions align with observed frequencies, is a minimal and fundamental requirement for classifiers to be viewed as trustworthy. Existing methods for assessing…

Confidence Calibration for Object Detection and Segmentation

2022-02-25 · Fabian Küppers, Anselm Haselhoff, Jan Kronenberger, Jonas Schneider

Calibrated confidence estimates obtained from neural networks are crucial, particularly for safety-critical applications such as autonomous driving or medical image diagnosis. However, although the task of confidence cal…

Autonomous DrivingInstance SegmentationObjectobject-detection+3

Localization-Guided Track: A Deep Association Multi-Object Tracking Framework Based on Localization Confidence of Detections

2023-09-18 · Ting Meng, Chunyun Fu, Mingguang Huang, Xiyang Wang 외

In currently available literature, no tracking-by-detection (TBD) paradigm-based tracking method has considered the localization confidence of detection boxes. In most TBD-based methods, it is considered that objects of …

Multi-Object TrackingObject Tracking