paper-with-me

Papers

The Box Size Confidence Bias Harms Your Object Detector

2021-12-03 · Johannes Gilg, Torben Teepe, Fabian Herzog, Gerhard Rigoll

Countless applications depend on accurate predictions with reliable confidence estimates from modern object detectors. It is well known, however, that neural networks including object detectors produce miscalibrated confidence estimates. Recent work even suggests that detectors' confidence predictions are biased with respect to object size and position, but it is still unclear how this bias relates to the performance of the affected object detectors. We formally prove that the conditional confidence bias is harming the expected performance of object detectors and empirically validate these findings. Specifically, we demonstrate how to modify the histogram binning calibration to not only avoid performance impairment but also improve performance through conditional confidence calibration. We further find that the confidence bias is also present in detections generated on the training data of the detector, which we leverage to perform our de-biasing without using additional data. Moreover, Test Time Augmentation magnifies this bias, which results in even larger performance gains from our calibration method. Finally, we validate our findings on a diverse set of object detection architectures and show improvements of up to 0.6 mAP and 0.8 mAP50 without extra data or training.

📄 PDF Abstract BibTeX arXiv:2112.01901

Code (1)

blueblue4/object-detection-confidence-bias 공식 구현 pytorch

Tasks

Objectobject-detectionObject Detection

Similar Papers 제목 키워드 기반

COBRA Frames: Contextual Reasoning about Effects and Harms of Offensive Statements

2023-06-03 · Xuhui Zhou, Hao Zhu, Akhila Yerukola, Thomas Davidson 외

Warning: This paper contains content that may be offensive or upsetting. Understanding the harms and offensiveness of statements requires reasoning about the social and situational context in which statements are made. F…

Mind-proofing Your Phone: Navigating the Digital Minefield with GreaseTerminator

2021-12-20 · Siddhartha Datta, Konrad Kollnig, Nigel Shadbolt

Digital harms are widespread in the mobile ecosystem. As these devices gain ever more prominence in our daily lives, so too increases the potential for malicious attacks against individuals. The last line of defense agai…

Choose Your Lenses: Flaws in Gender Bias Evaluation

2022-10-20 · NAACL (GeBNLP) 2022 7 · Hadas Orgad, Yonatan Belinkov

Considerable efforts to measure and mitigate gender bias in recent years have led to the introduction of an abundance of tasks, datasets, and metrics used in this vein. In this position paper, we assess the current parad…

On Measures of Biases and Harms in NLP

2021-08-07 · Sunipa Dev, Emily Sheng, Jieyu Zhao, Aubrie Amstutz 외

Recent studies show that Natural Language Processing (NLP) technologies propagate societal biases about demographic groups associated with attributes such as gender, race, and nationality. To create interventions and mit…

Entropy is not Enough for Test-Time Adaptation: From the Perspective of Disentangled Factors

2024-03-12 · Jonghyun Lee, Dahuin Jung, Saehyung Lee, Junsung Park 외

Test-time adaptation (TTA) fine-tunes pre-trained deep neural networks for unseen test data. The primary challenge of TTA is limited access to the entire test dataset during online updates, causing error accumulation. To…

ObjectPseudo LabelTest-time Adaptation