paper-with-me

홈 › Papers

Calibrated neighborhood aware confidence measure for deep metric learning

2020-06-08 · Maryna Karpusha, Sunghee Yun, Istvan Fehervari

Deep metric learning has gained promising improvement in recent years following the success of deep learning. It has been successfully applied to problems in few-shot learning, image retrieval, and open-set classifications. However, measuring the confidence of a deep metric learning model and identifying unreliable predictions is still an open challenge. This paper focuses on defining a calibrated and interpretable confidence metric that closely reflects its classification accuracy. While performing similarity comparison directly in the latent space using the learned distance metric, our approach approximates the distribution of data points for each class using a Gaussian kernel smoothing function. The post-processing calibration algorithm with proposed confidence metric on the held-out validation dataset improves generalization and robustness of state-of-the-art deep metric learning models while provides an interpretable estimation of the confidence. Extensive tests on four popular benchmark datasets (Caltech-UCSD Birds, Stanford Online Product, Stanford Car-196, and In-shop Clothes Retrieval) show consistent improvements even at the presence of distribution shifts in test data related to additional noise or adversarial examples.

📄 PDF Abstract BibTeX arXiv:2006.04935

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot LearningImage RetrievalMetric LearningRetrieval

Similar Papers 제목 키워드 기반

Uncertainty-Aware Deep Calibrated Salient Object Detection

2020-12-10 · Jing Zhang, Yuchao Dai, Xin Yu, Mehrtash Harandi 외

Existing deep neural network based salient object detection (SOD) methods mainly focus on pursuing high network accuracy. However, those methods overlook the gap between network accuracy and prediction confidence, known …

Objectobject-detectionObject DetectionSalient Object Detection

DOMINO: Domain-aware Model Calibration in Medical Image Segmentation

2022-09-13 · Skylar E. Stolte, Kyle Volle, Aprinda Indahlastari, Alejandro Albizu 외

Model calibration measures the agreement between the predicted probability estimates and the true correctness likelihood. Proper model calibration is vital for high-risk applications. Unfortunately, modern deep neural ne…

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Overconfidence in LLM-as-a-Judge: Diagnosis and Confidence-Driven Solution

2025-08-08 · Zailong Tian, Zhuoheng Han, Yanzhe Chen, Haozhe Xu 외 arxiv

Large Language Models (LLMs) are widely used as automated judges, where practical value depends on both accuracy and trustworthy, risk-aware judgments. Existing approaches predominantly focus on accuracy, overlooking the…

Inlier Confidence Calibration for Point Cloud Registration

2024-01-01 · CVPR 2024 1 · Yongzhe Yuan, Yue Wu, Xiaolong Fan, Maoguo Gong 외

Inliers estimation constitutes a pivotal step in partially overlapping point cloud registration. Existing methods broadly obey coordinate-based scheme where inlier confidence is scored through simply capturing coordi…

Point Cloud Registration

Beyond ECE: Calibrated Size Ratio, Risk Assessment, and Confidence-Weighted Metrics

2026-05-03 · Fernando Martin-Maroto, Nabil Abderrahaman, Gonzalo G. de Polavieja arxiv

Confidence calibration has been dominated by the Expected Calibration Error (ECE), a linear metric that counts calibration offset equally regardless of the confidence level at which it occurs. We show that ECE can remain…