paper-with-me

홈 › Papers

Divide et Calibra: Multiclass Local Calibration via Vector Quantization

2026-05-20 · Cesare Barbera, Lorenzo Perini, Giovanni De Toni, Andrea Passerini, Andrea Pugnana arxiv

Accurate and well-calibrated Machine Learning (ML) models are mandatory in high-stakes settings, yet effective multiclass calibration remains challenging: global approaches assume calibration errors are homogeneous across the latent space, while local methods often rely on latent-space dimensionality reduction, which leads to information loss. To address these issues, we propose a compositional approach to multiclass calibration, where region-specific calibration maps are constructed from shared codeword-dependent factors. We instantiate this idea via Vector Quantization (VQ), which induces a structured partition of the representation space, and an indexed parameterization of Dirichlet concentrations that enables parameter sharing across regions. Our approach learns heterogeneous calibration maps that generalize well even to sparse regions of the latent space. Experiments on benchmark datasets show significant improvements in local calibration while maintaining competitive global calibration and predictive performance.

📄 PDF Abstract BibTeX arXiv:2605.21060

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality Reduction

Similar Papers 제목 키워드 기반

Multiclass Local Calibration with the Jensen-Shannon Distance

2025-10-30 · Cesare Barbera, Lorenzo Perini, Giovanni De Toni, Andrea Passerini 외 arxiv

Developing trustworthy Machine Learning (ML) models requires their predicted probabilities to be well-calibrated, meaning they should reflect true-class frequencies. Among calibration notions in multiclass classification…

Top-label calibration and multiclass-to-binary reductions

2021-07-18 · ICLR 2022 4 · Chirag Gupta, Aaditya Ramdas

A multiclass classifier is said to be top-label calibrated if the reported probability for the predicted class -- the top-label -- is calibrated, conditioned on the top-label. This conditioning on the top-label is absent…

Decision Making

Multiclass Confidence and Localization Calibration for Object Detection

2023-06-14 · CVPR 2023 1 · Bimsara Pathiraja, Malitha Gunawardhana, Muhammad Haris Khan

Albeit achieving high predictive accuracy across many challenging computer vision problems, recent studies suggest that deep neural networks (DNNs) tend to make overconfident predictions, rendering them poorly calibrated…

Objectobject-detectionObject Detection

Convex Calibration Dimension for Multiclass Loss Matrices

2014-08-12 · Harish G. Ramaswamy, Shivani Agarwal

We study consistency properties of surrogate loss functions for general multiclass learning problems, defined by a general multiclass loss matrix. We extend the notion of classification calibration, which has been studie…

General Classification

Scalable Utility-Aware Multiclass Calibration

2025-10-29 · Mahmoud Hegazy, Michael I. Jordan, Aymeric Dieuleveut arxiv

Ensuring that classifiers are well-calibrated, i.e., their predictions align with observed frequencies, is a minimal and fundamental requirement for classifiers to be viewed as trustworthy. Existing methods for assessing…