Hierarchical Conformal Classification

2025-08-18 · Floris den Hengst, Inès Blin, Majid Mohammadi, Syed Ihtesham Hussain Shah, Taraneh Younesian arxiv

Conformal prediction (CP) is a powerful framework for quantifying uncertainty in machine learning models, offering reliable predictions with finite-sample coverage guarantees. When applied to classification, CP produces a prediction set of possible labels that is guaranteed to contain the true label with high probability, regardless of the underlying classifier. However, standard CP treats classes as flat and unstructured, ignoring domain knowledge such as semantic relationships or hierarchical structure among class labels. This paper presents hierarchical conformal classification (HCC), an extension of CP that incorporates class hierarchies into both the structure and semantics of prediction sets. We formulate HCC as a constrained optimization problem whose solutions yield prediction sets composed of nodes at different levels of the hierarchy, while maintaining coverage guarantees. To address the combinatorial nature of the problem, we formally show that a much smaller, well-structured subset of candidate solutions suffices to ensure coverage while upholding optimality. An empirical evaluation on three new benchmarks consisting of audio, image, and text data highlights the advantages of our approach, and a user study shows that annotators significantly prefer hierarchical over flat prediction sets.

📄 PDF Abstract BibTeX arXiv:2508.13288

Code (0)

등록된 구현이 없습니다.

Conformal Prediction in Hierarchical Classification

2025-01-31 · Thomas Mortier, Alireza Javanmardi, Yusuf Sale, Eyke Hüllermeier 외

Conformal prediction has emerged as a widely used framework for constructing valid prediction sets in classification and regression tasks. In this work, we extend the split conformal prediction framework to hierarchical …

Classification Conformal Prediction Prediction valid

Conformal Structured Prediction

2024-10-08 · Botong Zhang, Shuo Li, Osbert Bastani

Conformal prediction has recently emerged as a promising strategy for quantifying the uncertainty of a predictive model; these algorithms modify the model to output sets of labels that are guaranteed to contain the true …

Conformal Prediction image-classification Image Classification Prediction+2

Conformal Prediction for Hierarchical Data

2024-11-20 · Guillaume Principato, Gilles Stoltz, Yvenn Amara-Ouali, Yannig Goude 외

We consider conformal prediction of multivariate data series, which consists of outputting prediction regions based on empirical quantiles of point-estimate errors. We actually consider hierarchical multivariate data ser…

Conformal Prediction Prediction Time Series

conformalClassification: A Conformal Prediction R Package for Classification

2018-04-16 · Niharika Gauraha, Ola Spjuth

The conformalClassification package implements Transductive Conformal Prediction (TCP) and Inductive Conformal Prediction (ICP) for classification problems. Conformal Prediction (CP) is a framework that complements the p…

BIG-bench Machine Learning Classification Conformal Prediction Diagnostic+2

Multi-level conformal clustering: A distribution-free technique for clustering and anomaly detection

2019-10-17 · Ilia Nouretdinov, James Gammerman, Matteo Fontana, Daljit Rehal

In this work we present a clustering technique called \textit{multi-level conformal clustering (MLCC)}. The technique is hierarchical in nature because it can be performed at multiple significance levels which yields gre…

Anomaly Detection Clustering Conformal Prediction