paper-with-me

Papers

Multi-level conformal clustering: A distribution-free technique for clustering and anomaly detection

2019-10-17 · Ilia Nouretdinov, James Gammerman, Matteo Fontana, Daljit Rehal

In this work we present a clustering technique called \textit{multi-level conformal clustering (MLCC)}. The technique is hierarchical in nature because it can be performed at multiple significance levels which yields greater insight into the data than performing it at just one level. We describe the theoretical underpinnings of MLCC, compare and contrast it with the hierarchical clustering algorithm, and then apply it to real world datasets to assess its performance. There are several advantages to using MLCC over more classical clustering techniques: Once a significance level has been set, MLCC is able to automatically select the number of clusters. Furthermore, thanks to the conformal prediction framework the resulting clustering model has a clear statistical meaning without any assumptions about the distribution of the data. This statistical robustness also allows us to perform clustering and anomaly detection simultaneously. Moreover, due to the flexibility of the conformal prediction framework, our algorithm can be used on top of many other machine learning algorithms.

📄 PDF Abstract BibTeX arXiv:1910.08105

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionClusteringConformal Prediction

Similar Papers 제목 키워드 기반

Distribution-free Conformal Prediction for Ordinal Classification

2024-04-25 · Subhrasish Chakraborty, Chhavi Tyagi, Haiyan Qiao, Wenge Guo

Conformal prediction is a general distribution-free approach for constructing prediction sets combined with any machine learning algorithm that achieve valid marginal or conditional coverage in finite samples. Ordinal cl…

ClassificationConformal PredictionOrdinal ClassificationPrediction+1

Weighted Conformal Clustering

2026-05-29 · Anirban Nath, YoonHaeng Hur, Genevera I. Allen arxiv

Clustering is a central tool for discovering latent structure in unlabeled data; yet modern clustering pipelines often end with a hard assignment of each observation to a cluster without rigorous measures of assignment u…

Distribution-Free Uncertainty Quantification for Continuous AI Agent Evaluation

2026-05-19 · Yuxuan Gao, Megan Wang, Yi Ling Yu arxiv

We adapt split conformal prediction and adaptive conformal inference (ACI) to continuous AI agent evaluation, providing distribution-free coverage guarantees for forecasted quality scores. Conformal intervals achieve cal…

Probabilistic Conformal Coverage Guarantees in Small-Data Settings

2025-09-18 · Petrus H. Zwart arxiv

Conformal prediction provides distribution-free prediction sets with guaranteed marginal coverage. However, in split conformal prediction this guarantee is training-conditional only in expectation: across many calibratio…

Flow-Based Conformal Predictive Distributions

2026-02-07 · Trevor Harris arxiv

Conformal prediction provides a distribution-free framework for uncertainty quantification via prediction sets with exact finite-sample coverage. In low dimensions these sets are easy to interpret, but in high-dimensiona…

Trajectory Forecasting