Conf-Gen: Conformal Uncertainty Quantification for Generative Models
Conformal prediction (CP) and its extension, conformal risk control (CRC), are established frameworks for quantifying uncertainty in supervised machine learning through formal guarantees. However, recent breakthroughs in artificial intelligence (AI) have been driven by unsupervised generative models, such as large language models (LLMs) and image generators, which are not directly compatible with CP or CRC. In this work we introduce conformal generation (Conf-Gen), a general framework adapting CRC to generative tasks while relaxing its theoretical assumptions. Conf-Gen unifies and generalizes previous attempts to apply CP to LLMs, and extends conformal methodology to entirely new domains. We demonstrate the flexibility of Conf-Gen through some novel applications, including obtaining conformal guarantees on: image generators producing non-memorized images, conversational AI systems having asked enough clarifying questions, and the output of AI agents being correct.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Statistical Guarantees in Synthetic Data through Conformal Adversarial Generation
The generation of high-quality synthetic data presents significant challenges in machine learning research, particularly regarding statistical fidelity and uncertainty quantification. Existing generative models produce c…
Conformal PredictionMathematical ProofsPredictionUncertainty QuantificationConformalized-DeepONet: A Distribution-Free Framework for Uncertainty Quantification in Deep Operator Networks
In this paper, we adopt conformal prediction, a distribution-free uncertainty quantification (UQ) framework, to obtain confidence prediction intervals with coverage guarantees for Deep Operator Network (DeepONet) regress…
Conformal PredictionPredictionPrediction Intervalsregression+1Conformalized Generative Bayesian Imaging: An Uncertainty Quantification Framework for Computational Imaging
Uncertainty quantification plays an important role in achieving trustworthy and reliable learning-based computational imaging. Recent advances in generative modeling and Bayesian neural networks have enabled the developm…
Conformal PredictionImage InpaintingImage ReconstructionUncertainty QuantificationGenerative Conformal Prediction with Vectorized Non-Conformity Scores
Conformal prediction (CP) provides model-agnostic uncertainty quantification with guaranteed coverage, but conventional methods often produce overly conservative uncertainty sets, especially in multi-dimensional settings…
Autonomous DrivingConformal PredictionDecision MakingMedical Diagnosis+3Federated Conformal Predictors for Distributed Uncertainty Quantification
Conformal prediction is emerging as a popular paradigm for providing rigorous uncertainty quantification in machine learning since it can be easily applied as a post-processing step to already trained models. In this pap…
Conformal PredictionFederated LearningPredictionUncertainty Quantification