Papers Conformal Prediction
“Conformal Prediction” 태그가 달린 논문 704편 · 필터 해제
Foundation models for time series forecasting: Application in conformal prediction
The zero-shot capabilities of foundation models (FMs) for time series forecasting offer promising potentials in conformal prediction, as most of the available data can be allocated to calibration. This study compares the…
Conformal PredictionPredictionPrediction IntervalsTime Series+1The Trilemma of Truth in Large Language Models
We often attribute human characteristics to large language models (LLMs) and claim that they "know" certain things. LLMs have an internal probabilistic knowledge that represents information retained during training. How …
AttributeConformal PredictionKnowledge DistillationMultiple Instance Learning+1Deterministic Object Pose Confidence Region Estimation
6D pose confidence region estimation has emerged as a critical direction, aiming to perform uncertainty quantification for assessing the reliability of estimated poses. However, current sampling-based approach suffers fr…
Conformal PredictionObjectPose EstimationUncertainty QuantificationResponse Quality Assessment for Retrieval-Augmented Generation via Conditional Conformal Factuality
Existing research on Retrieval-Augmented Generation (RAG) primarily focuses on improving overall question-answering accuracy, often overlooking the quality of sub-claims within generated responses. Recent methods that at…
Conformal PredictionQuestion AnsweringRAGRetrieval+1Graph-Structured Feedback Multimodel Ensemble Online Conformal Prediction
Online conformal prediction has demonstrated its capability to construct a prediction set for each incoming data point that covers the true label with a predetermined probability. To cope with potential distribution shif…
Conformal PredictionPredictionValid Selection among Conformal Sets
Conformal prediction offers a distribution-free framework for constructing prediction sets with coverage guarantees. In practice, multiple valid conformal prediction sets may be available, arising from different models o…
Conformal PredictionPredictionvalidCOIN: Uncertainty-Guarding Selective Question Answering for Foundation Models with Provable Risk Guarantees
Uncertainty quantification (UQ) for foundation models is essential to identify and mitigate potential hallucinations in automatically generated text. However, heuristic UQ approaches lack formal guarantees for key metric…
Conformal PredictionQuestion AnsweringText GenerationUncertainty QuantificationWhen Can We Reuse a Calibration Set for Multiple Conformal Predictions?
Reliable uncertainty quantification is crucial for the trustworthiness of machine learning applications. Inductive Conformal Prediction (ICP) offers a distribution-free framework for generating prediction sets or interva…
Conformal PredictionPredictionUncertainty QuantificationOne Sample is Enough to Make Conformal Prediction Robust
Given any model, conformal prediction (CP) returns prediction sets guaranteed to include the true label with high adjustable probability. Robust CP (RCP) extends this to inputs with worst-case noise. A well-established a…
Conformal PredictionPredictionCertDW: Towards Certified Dataset Ownership Verification via Conformal Prediction
Deep neural networks (DNNs) rely heavily on high-quality open-source datasets (e.g., ImageNet) for their success, making dataset ownership verification (DOV) crucial for protecting public dataset copyrights. In this pape…
Conformal PredictionCalibrated Predictive Lower Bounds on Time-to-Unsafe-Sampling in LLMs
We develop a framework to quantify the time-to-unsafe-sampling - the number of large language model (LLM) generations required to trigger an unsafe (e.g., toxic) response. Estimating this quantity is challenging, since u…
Conformal PredictionLarge Language ModelSurvival AnalysisMARCO: Hardware-Aware Neural Architecture Search for Edge Devices with Multi-Agent Reinforcement Learning and Conformal Prediction Filtering
This paper introduces MARCO (Multi-Agent Reinforcement learning with Conformal Optimization), a novel hardware-aware framework for efficient neural architecture search (NAS) targeting resource-constrained edge devices. B…
Conformal PredictionHardware Aware Neural Architecture SearchMulti-agent Reinforcement LearningNeural Architecture SearchA Fast, Reliable, and Secure Programming Language for LLM Agents with Code Actions
Modern large language models (LLMs) are often deployed as agents, calling external tools adaptively to solve tasks. Rather than directly calling tools, it can be more effective for LLMs to write code to perform the tool …
Conformal PredictionQuestion AnsweringUncertainty QuantificationVisual Question AnsweringConformal Safety Shielding for Imperfect-Perception Agents
We consider the problem of safe control in discrete autonomous agents that use learned components for imperfect perception (or more generally, state estimation) from high-dimensional observations. We propose a shield con…
Conformal PredictionState EstimationSAFE: Multitask Failure Detection for Vision-Language-Action Models
While vision-language-action models (VLAs) have shown promising robotic behaviors across a diverse set of manipulation tasks, they achieve limited success rates when deployed on novel tasks out-of-the-box. To allow these…
Conformal PredictionVision-Language-ActionModel-Free Kernel Conformal Depth Measures Algorithm for Uncertainty Quantification in Regression Models in Separable Hilbert Spaces
Depth measures are powerful tools for defining level sets in emerging, non--standard, and complex random objects such as high-dimensional multivariate data, functional data, and random graphs. Despite their favorable the…
Conformal PredictionPredictionUncertainty QuantificationEnhancing Adversarial Robustness with Conformal Prediction: A Framework for Guaranteed Model Reliability
As deep learning models are increasingly deployed in high-risk applications, robust defenses against adversarial attacks and reliable performance guarantees become paramount. Moreover, accuracy alone does not provide suf…
Adversarial AttackAdversarial RobustnessConformal PredictionPredictionStatistical Guarantees in Data-Driven Nonlinear Control: Conformal Robustness for Stability and Safety
We present a true-dynamics-agnostic, statistically rigorous framework for establishing exponential stability and safety guarantees of closed-loop, data-driven nonlinear control. Central to our approach is the novel conce…
Conformal PredictionPredictionEfficient Robust Conformal Prediction via Lipschitz-Bounded Networks
Conformal Prediction (CP) has proven to be an effective post-hoc method for improving the trustworthiness of neural networks by providing prediction sets with finite-sample guarantees. However, under adversarial attacks,…
Adversarial AttackComputational EfficiencyConformal PredictionPredictionConformal coronary calcification volume estimation with conditional coverage via histogram clustering
Incidental detection and quantification of coronary calcium in CT scans could lead to the early introduction of lifesaving clinical interventions. However, over-reporting could negatively affect patient wellbeing and unn…
Conformal PredictionPrediction