Predicate-Conditional Conformalized Answer Sets for Knowledge Graph Embeddings
Uncertainty quantification in Knowledge Graph Embedding (KGE) methods is crucial for ensuring the reliability of downstream applications. A recent work applies conformal prediction to KGE methods, providing uncertainty estimates by generating a set of answers that is guaranteed to include the true answer with a predefined confidence level. However, existing methods provide probabilistic guarantees averaged over a reference set of queries and answers (marginal coverage guarantee). In high-stakes applications such as medical diagnosis, a stronger guarantee is often required: the predicted sets must provide consistent coverage per query (conditional coverage guarantee). We propose CondKGCP, a novel method that approximates predicate-conditional coverage guarantees while maintaining compact prediction sets. CondKGCP merges predicates with similar vector representations and augments calibration with rank information. We prove the theoretical guarantees and demonstrate empirical effectiveness of CondKGCP by comprehensive evaluations.
Code (0)
등록된 구현이 없습니다.
Tasks
Conformal PredictionGraph EmbeddingKnowledge Graph EmbeddingKnowledge Graph EmbeddingsMedical DiagnosisUncertainty QuantificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Electra: Conditional Generative Model based Predicate-Aware Query Approximation
The goal of Approximate Query Processing (AQP) is to provide very fast but "accurate enough" results for costly aggregate queries thereby improving user experience in interactive exploration of large datasets. Recently p…
Improved conformalized quantile regression
Conformalized quantile regression is a procedure that inherits the advantages of conformal prediction and quantile regression. That is, we use quantile regression to estimate the true conditional quantile and then apply …
Conformal PredictionPredictionPrediction Intervalsquantile regression+1Dynamic Language Binding in Relational Visual Reasoning
We present Language-binding Object Graph Network, the first neural reasoning method with dynamic relational structures across both visual and textual domains with applications in visual question answering. Relaxing the c…
ObjectQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)+1Conformalized Answer Set Prediction for Knowledge Graph Embedding
Knowledge graph embeddings (KGE) apply machine learning methods on knowledge graphs (KGs) to provide non-classical reasoning capabilities based on similarities and analogies. The learned KG embeddings are typically used …
Conformal PredictionGraph EmbeddingKnowledge Graph EmbeddingKnowledge Graph Embeddings+3Integrating Uncertainty Awareness into Conformalized Quantile Regression
Conformalized Quantile Regression (CQR) is a recently proposed method for constructing prediction intervals for a response $Y$ given covariates $X$, without making distributional assumptions. However, existing constructi…
Prediction Intervalsquantile regressionregression