paper-with-me

홈 › Papers

Calibrating the Predictions for Top-N Recommendations

2024-08-21 · Masahiro Sato

Well-calibrated predictions of user preferences are essential for many applications. Since recommender systems typically select the top-N items for users, calibration for those top-N items, rather than for all items, is important. We show that previous calibration methods result in miscalibrated predictions for the top-N items, despite their excellent calibration performance when evaluated on all items. In this work, we address the miscalibration in the top-N recommended items. We first define evaluation metrics for this objective and then propose a generic method to optimize calibration models focusing on the top-N items. It groups the top-N items by their ranks and optimizes distinct calibration models for each group with rank-dependent training weights. We verify the effectiveness of the proposed method for both explicit and implicit feedback datasets, using diverse classes of recommender models.

📄 PDF Abstract BibTeX arXiv:2408.11596

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation Systems

Similar Papers 제목 키워드 기반

Self-Calibrating Conformal Prediction

2024-02-11 · Lars van der Laan, Ahmed M. Alaa

In machine learning, model calibration and predictive inference are essential for producing reliable predictions and quantifying uncertainty to support decision-making. Recognizing the complementary roles of point and in…

Binary ClassificationConformal PredictionDecision MakingManagement+3

Multiclass Confidence and Localization Calibration for Object Detection

2023-06-14 · CVPR 2023 1 · Bimsara Pathiraja, Malitha Gunawardhana, Muhammad Haris Khan

Albeit achieving high predictive accuracy across many challenging computer vision problems, recent studies suggest that deep neural networks (DNNs) tend to make overconfident predictions, rendering them poorly calibrated…

Objectobject-detectionObject Detection

Considering discrepancy when calibrating a mechanistic electrophysiology model

2020-01-13 · Chon Lok Lei, Sanmitra Ghosh, Dominic G. Whittaker, Yasser Aboelkassem 외

Uncertainty quantification (UQ) is a vital step in using mathematical models and simulations to take decisions. The field of cardiac simulation has begun to explore and adopt UQ methods to characterise uncertainty in mod…

Gaussian ProcessesUncertainty Quantification

Calibrating Bayesian UNet++ for Sub-Seasonal Forecasting

2024-03-25 · Busra Asan, Abdullah Akgül, Alper Unal, Melih Kandemir 외

Seasonal forecasting is a crucial task when it comes to detecting the extreme heat and colds that occur due to climate change. Confidence in the predictions should be reliable since a small increase in the temperatures i…

Performative Risk Control: Calibrating Models for Reliable Deployment under Performativity

2025-05-30 · Victor Li, Baiting Chen, Yuzhen Mao, Qi Lei 외

Calibrating blackbox machine learning models to achieve risk control is crucial to ensure reliable decision-making. A rich line of literature has been studying how to calibrate a model so that its predictions satisfy exp…

Decision Making