paper-with-me

홈 › Papers

Uncertainty in Repeated Implicit Feedback as a Measure of Reliability

2025-05-05 · Bruno Sguerra, Viet-Anh Tran, Romain Hennequin, Manuel Moussallam

Recommender systems rely heavily on user feedback to learn effective user and item representations. Despite their widespread adoption, limited attention has been given to the uncertainty inherent in the feedback used to train these systems. Both implicit and explicit feedback are prone to noise due to the variability in human interactions, with implicit feedback being particularly challenging. In collaborative filtering, the reliability of interaction signals is critical, as these signals determine user and item similarities. Thus, deriving accurate confidence measures from implicit feedback is essential for ensuring the reliability of these signals. A common assumption in academia and industry is that repeated interactions indicate stronger user interest, increasing confidence in preference estimates. However, in domains such as music streaming, repeated consumption can shift user preferences over time due to factors like satiation and exposure. While literature on repeated consumption acknowledges these dynamics, they are often overlooked when deriving confidence scores for implicit feedback. This paper addresses this gap by focusing on music streaming, where repeated interactions are frequent and quantifiable. We analyze how repetition patterns intersect with key factors influencing user interest and develop methods to quantify the associated uncertainty. These uncertainty measures are then integrated as consistency metrics in a recommendation task. Our empirical results show that incorporating uncertainty into user preference models yields more accurate and relevant recommendations. Key contributions include a comprehensive analysis of uncertainty in repeated consumption patterns, the release of a novel dataset, and a Bayesian model for implicit listening feedback.

📄 PDF Abstract BibTeX arXiv:2505.02492

Code (1)

deezer/uncertainty_feedback 공식 구현

Tasks

Collaborative FilteringRecommendation Systems

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

LLMs as Implicit Imputers: Uncertainty Should Scale with Missing Information

2026-05-13 · Stef van Buuren arxiv

Large language models (LLMs) are increasingly deployed in settings where the available context is incomplete or degraded. We argue that an LLM generating answers under incomplete context can be viewed as an implicit impu…

Uncertainty-Based Abstention in LLMs Improves Safety and Reduces Hallucinations

2024-04-16 · Christian Tomani, Kamalika Chaudhuri, Ivan Evtimov, Daniel Cremers 외

A major barrier towards the practical deployment of large language models (LLMs) is their lack of reliability. Three situations where this is particularly apparent are correctness, hallucinations when given unanswerable …

Question Answering

Reliability and repeatability of ISO 3382-3 metrics based on repeated acoustic measurements in open-plan offices

2023-06-17 · Manuj Yadav, Densil Cabrera, James Love, Jungsoo Kim 외

This paper investigates variability in the key ISO 3382-3:2012 metrics, based primarily on the repeatability and reliability of these metrics, using repeated measurements in open-plan offices. Two types of repeated measu…

Explicit Feedbacks Meet with Implicit Feedbacks : A Combined Approach for Recommendation System

2018-10-29 · Supriyo Mandal, Abyayananda Maiti

Recommender systems recommend items more accurately by analyzing users' potential interest on different brands' items. In conjunction with users' rating similarity, the presence of users' implicit feedbacks like clicking…

Recommendation Systems

Conformal Feedback Alignment: Quantifying Answer-Level Reliability for Robust LLM Alignment

2026-01-24 · Tiejin Chen, Xiaoou Liu, Vishnu Nandam, Kuan-Ru Liou 외 arxiv

Preference-based alignment like Reinforcement Learning from Human Feedback (RLHF) learns from pairwise preferences, yet the labels are often noisy and inconsistent. Existing uncertainty-aware approaches weight preference…

Reinforcement Learning