paper-with-me

홈 › Papers

User-centered Evaluation of Popularity Bias in Recommender Systems

2021-03-10 · Himan Abdollahpouri, Masoud Mansoury, Robin Burke, Bamshad Mobasher, Edward Malthouse

Recommendation and ranking systems are known to suffer from popularity bias; the tendency of the algorithm to favor a few popular items while under-representing the majority of other items. Prior research has examined various approaches for mitigating popularity bias and enhancing the recommendation of long-tail, less popular, items. The effectiveness of these approaches is often assessed using different metrics to evaluate the extent to which over-concentration on popular items is reduced. However, not much attention has been given to the user-centered evaluation of this bias; how different users with different levels of interest towards popular items are affected by such algorithms. In this paper, we show the limitations of the existing metrics to evaluate popularity bias mitigation when we want to assess these algorithms from the users' perspective and we propose a new metric that can address these limitations. In addition, we present an effective approach that mitigates popularity bias from the user-centered point of view. Finally, we investigate several state-of-the-art approaches proposed in recent years to mitigate popularity bias and evaluate their performances using the existing metrics and also from the users' perspective. Our experimental results using two publicly-available datasets show that existing popularity bias mitigation techniques ignore the users' tolerance towards popular items. Our proposed user-centered method can tackle popularity bias effectively for different users while also improving the existing metrics.

📄 PDF Abstract BibTeX arXiv:2103.06364

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation Systems

Similar Papers 제목 키워드 기반

Potential Factors Leading to Popularity Unfairness in Recommender Systems: A User-Centered Analysis

2023-10-04 · Masoud Mansoury, Finn Duijvestijn, Imane Mourabet

Popularity bias is a well-known issue in recommender systems where few popular items are over-represented in the input data, while majority of other less popular items are under-represented. This disparate representation…

Movie RecommendationRecommendation Systems

HELM: A Human-Centered Evaluation Framework for LLM-Powered Recommender Systems

2026-01-27 · Sushant Mehta arxiv

The integration of Large Language Models (LLMs) into recommendation systems has introduced unprecedented capabilities for natural language understanding, explanation generation, and conversational interactions. However, …

Natural Language UnderstandingCollaborative FilteringExplanation GenerationRecommendation Systems

Measuring Recommender System Effects with Simulated Users

2021-01-12 · Sirui Yao, Yoni Halpern, Nithum Thain, Xuezhi Wang 외

Imagine a food recommender system -- how would we check if it is \emph{causing} and fostering unhealthy eating habits or merely reflecting users' interests? How much of a user's experience over time with a recommender is…

Collaborative FilteringRecommendation Systems

Popularity Bias in Recommendation: A Multi-stakeholder Perspective

2020-08-19 · Himan Abdollahpouri

Traditionally, especially in academic research in recommender systems, the focus has been solely on the satisfaction of the end-user. While user satisfaction has, indeed, been associated with the success of the business,…

Recommendation Systems

Ranking with Popularity Bias: User Welfare under Self-Amplification Dynamics

2023-05-24 · Guy Tennenholtz, Martin Mladenov, Nadav Merlis, Robert L. Axtell 외

While popularity bias is recognized to play a crucial role in recommmender (and other ranking-based) systems, detailed analysis of its impact on collective user welfare has largely been lacking. We propose and theoretica…