Large Language Models as Recommender Systems: A Study of Popularity Bias
The issue of popularity bias -- where popular items are disproportionately recommended, overshadowing less popular but potentially relevant items -- remains a significant challenge in recommender systems. Recent advancements have seen the integration of general-purpose Large Language Models (LLMs) into the architecture of such systems. This integration raises concerns that it might exacerbate popularity bias, given that the LLM's training data is likely dominated by popular items. However, it simultaneously presents a novel opportunity to address the bias via prompt tuning. Our study explores this dichotomy, examining whether LLMs contribute to or can alleviate popularity bias in recommender systems. We introduce a principled way to measure popularity bias by discussing existing metrics and proposing a novel metric that fulfills a series of desiderata. Based on our new metric, we compare a simple LLM-based recommender to traditional recommender systems on a movie recommendation task. We find that the LLM recommender exhibits less popularity bias, even without any explicit mitigation.
Code (0)
등록된 구현이 없습니다.
Tasks
Movie RecommendationRecommendation SystemsSimilar Papers 제목 키워드 기반
Popularity Bias in Collaborative Filtering-Based Multimedia Recommender Systems
Multimedia recommender systems suggest media items, e.g., songs, (digital) books and movies, to users by utilizing concepts of traditional recommender systems such as collaborative filtering. In this paper, we investigat…
Collaborative FilteringRecommendation SystemsQuantifying and Mitigating Popularity Bias in Conversational Recommender Systems
Conversational recommender systems (CRS) have shown great success in accurately capturing a user's current and detailed preference through the multi-round interaction cycle while effectively guiding users to a more perso…
AttributeRecommendation SystemsRanking with Popularity Bias: User Welfare under Self-Amplification Dynamics
While popularity bias is recognized to play a crucial role in recommmender (and other ranking-based) systems, detailed analysis of its impact on collective user welfare has largely been lacking. We propose and theoretica…
On the challenges of studying bias in Recommender Systems: A UserKNN case study
Statements on the propagation of bias by recommender systems are often hard to verify or falsify. Research on bias tends to draw from a small pool of publicly available datasets and is therefore bound by their specific p…
Recommendation SystemsPopularity Bias in Recommendation: A Multi-stakeholder Perspective
Traditionally, especially in academic research in recommender systems, the focus has been solely on the satisfaction of the end-user. While user satisfaction has, indeed, been associated with the success of the business,…
Recommendation Systems