Revisiting Popularity and Demographic Biases in Recommender Evaluation and Effectiveness
Recommendation algorithms are susceptible to popularity bias: a tendency to recommend popular items even when they fail to meet user needs. A related issue is that the recommendation quality can vary by demographic groups. Marginalized groups or groups that are under-represented in the training data may receive less relevant recommendations from these algorithms compared to others. In a recent study, Ekstrand et al. investigate how recommender performance varies according to popularity and demographics, and find statistically significant differences in recommendation utility between binary genders on two datasets, and significant effects based on age on one dataset. Here we reproduce those results and extend them with additional analyses. We find statistically significant differences in recommender performance by both age and gender. We observe that recommendation utility steadily degrades for older users, and is lower for women than men. We also find that the utility is higher for users from countries with more representation in the dataset. In addition, we find that total usage and the popularity of consumed content are strong predictors of recommender performance and also vary significantly across demographic groups.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Embedding Cultural Diversity in Prototype-based Recommender Systems
Popularity bias in recommender systems can increase cultural overrepresentation by favoring norms from dominant cultures and marginalizing underrepresented groups. This issue is critical for platforms offering cultural p…
AttributeDiversityFairnessRecommendation SystemsMeasuring Recommender System Effects with Simulated Users
Imagine a food recommender system -- how would we check if it is \emph{causing} and fostering unhealthy eating habits or merely reflecting users' interests? How much of a user's experience over time with a recommender is…
Collaborative FilteringRecommendation SystemsDebiased Contrastive Representation Learning for Mitigating Dual Biases in Recommender Systems
In recommender systems, popularity and conformity biases undermine recommender effectiveness by disproportionately favouring popular items, leading to their over-representation in recommendation lists and causing an unba…
Contrastive LearningDiversityRecommendation SystemsRepresentation LearningShould I Follow the Crowd? A Probabilistic Analysis of the Effectiveness of Popularity in Recommender Systems
The use of IR methodology in the evaluation of recommender systems has become common practice in recent years. IR metrics have been found however to be strongly biased towards rewarding algorithms that recommend popular …
Recommendation SystemsWhy is Normalization Necessary for Linear Recommenders?
Despite their simplicity, linear autoencoder (LAE)-based models have shown comparable or even better performance with faster inference speed than neural recommender models. However, LAEs face two critical challenges: (i)…
Collaborative FilteringRecommendation Systems