Exploring How Fair Model Representations Relate to Fair Recommendations
One of the many fairness definitions pursued in recent recommender system research targets mitigating demographic information encoded in model representations. Models optimized for this definition are typically evaluated on how well demographic attributes can be classified given model representations, with the (implicit) assumption that this measure accurately reflects \textit{recommendation parity}, i.e., how similar recommendations given to different users are. We challenge this assumption by comparing the amount of demographic information encoded in representations with various measures of how the recommendations differ. We propose two new approaches for measuring how well demographic information can be classified given ranked recommendations. Our results from extensive testing of multiple models on one real and multiple synthetically generated datasets indicate that optimizing for fair representations positively affects recommendation parity, but also that evaluation at the representation level is not a good proxy for measuring this effect when comparing models. We also provide extensive insight into how recommendation-level fairness metrics behave for various models by evaluating their performances on numerous generated datasets with different properties.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Compositional Fairness Constraints for Graph Embeddings
Learning high-quality node embeddings is a key building block for machine learning models that operate on graph data, such as social networks and recommender systems. However, existing graph embedding techniques are unab…
FairnessGraph EmbeddingRecommendation SystemsPrivate Recommender Systems: How Can Users Build Their Own Fair Recommender Systems without Log Data?
Fairness is a crucial property in recommender systems. Although some online services have adopted fairness aware systems recently, many other services have not adopted them yet. In this work, we propose methods to enable…
FairnessRecommendation SystemsExplanations, Fairness, and Appropriate Reliance in Human-AI Decision-Making
In this work, we study the effects of feature-based explanations on distributive fairness of AI-assisted decisions, specifically focusing on the task of predicting occupations from short textual bios. We also investigate…
AttributeDecision MakingFairnessClosing the Gender Wage Gap: Adversarial Fairness in Job Recommendation
The goal of this work is to help mitigate the already existing gender wage gap by supplying unbiased job recommendations based on resumes from job seekers. We employ a generative adversarial network to remove gender bias…
FairnessGenerative Adversarial NetworkRecommendation SystemsUsing Image Fairness Representations in Diversity-Based Re-ranking for Recommendations
The trade-off between relevance and fairness in personalized recommendations has been explored in recent works, with the goal of minimizing learned discrimination towards certain demographics while still producing releva…
DiversityFairnessRecommendation SystemsRe-Ranking