Fairness Practices in Industry: A Case Study in Machine Learning Teams Building Recommender Systems
The rapid proliferation of recommender systems necessitates robust fairness practices to address inherent biases. Assessing fairness, though, is challenging due to constantly evolving metrics and best practices. This paper analyzes how industry practitioners perceive and incorporate these changing fairness standards in their workflows. Through semi-structured interviews with 11 practitioners from technical teams across a range of large technology companies, we investigate industry implementations of fairness in recommendation system products. We focus on current debiasing practices, applied metrics, collaborative strategies, and integrating academic research into practice. Findings show a preference for multi-dimensional debiasing over traditional demographic methods, and a reliance on intuitive rather than academic metrics. This study also highlights the difficulties in balancing fairness with both the practitioner's individual (bottom-up) roles and organizational (top-down) workplace constraints, including the interplay with legal and compliance experts. Finally, we offer actionable recommendations for the recommender system community and algorithmic fairness practitioners, underlining the need to refine fairness practices continually.
Code (0)
등록된 구현이 없습니다.
Tasks
FairnessRecommendation SystemsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
An Analysis of the New EU AI Act and A Proposed Standardization Framework for Machine Learning Fairness
The European Union's AI Act represents a crucial step towards regulating ethical and responsible AI systems. However, we find an absence of quantifiable fairness metrics and the ambiguity in terminology, particularly the…
Assessing Perceived Fairness from Machine Learning Developer's Perspective
Fairness in machine learning (ML) applications is an important practice for developers in research and industry. In ML applications, unfairness is triggered due to bias in the data, curation process, erroneous assumption…
FairnessA Catalog of Fairness-Aware Practices in Machine Learning Engineering
Machine learning's widespread adoption in decision-making processes raises concerns about fairness, particularly regarding the treatment of sensitive features and potential discrimination against minorities. The software…
Decision MakingFairnessInvestigating Practices and Opportunities for Cross-functional Collaboration around AI Fairness in Industry Practice
An emerging body of research indicates that ineffective cross-functional collaboration -- the interdisciplinary work done by industry practitioners across roles -- represents a major barrier to addressing issues of fairn…
FairnessCharacterizing machine learning process: A maturity framework
Academic literature on machine learning modeling fails to address how to make machine learning models work for enterprises. For example, existing machine learning processes cannot address how to define business use cases…
BIG-bench Machine LearningFairnessManagement