Bias by Design? How Data Practices Shape Fairness in AI Healthcare Systems
Artificial intelligence (AI) holds great promise for transforming healthcare. However, despite significant advances, the integration of AI solutions into real-world clinical practice remains limited. A major barrier is the quality and fairness of training data, which is often compromised by biased data collection practices. This paper draws on insights from the AI4HealthyAging project, part of Spain's national R&D initiative, where our task was to detect biases during clinical data collection. We identify several types of bias across multiple use cases, including historical, representation, and measurement biases. These biases manifest in variables such as sex, gender, age, habitat, socioeconomic status, equipment, and labeling. We conclude with practical recommendations for improving the fairness and robustness of clinical problem design and data collection. We hope that our findings and experience contribute to guiding future projects in the development of fairer AI systems in healthcare.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Fairness Practices in Industry: A Case Study in Machine Learning Teams Building Recommender Systems
The rapid proliferation of recommender systems necessitates robust fairness practices to address inherent biases. Assessing fairness, though, is challenging due to constantly evolving metrics and best practices. This pap…
FairnessRecommendation SystemsA Gray Literature Study on Fairness Requirements in AI-enabled Software Engineering
Today, with the growing obsession with applying Artificial Intelligence (AI), particularly Machine Learning (ML), to software across various contexts, much of the focus has been on the effectiveness of AI models, often m…
Data Preparation for Fairness-Performance Trade-Offs: A Practitioner-Friendly Alternative?
As machine learning (ML) systems are increasingly adopted across industries, addressing fairness and bias has become essential. While many solutions focus on ethical challenges in ML, recent studies highlight that data i…
FairnessFairComp: Workshop on Fairness and Robustness in Machine Learning for Ubiquitous Computing
How can we ensure that Ubiquitous Computing (UbiComp) research outcomes are both ethical and fair? While fairness in machine learning (ML) has gained traction in recent years, fairness in UbiComp remains unexplored. This…
FairnessThe invisible power of fairness. How machine learning shapes democracy
Many machine learning systems make extensive use of large amounts of data regarding human behaviors. Several researchers have found various discriminatory practices related to the use of human-related machine learning sy…
BIG-bench Machine LearningCultural Vocal Bursts Intensity PredictionFairness