Predictive Inequity in Object Detection
In this work, we investigate whether state-of-the-art object detection systems have equitable predictive performance on pedestrians with different skin tones. This work is motivated by many recent examples of ML and vision systems displaying higher error rates for certain demographic groups than others. We annotate an existing large scale dataset which contains pedestrians, BDD100K, with Fitzpatrick skin tones in ranges [1-3] or [4-6]. We then provide an in-depth comparative analysis of performance between these two skin tone groupings, finding that neither time of day nor occlusion explain this behavior, suggesting this disparity is not merely the result of pedestrians in the 4-6 range appearing in more difficult scenes for detection. We investigate to what extent time of day, occlusion, and reweighting the supervised loss during training affect this predictive bias.
Code (1)
Tasks
Objectobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
ICON$^2$: Reliably Benchmarking Predictive Inequity in Object Detection
As computer vision systems are being increasingly deployed at scale in high-stakes applications like autonomous driving, concerns about social bias in these systems are rising. Analysis of fairness in real-world vision s…
AttributeAutonomous DrivingBenchmarkingFairness+3Inequity aversion improves cooperation in intertemporal social dilemmas
Groups of humans are often able to find ways to cooperate with one another in complex, temporally extended social dilemmas. Models based on behavioral economics are only able to explain this phenomenon for unrealistic st…
Multi-agent Reinforcement LearningReinforcement LearningAdvantageous and disadvantageous inequality aversion can be taught through vicarious learning of others' preferences
While enforcing egalitarian social norms is critical for human society, punishing social norm violators often incurs a cost to the self. This cost looms even larger when one can benefit from an unequal distribution of re…
FairnessFair Multivariate Adaptive Regression Splines for Ensuring Equity and Transparency
Predictive analytics is widely used in various domains, including education, to inform decision-making and improve outcomes. However, many predictive models are proprietary and inaccessible for evaluation or modification…
Decision MakingFairnessfeature selectionregressionA Branch-and-Price Algorithm for Fast and Equitable Last-Mile Relief Aid Distribution
The distribution of relief supplies to shelters is a critical aspect of post-disaster humanitarian logistics. In major disasters, prepositioned supplies often fall short of meeting all demands. We address the problem of …