Disparate Impact of Artificial Intelligence Bias in Ridehailing Economy's Price Discrimination Algorithms
Ridehailing applications that collect mobility data from individuals to inform smart city planning predict each trip's fare pricing with automated algorithms that rely on artificial intelligence (AI). This type of AI algorithm, namely a price discrimination algorithm, is widely used in the industry's black box systems for dynamic individualized pricing. Lacking transparency, studying such AI systems for fairness and disparate impact has not been possible without access to data used in generating the outcomes of price discrimination algorithms. Recently, in an effort to enhance transparency in city planning, the city of Chicago regulation mandated that transportation providers publish anonymized data on ridehailing. As a result, we present the first large-scale measurement of the disparate impact of price discrimination algorithms used by ridehailing applications. The application of random effects models from the meta-analysis literature combines the city-level effects of AI bias on fare pricing from census tract attributes, aggregated from the American Community Survey. An analysis of 100 million ridehailing samples from the city of Chicago indicates a significant disparate impact in fare pricing of neighborhoods due to AI bias learned from ridehailing utilization patterns associated with demographic attributes. Neighborhoods with larger non-white populations, higher poverty levels, younger residents, and high education levels are significantly associated with higher fare prices, with combined effect sizes, measured in Cohen's d, of -0.32, -0.28, 0.69, and 0.24 for each demographic, respectively. Further, our methods hold promise for identifying and addressing the sources of disparate impact in AI algorithms learning from datasets that contain U.S. geolocations.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingFairnessMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Skin Cancer Machine Learning Model Tone Bias
Background: Many open-source skin cancer image datasets are the result of clinical trials conducted in countries with lighter skin tones. Due to this tone imbalance, machine learning models derived from these datasets ca…
FairnessmodelAn investigation into the impact of deep learning model choice on sex and race bias in cardiac MR segmentation
In medical imaging, artificial intelligence (AI) is increasingly being used to automate routine tasks. However, these algorithms can exhibit and exacerbate biases which lead to disparate performances between protected gr…
Image SegmentationSegmentationSemantic SegmentationAn Introduction to Artificial Intelligence and Solutions to the Problems of Algorithmic Discrimination
There is substantial evidence that Artificial Intelligence (AI) and Machine Learning (ML) algorithms can generate bias against minorities, women, and other protected classes. Federal and state laws have been enacted to p…
FairnessInvestigating Socio-spatial Differences between Solo Ridehailing and Pooled Rides in Diverse Communities
Transformative mobility services present both considerable opportunities and challenges for urban mobility systems. Increasing attention is being paid to ridehailing platforms and connections between demand and continuou…
Disparate Impact in Synthetic Data Generation
We revisit the fairness notion of disparate impact for synthetic data generation (SDG), that assesses whether the utility of generated records is the same across sensitive groups. Our approach departs from existing work …
Synthetic Data Generation