Designing Tools for Semi-Automated Detection of Machine Learning Biases: An Interview Study
Machine learning models often make predictions that bias against certain subgroups of input data. When undetected, machine learning biases can constitute significant financial and ethical implications. Semi-automated tools that involve humans in the loop could facilitate bias detection. Yet, little is known about the considerations involved in their design. In this paper, we report on an interview study with 11 machine learning practitioners for investigating the needs surrounding semi-automated bias detection tools. Based on the findings, we highlight four considerations in designing to guide system designers who aim to create future tools for bias detection.
Code (0)
등록된 구현이 없습니다.
Tasks
Bias DetectionBIG-bench Machine LearningSimilar Papers 제목 키워드 기반
Accelerating System Log Processing by Semi-supervised Learning: A Technical Report
There is an increasing need for more automated system-log analysis tools for large scale online system in a timely manner. However, conventional way to monitor and classify the log output based on keyword list does not s…
A Metric Learning Approach to Anomaly Detection in Video Games
With the aim of designing automated tools that assist in the video game quality assurance process, we frame the problem of identifying bugs in video games as an anomaly detection (AD) problem. We develop State-State Siam…
Anomaly DetectionAtari GamesMetric LearningOptimal Auctions through Deep Learning: Advances in Differentiable Economics
Designing an incentive compatible auction that maximizes expected revenue is an intricate task. The single-item case was resolved in a seminal piece of work by Myerson in 1981, but more than 40 years later a full analyti…
Deep LearningGeneralization BoundsUser-Centric Semi-Automated Infographics Authoring and Recommendation
Designing infographics can be a tedious process for non-experts and time-consuming even for professional designers. Based on the literature and a formative study, we propose a flexible framework for automated and semi-au…
Evaluating the Performance of Large Language Models in Scientific Claim Detection and Classification
The pervasive influence of social media during the COVID-19 pandemic has been a double-edged sword, enhancing communication while simultaneously propagating misinformation. This \textit{Digital Infodemic} has highlighted…
Decision MakingFact CheckingMisinformation