Learning to Complement Humans
A rising vision for AI in the open world centers on the development of systems that can complement humans for perceptual, diagnostic, and reasoning tasks. To date, systems aimed at complementing the skills of people have employed models trained to be as accurate as possible in isolation. We demonstrate how an end-to-end learning strategy can be harnessed to optimize the combined performance of human-machine teams by considering the distinct abilities of people and machines. The goal is to focus machine learning on problem instances that are difficult for humans, while recognizing instances that are difficult for the machine and seeking human input on them. We demonstrate in two real-world domains (scientific discovery and medical diagnosis) that human-machine teams built via these methods outperform the individual performance of machines and people. We then analyze conditions under which this complementarity is strongest, and which training methods amplify it. Taken together, our work provides the first systematic investigation of how machine learning systems can be trained to complement human reasoning.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningDiagnosticMedical Diagnosisscientific discoverySimilar Papers 제목 키워드 기반
On the Effect of Information Asymmetry in Human-AI Teams
Over the last years, the rising capabilities of artificial intelligence (AI) have improved human decision-making in many application areas. Teaming between AI and humans may even lead to complementary team performance (C…
Decision MakingExplainable Artificial Intelligence (XAI)Learning Complementary Policies for Human-AI Teams
Human-AI complementarity is important when neither the algorithm nor the human yields dominant performance across all instances in a given context. Recent work that explored human-AI collaboration has considered decision…
Toward Human-AI Complementarity Across Diverse Tasks
Human-AI complementarity, the idea that combining human and AI judgments can outperform either alone, offers a promising pathway toward robust oversight of advanced AI systems. However, whether human-AI complementarity c…
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Many researchers motivate explainable AI with studies showing that human-AI team performance on decision-making tasks improves when the AI explains its recommendations. However, prior studies observed improvements from e…
Decision MakingQuestion AnsweringSentiment AnalysisTowards Effective Human-AI Decision-Making: The Role of Human Learning in Appropriate Reliance on AI Advice
The true potential of human-AI collaboration lies in exploiting the complementary capabilities of humans and AI to achieve a joint performance superior to that of the individual AI or human, i.e., to achieve complementar…
Decision Making