More Isn't Always Better: Balancing Decision Accuracy and Conformity Pressures in Multi-AI Advice
Just as people improve decision-making by consulting diverse human advisors, they can now also consult with multiple AI systems. Prior work on group decision-making shows that advice aggregation creates pressure to conform, leading to overreliance. However, the conditions under which multi-AI consultation improves or undermines human decision-making remain unclear. We conducted experiments with three tasks in which participants received advice from panels of AIs. We varied panel size, within-panel consensus, and the human-likeness of presentation. Accuracy improved for small panels relative to a single AI; larger panels yielded no gains. The level of within-panel consensus affected participants' reliance on AI advice: High consensus fostered overreliance; a single dissent reduced pressure to conform; wide disagreement created confusion and undermined appropriate reliance. Human-like presentations increased perceived usefulness and agency in certain tasks, without raising conformity pressure. These findings yield design implications for presenting multi-AI advice that preserve accuracy while mitigating conformity.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Where Am I and Where Should I Go? Grounding Positional and Directional Labels in a Disoriented Human Balancing Task
In this paper, we present an approach toward grounding linguistic positional and directional labels directly to human motions in the course of a disoriented balancing task in a multi-axis rotational device. We use deep n…
Wait-info Policy: Balancing Source and Target at Information Level for Simultaneous Machine Translation
Simultaneous machine translation (SiMT) outputs the translation while receiving the source inputs, and hence needs to balance the received source information and translated target information to make a reasonable decisio…
Machine TranslationTranslationVideo Face Matching using Subset Selection and Clustering of Probabilistic Multi-Region Histograms
Balancing computational efficiency with recognition accuracy is one of the major challenges in real-world video-based face recognition. A significant design decision for any such system is whether to process and use all …
AllClusteringComputational EfficiencyFace Detection+2More is not always better: balancing sense distributions for all-words Word Sense Disambiguation
Current Word Sense Disambiguation systems show an extremely poor performance on low frequent senses, which is mainly caused by the difference in sense distributions between training and test data. The main focus in tackl…
AllWord Sense DisambiguationBlackwell-Monotone Updating Rules
An updating rule specifies how an agent reacts to information. An updating rule is Blackwell monotone if more information is always better for an agent in a decision problem and strictly Blackwell monotone if, in additio…