paper-with-me

Papers

The Crowd Classification Problem: Social Dynamics of Binary Choice Accuracy

2021-04-22 · Joshua Becker, Douglas Guilbeault, Ned Smith

Decades of research suggest that information exchange in groups and organizations can reliably improve judgment accuracy in tasks such as financial forecasting, market research, and medical decision-making. However, we show that improving the accuracy of numeric estimates does not necessarily improve the accuracy of decisions. For binary choice judgments, also known as classification tasks--e.g. yes/no or build/buy decisions--social influence is most likely to grow the majority vote share, regardless of the accuracy of that opinion. As a result, initially inaccurate groups become increasingly inaccurate after information exchange even as they signal stronger support. We term this dynamic the "crowd classification problem." Using both a novel dataset as well as a reanalysis of three previous datasets, we study this process in two types of information exchange: (1) when people share votes only, and (2) when people form and exchange numeric estimates prior to voting. Surprisingly, when people exchange numeric estimates prior to voting, the binary choice vote can become less accurate even as the average numeric estimate becomes more accurate. Our findings recommend against voting as a form of decision-making when groups are optimizing for accuracy. For those cases where voting is required, we discuss strategies for managing communication to avoid the crowd classification problem. We close with a discussion of how our results contribute to a broader contingency theory of collective intelligence.

📄 PDF Abstract BibTeX arXiv:2104.11300

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationDecision MakingGeneral Classification

Similar Papers 제목 키워드 기반

Wisdom of the crowd from unsupervised dimension reduction

2017-11-28 · Lingfei Wang, Tom Michoel

Wisdom of the crowd, the collective intelligence derived from responses of multiple human or machine individuals to the same questions, can be more accurate than each individual, and improve social decision-making and pr…

Decision MakingDimensionality Reduction

An Expert Annotated Dataset for the Detection of Online Misogyny

2021-04-01 · EACL 2021 2 · Ella Guest, Bertie Vidgen, Alexandros Mittos, Nishanth Sastry 외

Online misogyny is a pernicious social problem that risks making online platforms toxic and unwelcoming to women. We present a new hierarchical taxonomy for online misogyny, as well as an expert labelled dataset to enabl…

Binary ClassificationClassification

Embracing Error to Enable Rapid Crowdsourcing

2016-02-14 · Ranjay Krishna, Kenji Hata, Stephanie Chen, Joshua Kravitz 외

Microtask crowdsourcing has enabled dataset advances in social science and machine learning, but existing crowdsourcing schemes are too expensive to scale up with the expanding volume of data. To scale and widen the appl…

General ClassificationSentiment AnalysisTopic ClassificationWord Similarity

ODEs learn to walk: ODE-Net based data-driven modeling for crowd dynamics

2022-10-18 · Chen Cheng, Jinglai Li

Predicting the behaviors of pedestrian crowds is of critical importance for a variety of real-world problems. Data driven modeling, which aims to learn the mathematical models from observed data, is a promising tool to c…

Detecting F-formations & Roles in Crowded Social Scenes with Wearables: Combining Proxemics & Dynamics using LSTMs

2019-11-17 · Alessio Rosatelli, Ekin Gedik, Hayley Hung

In this paper, we investigate the use of proxemics and dynamics for automatically identifying conversing groups, or so-called F-formations. More formally we aim to automatically identify whether wearable sensor data comi…

Descriptive