From Individual Experience to Collective Evidence: A Reporting-Based Framework for Identifying Systemic Harms
When an individual reports a negative interaction with some system, how can their personal experience be contextualized within broader patterns of system behavior? We study the reporting database problem, where individual reports of adverse events arrive sequentially, and are aggregated over time. In this work, our goal is to identify whether there are subgroups--defined by any combination of relevant features--that are disproportionately likely to experience harmful interactions with the system. We formalize this problem as a sequential hypothesis test, and identify conditions on reporting behavior that are sufficient for making inferences about disparities in true rates of harm across subgroups. We show that algorithms for sequential hypothesis tests can be applied to this problem with a standard multiple testing correction. We then demonstrate our method on real-world datasets, including mortgage decisions and vaccine side effects; on each, our method (re-)identifies subgroups known to experience disproportionate harm using only a fraction of the data that was initially used to discover them.
Code (1)
Similar Papers 제목 키워드 기반
Collective learning from individual experiences and information transfer during group foraging
Living in groups brings benefits to many animals, such as a protection against predators and an improved capacity for sensing and making decisions while searching for resources in uncertain environments. A body of studie…
The Homogenizing Effect of Large Language Models on Human Expression and Thought
Cognitive diversity, reflected in variations of language, perspective, and reasoning, is essential to creativity and collective intelligence. This diversity is rich and grounded in culture, history, and individual experi…
Unified Dual-view Cognitive Model for Interpretable Claim Verification
Recent studies constructing direct interactions between the claim and each single user response (a comment or a relevant article) to capture evidence have shown remarkable success in interpretable claim verification. Owi…
ArticlesClaim VerificationSentenceATRIA: Adaptive Traceable ECG Reporting with Iterative Agents
Existing ECG report generation is tightly coupled -- interpretation and reporting fused end-to-end, so errors propagate without stage-level recourse -- while agent-based systems decouple tasks but remain single-pass, nev…
Loose social organisation of AB strain zebrafish groups in a two-patch environment
We explore the collective behaviours of 7 group sizes: 1, 2, 3, 5, 7, 10 and 20 AB zebrafish (Danio rerio) in a constraint environment composed of two identical squared rooms connected by a corridor. This simple set-up i…