paper-with-me

홈 › Papers

Intuitions of Compromise: Utilitarianism vs. Contractualism

2024-10-07 · Jared Moore, Yejin Choi, Sydney Levine

What is the best compromise in a situation where different people value different things? The most commonly accepted method for answering this question -- in fields across the behavioral and social sciences, decision theory, philosophy, and artificial intelligence development -- is simply to add up utilities associated with the different options and pick the solution with the largest sum. This `utilitarian'' approach seems like the obvious, theory-neutral way of approaching the problem. But there is an important, though often-ignored, alternative: a contractualist'' approach, which advocates for an agreement-driven method of deciding. Remarkably, no research has presented empirical evidence directly comparing the intuitive plausibility of these two approaches. In this paper, we systematically explore the proposals suggested by each algorithm (the `Utilitarian Sum'' and the contractualist ''Nash Product''), using a paradigm that applies those algorithms to aggregating preferences across groups in a social decision-making context. While the dominant approach to value aggregation up to now has been utilitarian, we find that people strongly prefer the aggregations recommended by the contractualist algorithm. Finally, we compare the judgments of large language models (LLMs) to that of our (human) participants, finding important misalignment between model and human preferences.

📄 PDF Abstract BibTeX arXiv:2410.05496

Code (1)

jlcmoore/valueaggregation 공식 구현

Tasks

Decision MakingPhilosophy

Similar Papers 제목 키워드 기반

Requisite Variety in Ethical Utility Functions for AI Value Alignment

2019-06-30 · Nadisha-Marie Aliman, Leon Kester

Being a complex subject of major importance in AI Safety research, value alignment has been studied from various perspectives in the last years. However, no final consensus on the design of ethical utility functions faci…

Non-Additive Axiologies in Large Worlds

2020-10-14 · Christian Tarsney, Teruji Thomas

Is the overall value of a world just the sum of values contributed by each value-bearing entity in that world? Additively separable axiologies (like total utilitarianism, prioritarianism, and critical level views) say 'y…

Ethics

Utilitarian Social Choice and Distributional Welfare Analysis

2024-11-02 · Federico Echenique, Quitzé Valenzuela-Stookey

Harsanyi (1955) showed that the only way to aggregate individual preferences into a social preference which satisfies certain desirable properties is ``utilitarianism'', whereby the social utility function is a weighted …

Formalizing Preference Utilitarianism in Physical World Models

2015-04-21 · Caspar Oesterheld

Most ethical work is done at a low level of formality. This makes practical moral questions inaccessible to formal and natural sciences and can lead to misunderstandings in ethical discussion. In this paper, we use Bayes…

Bayesian InferenceEthics

Uncovering Latent Human Wellbeing in Language Model Embeddings

2024-02-19 · Pedro Freire, ChengCheng Tan, Adam Gleave, Dan Hendrycks 외

Do language models implicitly learn a concept of human wellbeing? We explore this through the ETHICS Utilitarianism task, assessing if scaling enhances pretrained models' representations. Our initial finding reveals that…

EthicsLanguage ModelingLanguage Modellingmodel+1