Formalizing Preference Utilitarianism in Physical World Models
Most ethical work is done at a low level of formality. This makes practical moral questions inaccessible to formal and natural sciences and can lead to misunderstandings in ethical discussion. In this paper, we use Bayesian inference to introduce a formalization of preference utilitarianism in physical world models, specifically cellular automata. Even though our formalization is not immediately applicable, it is a first step in providing ethics and ultimately the question of how to "make the world better" with a formal basis.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceEthicsSimilar Papers 제목 키워드 기반
Utilitarian Social Choice and Distributional Welfare Analysis
Harsanyi (1955) showed that the only way to aggregate individual preferences into a social preference which satisfies certain desirable properties is ``utilitarianism'', whereby the social utility function is a weighted …
Algorithmic Ethics: Formalization and Verification of Autonomous Vehicle Obligations
We develop a formal framework for automatic reasoning about the obligations of autonomous cyber-physical systems, including their social and ethical obligations. Obligations, permissions and prohibitions are distinct fro…
EthicsSelf-Driving CarsNon-Additive Axiologies in Large Worlds
Is the overall value of a world just the sum of values contributed by each value-bearing entity in that world? Additively separable axiologies (like total utilitarianism, prioritarianism, and critical level views) say 'y…
EthicsBelief-Averaged Relative Utilitarianism
We consider social welfare functions when the preferences of individual agents and society maximize subjective expected utility in the tradition of Savage. A system of axioms is introduced whose unique solution is the so…
Social Choice with Changing Preferences: Representation Theorems and Long-Run Policies
We study group decision making with changing preferences as a Markov Decision Process. We are motivated by the increasing prevalence of automated decision-making systems when making choices for groups of people over time…
Decision Making