MoralChoice Survey

홈페이지

*MoralChoice* is a survey dataset to evaluate the moral beliefs encoded in LLMs. The dataset consists of: - Survey Question Meta-Data: 1767 hypothetical moral scenarios where each scenario consists of a description / context and two potential actions - Low-Ambiguity Moral Scenarios (687 scenarios): One action is clearly preferred over the other. - High-Ambiguity Moral Scenarios (680 scenarios): Neither action is clearly preferred - Survey Question Templates: 3 hand-curated question templates - Survey Responses: Outputs from 28 open- and closed-sourced LLMs