paper-with-me

Papers

Morality is Non-Binary: Building a Pluralist Moral Sentence Embedding Space using Contrastive Learning

2024-01-30 · Jeongwoo Park, Enrico Liscio, Pradeep K. Murukannaiah

Recent advances in NLP show that language models retain a discernible level of knowledge in deontological ethics and moral norms. However, existing works often treat morality as binary, ranging from right to wrong. This simplistic view does not capture the nuances of moral judgment. Pluralist moral philosophers argue that human morality can be deconstructed into a finite number of elements, respecting individual differences in moral judgment. In line with this view, we build a pluralist moral sentence embedding space via a state-of-the-art contrastive learning approach. We systematically investigate the embedding space by studying the emergence of relationships among moral elements, both quantitatively and qualitatively. Our results show that a pluralist approach to morality can be captured in an embedding space. However, moral pluralism is challenging to deduce via self-supervision alone and requires a supervised approach with human labels.

📄 PDF Abstract BibTeX arXiv:2401.17228

Code (1)

jeongwoopark0514/morality-is-non-binary 공식 구현 pytorch

Tasks

Contrastive LearningEthicsSentenceSentence EmbeddingSentence-Embedding

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Jailbreaking Large Language Models with Morality Attacks

2026-04-18 · Ying Su, Mingen Zheng, Weili Diao, Haoran Li arxiv

Pluralism alignment with AI has the sophisticated and necessary goal of creating AI that can coexist with and serve morally multifaceted humanity. Research towards pluralism alignment has many efforts in enhancing the le…

MoralDial: A Framework to Train and Evaluate Moral Dialogue Systems via Moral Discussions

2022-12-21 · Hao Sun, Zhexin Zhang, Fei Mi, Yasheng Wang 외

Morality in dialogue systems has raised great attention in research recently. A moral dialogue system aligned with users' values could enhance conversation engagement and user connections. In this paper, we propose a fra…

If our aim is to build morality into an artificial agent, how might we begin to go about doing so?

2023-10-12 · Reneira Seeamber, Cosmin Badea

As Artificial Intelligence (AI) becomes pervasive in most fields, from healthcare to autonomous driving, it is essential that we find successful ways of building morality into our machines, especially for decision-making…

Autonomous DrivingDecision MakingEthics

Extended Japanese Commonsense Morality Dataset with Masked Token and Label Enhancement

2024-10-12 · Takumi Ohashi, Tsubasa Nakagawa, Hitoshi Iyatomi

Rapid advancements in artificial intelligence (AI) have made it crucial to integrate moral reasoning into AI systems. However, existing models and datasets often overlook regional and cultural differences. To address thi…

Language ModellingLarge Language ModelSentenceSentence Expansion

From Polarity to Intensity: Mining Morality from Semantic Space

2022-10-01 · COLING 2022 10 · Chunxu Zhao, Pengyuan Liu, Dong Yu

Most works on computational morality focus on moral polarity recognition, i.e., distinguishing right from wrong. However, a discrete polarity label is not informative enough to reflect morality as it does not contain any…

Sentence