paper-with-me

홈 › Papers

Ethical Challenges in Data-Driven Dialogue Systems

2017-11-24 · Peter Henderson, Koustuv Sinha, Nicolas Angelard-Gontier, Nan Rosemary Ke, Genevieve Fried, Ryan Lowe, Joelle Pineau

The use of dialogue systems as a medium for human-machine interaction is an increasingly prevalent paradigm. A growing number of dialogue systems use conversation strategies that are learned from large datasets. There are well documented instances where interactions with these system have resulted in biased or even offensive conversations due to the data-driven training process. Here, we highlight potential ethical issues that arise in dialogue systems research, including: implicit biases in data-driven systems, the rise of adversarial examples, potential sources of privacy violations, safety concerns, special considerations for reinforcement learning systems, and reproducibility concerns. We also suggest areas stemming from these issues that deserve further investigation. Through this initial survey, we hope to spur research leading to robust, safe, and ethically sound dialogue systems.

📄 PDF Abstract BibTeX arXiv:1711.09050

Code (1)

Breakend/EthicsInDialogue 공식 구현 pytorch

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

EthicMind: A Risk-Aware Framework for Ethical-Emotional Alignment in Multi-Turn Dialogue

2026-04-10 · Jiawen Deng, Wei Li, Wentao Zhang, Ziyun Jiao 외 arxiv

Intelligent dialogue systems are increasingly deployed in emotionally and ethically sensitive settings, where failures in either emotional attunement or ethical judgment can cause significant harm. Existing dialogue mode…

Chain of Attack: a Semantic-Driven Contextual Multi-Turn attacker for LLM

2024-05-09 · Xikang Yang, Xuehai Tang, Songlin Hu, Jizhong Han

Large language models (LLMs) have achieved remarkable performance in various natural language processing tasks, especially in dialogue systems. However, LLM may also pose security and moral threats, especially in multi r…

EmoUS: Simulating User Emotions in Task-Oriented Dialogues

2023-06-02 · Hsien-Chin Lin, Shutong Feng, Christian Geishauser, Nurul Lubis 외

Existing user simulators (USs) for task-oriented dialogue systems only model user behaviour on semantic and natural language levels without considering the user persona and emotions. Optimising dialogue systems with gene…

Language ModelingLanguage ModellingLarge Language ModelTask-Oriented Dialogue Systems

A Logic-based Multi-agent System for Ethical Monitoring and Evaluation of Dialogues

2021-09-17 · Abeer Dyoub, Stefania Costantini, Ivan Letteri, Francesca A. Lisi

Dialogue Systems are tools designed for various practical purposes concerning human-machine interaction. These systems should be built on ethical foundations because their behavior may heavily influence a user (think esp…

Ethics

Building Trustworthy Multimodal AI: A Review of Fairness, Transparency, and Ethics in Vision-Language Tasks

2025-04-14 · Mohammad Saleh, Azadeh Tabatabaei

Objective: This review explores the trustworthiness of multimodal artificial intelligence (AI) systems, specifically focusing on vision-language tasks. It addresses critical challenges related to fairness, transparency, …

EthicsFairnessImage CaptioningQuestion Answering+2