Applying Standards to Advance Upstream & Downstream Ethics in Large Language Models
This paper explores how AI-owners can develop safeguards for AI-generated content by drawing from established codes of conduct and ethical standards in other content-creation industries. It delves into the current state of ethical awareness on Large Language Models (LLMs). By dissecting the mechanism of content generation by LLMs, four key areas (upstream/downstream and at user prompt/answer), where safeguards could be effectively applied, are identified. A comparative analysis of these four areas follows and includes an evaluation of the existing ethical safeguards in terms of cost, effectiveness, and alignment with established industry practices. The paper's key argument is that existing IT-related ethical codes, while adequate for traditional IT engineering, are inadequate for the challenges posed by LLM-based content generation. Drawing from established practices within journalism, we propose potential standards for businesses involved in distributing and selling LLM-generated content. Finally, potential conflicts of interest between dataset curation at upstream and ethical benchmarking downstream are highlighted to underscore the need for a broader evaluation beyond mere output. This study prompts a nuanced conversation around ethical implications in this rapidly evolving field of content generation.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingEthicsSimilar Papers 제목 키워드 기반
Multi-Dimensional self-exciting NBD process and Default portfolios
In this study, we apply a multidimensional self-exciting negative binomial distribution (SE-NBD) process to default portfolios with 13 sectors. The SE-NBD process is a Poisson process with a gamma-distributed intensity f…
On Transferability of Bias Mitigation Effects in Language Model Fine-Tuning
Fine-tuned language models have been shown to exhibit biases against protected groups in a host of modeling tasks such as text classification and coreference resolution. Previous works focus on detecting these biases, re…
coreference-resolutionCoreference ResolutionFairnessHate Speech Detection+6Research on Artificial Intelligence Ethics Based on the Evolution of Population Knowledge Base
The unclear development direction of human society is a deep reason for that it is difficult to form a uniform ethical standard for human society and artificial intelligence. Since the 21st century, the latest advances i…
EthicsMaking Intelligence: Ethical Values in IQ and ML Benchmarks
In recent years, ML researchers have wrestled with defining and improving machine learning (ML) benchmarks and datasets. In parallel, some have trained a critical lens on the ethics of dataset creation and ML research. I…
EthicsPhilosophyEnvironment Upgrade Reinforcement Learning for Non-Differentiable Multi-Stage Pipelines
Recent advances in multi-stage algorithms have shown great promise, but two important problems still remain. First of all, at inference time, information can't feed back from downstream to upstream. Second, at training t…
Instance SegmentationPose Estimationreinforcement-learningReinforcement Learning+2