paper-with-me

Papers

ValueDCG: Measuring Comprehensive Human Value Understanding Ability of Language Models

2023-09-30 · Zhaowei Zhang, Fengshuo Bai, Jun Gao, Yaodong Yang

Personal values are a crucial factor behind human decision-making. Considering that Large Language Models (LLMs) have been shown to impact human decisions significantly, it is essential to make sure they accurately understand human values to ensure their safety. However, evaluating their grasp of these values is complex due to the value's intricate and adaptable nature. We argue that truly understanding values in LLMs requires considering both "know what" and "know why". To this end, we present a comprehensive evaluation metric, ValueDCG (Value Discriminator-Critique Gap), to quantitatively assess the two aspects with an engineering implementation. We assess four representative LLMs and provide compelling evidence that the growth rates of LLM's "know what" and "know why" capabilities do not align with increases in parameter numbers, resulting in a decline in the models' capacity to understand human values as larger amounts of parameters. This may further suggest that LLMs might craft plausible explanations based on the provided context without truly understanding their inherent value, indicating potential risks.

📄 PDF Abstract BibTeX arXiv:2310.00378

Code (1)

zowiezhang/valuedcg 공식 구현

Tasks

Decision Making

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models

2024-06-16 · Bolei Ma, Xinpeng Wang, Tiancheng Hu, Anna-Carolina Haensch 외

Recent advances in Large Language Models (LLMs) have sparked wide interest in validating and comprehending the human-like cognitive-behavioral traits LLMs may capture and convey. These cognitive-behavioral traits include…

TrustGPT: A Benchmark for Trustworthy and Responsible Large Language Models

2023-06-20 · Yue Huang, Qihui Zhang, Philip S. Y, Lichao Sun

Large Language Models (LLMs) such as ChatGPT, have gained significant attention due to their impressive natural language processing capabilities. It is crucial to prioritize human-centered principles when utilizing these…

ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Models

2024-06-06 · Yuanyi Ren, Haoran Ye, Hanjun Fang, Xin Zhang 외

Large Language Models (LLMs) are transforming diverse fields and gaining increasing influence as human proxies. This development underscores the urgent need for evaluating value orientations and understanding of LLMs to …

Large Language Model Psychometrics: A Systematic Review of Evaluation, Validation, and Enhancement

2025-05-13 · Haoran Ye, Jing Jin, Yuhang Xie, Xin Zhang 외

The rapid advancement of large language models (LLMs) has outpaced traditional evaluation methodologies. It presents novel challenges, such as measuring human-like psychological constructs, navigating beyond static and t…

BenchmarkingLanguage ModelingLanguage ModellingLarge Language Model

CValues: Measuring the Values of Chinese Large Language Models from Safety to Responsibility

2023-07-19 · Guohai Xu, Jiayi Liu, Ming Yan, Haotian Xu 외

With the rapid evolution of large language models (LLMs), there is a growing concern that they may pose risks or have negative social impacts. Therefore, evaluation of human values alignment is becoming increasingly impo…