paper-with-me

홈 › Papers

Safety Assessment of Chinese Large Language Models

2023-04-20 · Hao Sun, Zhexin Zhang, Jiawen Deng, Jiale Cheng, Minlie Huang

With the rapid popularity of large language models such as ChatGPT and GPT-4, a growing amount of attention is paid to their safety concerns. These models may generate insulting and discriminatory content, reflect incorrect social values, and may be used for malicious purposes such as fraud and dissemination of misleading information. Evaluating and enhancing their safety is particularly essential for the wide application of large language models (LLMs). To further promote the safe deployment of LLMs, we develop a Chinese LLM safety assessment benchmark. Our benchmark explores the comprehensive safety performance of LLMs from two perspectives: 8 kinds of typical safety scenarios and 6 types of more challenging instruction attacks. Our benchmark is based on a straightforward process in which it provides the test prompts and evaluates the safety of the generated responses from the evaluated model. In evaluation, we utilize the LLM's strong evaluation ability and develop it as a safety evaluator by prompting. On top of this benchmark, we conduct safety assessments and analyze 15 LLMs including the OpenAI GPT series and other well-known Chinese LLMs, where we observe some interesting findings. For example, we find that instruction attacks are more likely to expose safety issues of all LLMs. Moreover, to promote the development and deployment of safe, responsible, and ethical AI, we publicly release SafetyPrompts including 100k augmented prompts and responses by LLMs.

📄 PDF Abstract BibTeX arXiv:2304.10436

Code (2)

thu-coai/safety-prompts 공식 구현
xmudm/guide-align pytorch

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Test 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

CHiSafetyBench: A Chinese Hierarchical Safety Benchmark for Large Language Models

2024-06-14 · Wenjing Zhang, Xuejiao Lei, Zhaoxiang Liu, Meijuan An 외

With the profound development of large language models(LLMs), their safety concerns have garnered increasing attention. However, there is a scarcity of Chinese safety benchmarks for LLMs, and the existing safety taxonomi…

Multiple-choiceQuestion Answering

OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety

2024-03-18 · Chuang Liu, Linhao Yu, Jiaxuan Li, Renren Jin 외

The rapid development of Chinese large language models (LLMs) poses big challenges for efficient LLM evaluation. While current initiatives have introduced new benchmarks or evaluation platforms for assessing Chinese LLMs…

BenchmarkingMathematical Reasoning

Safety Evaluation of DeepSeek Models in Chinese Contexts

2025-02-16 · Wenjing Zhang, Xuejiao Lei, Zhaoxiang Liu, Ning Wang 외

Recently, the DeepSeek series of models, leveraging their exceptional reasoning capabilities and open-source strategy, is reshaping the global AI landscape. Despite these advantages, they exhibit significant safety defic…

A Chinese Dataset for Evaluating the Safeguards in Large Language Models

2024-02-19 · Yuxia Wang, Zenan Zhai, Haonan Li, Xudong Han 외

Many studies have demonstrated that large language models (LLMs) can produce harmful responses, exposing users to unexpected risks when LLMs are deployed. Previous studies have proposed comprehensive taxonomies of the ri…

Chinese SafetyQA: A Safety Short-form Factuality Benchmark for Large Language Models

2024-12-17 · Yingshui Tan, Boren Zheng, Baihui Zheng, Kerui Cao 외

With the rapid advancement of Large Language Models (LLMs), significant safety concerns have emerged. Fundamentally, the safety of large language models is closely linked to the accuracy, comprehensiveness, and clarity o…

EthicsFormRAG