paper-with-me

Papers

CFSafety: Comprehensive Fine-grained Safety Assessment for LLMs

2024-10-29 · Zhihao Liu, Chenhui Hu

As large language models (LLMs) rapidly evolve, they bring significant conveniences to our work and daily lives, but also introduce considerable safety risks. These models can generate texts with social biases or unethical content, and under specific adversarial instructions, may even incite illegal activities. Therefore, rigorous safety assessments of LLMs are crucial. In this work, we introduce a safety assessment benchmark, CFSafety, which integrates 5 classic safety scenarios and 5 types of instruction attacks, totaling 10 categories of safety questions, to form a test set with 25k prompts. This test set was used to evaluate the natural language generation (NLG) capabilities of LLMs, employing a combination of simple moral judgment and a 1-5 safety rating scale for scoring. Using this benchmark, we tested eight popular LLMs, including the GPT series. The results indicate that while GPT-4 demonstrated superior safety performance, the safety effectiveness of LLMs, including this model, still requires improvement. The data and code associated with this study are available on GitHub.

📄 PDF Abstract BibTeX arXiv:2410.21695

Code (0)

등록된 구현이 없습니다.

Tasks

Text Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Multi-Head Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

MJ-VIDEO: Fine-Grained Benchmarking and Rewarding Video Preferences in Video Generation

2025-02-03 · Haibo Tong, Zhaoyang Wang, Zhaorun Chen, Haonian Ji 외

Recent advancements in video generation have significantly improved the ability to synthesize videos from text instructions. However, existing models still struggle with key challenges such as instruction misalignment, c…

BenchmarkingFairnessHallucinationMixture-of-Experts+1

LinguaSafe: A Comprehensive Multilingual Safety Benchmark for Large Language Models

2025-08-18 · Zhiyuan Ning, Tianle Gu, Jiaxin Song, Shixin Hong 외 arxiv

The widespread adoption and increasing prominence of large language models (LLMs) in global technologies necessitate a rigorous focus on ensuring their safety across a diverse range of linguistic and cultural contexts. T…

Multimodal Benchmark for Safety Assessment in Industrial Inspection Scenarios

2026-01-29 · Zeyi Liu, Shuang Liu, Jihai Min, Zhaoheng Zhang 외 arxiv

With the rapid development of industrial intelligence and unmanned inspection, reliable perception and safety assessment for AI systems in complex and dynamic industrial sites has become a key bottleneck for deploying pr…

Scene UnderstandingPoint Clouds

SafeDialBench: A Fine-Grained Safety Benchmark for Large Language Models in Multi-Turn Dialogues with Diverse Jailbreak Attacks

2025-02-16 · Hongye Cao, Yanming Wang, Sijia Jing, Ziyue Peng 외

With the rapid advancement of Large Language Models (LLMs), the safety of LLMs has been a critical concern requiring precise assessment. Current benchmarks primarily concentrate on single-turn dialogues or a single jailb…

Dialogue Generation

DriveSafe: A Framework for Risk Detection and Safety Suggestions in Driving Scenarios

2026-05-16 · Sainithin Artham, Shankar Gangisetty, Avijit Dasgupta, C. V. Jawahar arxiv

Comprehensive situational awareness is essential for autonomous vehicles operating in safety-critical environments, as it enables the identification and mitigation of potential risks. Although recent Multimodal Large Lan…

Autonomous VehiclesScene Understanding