paper-with-me

홈 › Papers

HaluEval-Wild: Evaluating Hallucinations of Language Models in the Wild

2024-03-07 · Zhiying Zhu, Yiming Yang, Zhiqing Sun

Hallucinations pose a significant challenge to the reliability of large language models (LLMs) in critical domains. Recent benchmarks designed to assess LLM hallucinations within conventional NLP tasks, such as knowledge-intensive question answering (QA) and summarization, are insufficient for capturing the complexities of user-LLM interactions in dynamic, real-world settings. To address this gap, we introduce HaluEval-Wild, the first benchmark specifically designed to evaluate LLM hallucinations in the wild. We meticulously collect challenging (adversarially filtered by Alpaca) user queries from ShareGPT, an existing real-world user-LLM interaction datasets, to evaluate the hallucination rates of various LLMs. Upon analyzing the collected queries, we categorize them into five distinct types, which enables a fine-grained analysis of the types of hallucinations LLMs exhibit, and synthesize the reference answers with the powerful GPT-4 model and retrieval-augmented generation (RAG). Our benchmark offers a novel approach towards enhancing our comprehension of and improving LLM reliability in scenarios reflective of real-world interactions. Our benchmark is available at https://github.com/HaluEval-Wild/HaluEval-Wild.

📄 PDF Abstract BibTeX arXiv:2403.04307

Code (1)

halueval-wild/halueval-wild 공식 구현

Tasks

HallucinationQuestion AnsweringRAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음

Similar Papers 제목 키워드 기반

WildHallucinations: Evaluating Long-form Factuality in LLMs with Real-World Entity Queries

2024-07-24 · Wenting Zhao, Tanya Goyal, Yu Ying Chiu, Liwei Jiang 외

While hallucinations of large language models (LLMs) prevail as a major challenge, existing evaluation benchmarks on factuality do not cover the diverse domains of knowledge that the real-world users of LLMs seek informa…

ChatbotFormHallucinationRetrieval

HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models

2023-05-19 · Junyi Li, Xiaoxue Cheng, Wayne Xin Zhao, Jian-Yun Nie 외

Large language models (LLMs), such as ChatGPT, are prone to generate hallucinations, i.e., content that conflicts with the source or cannot be verified by the factual knowledge. To understand what types of content and to…

HallucinationHallucination Evaluation

WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences

2024-06-16 · Yujie Lu, Dongfu Jiang, Wenhu Chen, William Yang Wang 외

Recent breakthroughs in vision-language models (VLMs) emphasize the necessity of benchmarking human preferences in real-world multimodal interactions. To address this gap, we launched WildVision-Arena (WV-Arena), an onli…

BenchmarkingSpatial Reasoning

The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models

2024-01-06 · Junyi Li, Jie Chen, Ruiyang Ren, Xiaoxue Cheng 외

In the era of large language models (LLMs), hallucination (i.e., the tendency to generate factually incorrect content) poses great challenge to trustworthy and reliable deployment of LLMs in real-world applications. To t…

Hallucination

WildFireCan-MMD: A Multimodal Dataset for Classification of User-Generated Content During Wildfires in Canada

2025-04-17 · Braeden Sherritt, Isar Nejadgholi, Marzieh Amini

Rapid information access is vital during wildfires, yet traditional data sources are slow and costly. Social media offers real-time updates, but extracting relevant insights remains a challenge. We present WildFireCan-MM…

Disaster Response