Not All Claims Are Equally Risky: FACTOR for Adaptive Verification in Factual Long-Form Generation
Large Language Models (LLMs) generate fluent long-form text, however, often add unsupported factual claims. Existing verification techniques improve factuality by grounding generation in external evidence. However, the same verification policy usually applies to all claims despite being differences in hallucination risks. We propose \textit{FACTOR} (\textit{FACTuality-Oriented Risk-aware Verification}), an inference-time model that adapts verification criteria according to claim-level uncertainty. FACTOR combines uncertainty estimation, adaptive language inference verification, and candidate re-ranking to allocate verification effort where it is most needed. We evaluate \textit{FACTOR} on FactScore benchmark showing that adaptive verification improves factuality while reducing verification cost simultaneously. We further perform different ablation studies to identify the primary driver of these gains. Our results show the effective and model-agnostic performance of \textit{FACTOR} for improving factuality in long-form generation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
CLAIR-Fin: An Adversarial Multi-Agent Framework for Claim-Level Verification and Adaptive Debate in Cross-Modal Financial QA
Existing defenses against hallucination in retrieval-augmented and multi-agent pipelines remain partial: evidence is trusted despite modality disagreement, debate verifies an aggregate report rather than individual claim…
Robust replication of barrier-style claims on price and volatility
We show how to price and replicate a variety of barrier-style claims written on the $\log$ price $X$ and quadratic variation $\langle X \rangle$ of a risky asset. Our framework assumes no arbitrage, frictionless markets …
Expected exponential utility maximization of insurers with a general diffusion factor model : The complete market case
In this paper, we consider the problem of optimal investment by an insurer. The insurer invests in a market consisting of a bank account and $m$ risky assets. The mean returns and volatilities of the risky assets depend …
A multivariate evolutionary generalised linear model framework with adaptive estimation for claims reserving
In this paper, we develop a multivariate evolutionary generalised linear model (GLM) framework for claims reserving, which allows for dynamic features of claims activity in conjunction with dependency across business lin…
Iterative Tree Analysis for Medical Critics
Large Language Models (LLMs) have been widely adopted across various domains, yet their application in the medical field poses unique challenges, particularly concerning the generation of hallucinations. Hallucinations i…