DAHRS: Divergence-Aware Hallucination-Remediated SRL Projection

2024-07-12 · Sangpil Youm, Brodie Mather, Chathuri Jayaweera, Juliana Prada, Bonnie Dorr

Semantic role labeling (SRL) enriches many downstream applications, e.g., machine translation, question answering, summarization, and stance/belief detection. However, building multilingual SRL models is challenging due to the scarcity of semantically annotated corpora for multiple languages. Moreover, state-of-the-art SRL projection (XSRL) based on large language models (LLMs) yields output that is riddled with spurious role labels. Remediation of such hallucinations is not straightforward due to the lack of explainability of LLMs. We show that hallucinated role labels are related to naturally occurring divergence types that interfere with initial alignments. We implement Divergence-Aware Hallucination-Remediated SRL projection (DAHRS), leveraging linguistically-informed alignment remediation followed by greedy First-Come First-Assign (FCFA) SRL projection. DAHRS improves the accuracy of SRL projection without additional transformer-based machinery, beating XSRL in both human and automatic comparisons, and advancing beyond headwords to accommodate phrase-level SRL projection (e.g., EN-FR, EN-ES). Using CoNLL-2009 as our ground truth, we achieve a higher word-level F1 over XSRL: 87.6% vs. 77.3% (EN-FR) and 89.0% vs. 82.7% (EN-ES). Human phrase-level assessments yield 89.1% (EN-FR) and 91.0% (EN-ES). We also define a divergence metric to adapt our approach to other language pairs (e.g., English-Tagalog).

📄 PDF Abstract BibTeX arXiv:2407.09283

Code (0)

등록된 구현이 없습니다.

Tasks

fr-enHallucinationMachine Translation Question Answering Semantic Role Labeling

Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence

2024-12-18 · Jinghan He, Kuan Zhu, Haiyun Guo, Junfeng Fang 외

Large vision-language models (LVLMs) have made substantial progress in integrating large language models (LLMs) with visual inputs, enabling advanced multimodal reasoning. Despite their success, a persistent challenge is…

Hallucination Multimodal Reasoning

Prompt-Response Semantic Divergence Metrics for Faithfulness Hallucination and Misalignment Detection in Large Language Models

2025-08-13 · Igor Halperin arxiv

The proliferation of Large Language Models (LLMs) is challenged by hallucinations, critical failure modes where models generate non-factual, nonsensical or unfaithful text. This paper introduces Semantic Divergence Metri…

Role-Aware Neural Convex Divergence Heads for Asymmetric Representation Learning

2026-07-02 · He Huang, Lu Shen, Yunfeng Huang, Li Qi arxiv

Many representation learning problems involve directed relations, such as lexical entailment, sentence entailment, ontology hierarchy, and citation links. Standard Euclidean, cosine, and Mahalanobis heads are symmetric, …

Representation Learning

MRFD: Multi-Region Fusion Decoding with Self-Consistency for Mitigating Hallucinations in LVLMs

2025-08-14 · Haonan Ge, Yiwei Wang, Ming-Hsuan Yang, Yujun Cai arxiv

Large Vision-Language Models (LVLMs) have shown strong performance across multimodal tasks. However, they often produce hallucinations -- text that is inconsistent with visual input, due to the limited ability to verify …

Towards A Scalable Solution for Improving Multi-Group Fairness in Compositional Classification

2023-07-11 · James Atwood, Tina Tian, Ben Packer, Meghana Deodhar 외

Despite the rich literature on machine learning fairness, relatively little attention has been paid to remediating complex systems, where the final prediction is the combination of multiple classifiers and where multiple…

Fairness