Enhanced Hallucination Detection in Neural Machine Translation through Simple Detector Aggregation
Hallucinated translations pose significant threats and safety concerns when it comes to the practical deployment of machine translation systems. Previous research works have identified that detectors exhibit complementary performance different detectors excel at detecting different types of hallucinations. In this paper, we propose to address the limitations of individual detectors by combining them and introducing a straightforward method for aggregating multiple detectors. Our results demonstrate the efficacy of our aggregated detector, providing a promising step towards evermore reliable machine translation systems.
Code (0)
등록된 구현이 없습니다.
Tasks
HallucinationMachine TranslationTranslationSimilar Papers 제목 키워드 기반
Machine Translation Hallucination Detection for Low and High Resource Languages using Large Language Models
Recent advancements in massively multilingual machine translation systems have significantly enhanced translation accuracy; however, even the best performing systems still generate hallucinations, severely impacting user…
HallucinationMachine TranslationSemantic SimilaritySemantic Textual Similarity+2Few-Shot Optimized Framework for Hallucination Detection in Resource-Limited NLP Systems
Hallucination detection in text generation remains an ongoing struggle for natural language processing (NLP) systems, frequently resulting in unreliable outputs in applications such as machine translation and definition …
Ensemble LearningHallucinationMachine TranslationPrompt Engineering+1HalOmi: A Manually Annotated Benchmark for Multilingual Hallucination and Omission Detection in Machine Translation
Hallucinations in machine translation are translations that contain information completely unrelated to the input. Omissions are translations that do not include some of the input information. While both cases tend to be…
HallucinationMachine TranslationSentenceTranslationOptimal Transport for Unsupervised Hallucination Detection in Neural Machine Translation
Neural machine translation (NMT) has become the de-facto standard in real-world machine translation applications. However, NMT models can unpredictably produce severely pathological translations, known as hallucinations,…
DecoderHallucinationMachine TranslationNMT+1Don't Believe Everything You Read: Enhancing Summarization Interpretability through Automatic Identification of Hallucinations in Large Language Models
Large Language Models (LLMs) are adept at text manipulation -- tasks such as machine translation and text summarization. However, these models can also be prone to hallucination, which can be detrimental to the faithfuln…
HallucinationMachine TranslationText SummarizationTranslation