paper-with-me

홈 › Papers

Knowledge Graph Enhanced Neural Machine Translation via Multi-task Learning on Sub-entity Granularity

2020-12-01 · COLING 2020 8 · Yang Zhao, Lu Xiang, Junnan Zhu, Jiajun Zhang, Yu Zhou, Chengqing Zong

Previous studies combining knowledge graph (KG) with neural machine translation (NMT) have two problems: i) Knowledge under-utilization: they only focus on the entities that appear in both KG and training sentence pairs, making much knowledge in KG unable to be fully utilized. ii) Granularity mismatch: the current KG methods utilize the entity as the basic granularity, while NMT utilizes the sub-word as the granularity, making the KG different to be utilized in NMT. To alleviate above problems, we propose a multi-task learning method on sub-entity granularity. Specifically, we first split the entities in KG and sentence pairs into sub-entity granularity by using joint BPE. Then we utilize the multi-task learning to combine the machine translation task and knowledge reasoning task. The extensive experiments on various translation tasks have demonstrated that our method significantly outperforms the baseline models in both translation quality and handling the entities.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationMulti-Task LearningNMTSentenceTranslation

Methods 이 논문이 사용한 방법론

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

CRAT: A Multi-Agent Framework for Causality-Enhanced Reflective and Retrieval-Augmented Translation with Large Language Models

2024-10-28 · Meiqi Chen, Fandong Meng, Yingxue Zhang, Yan Zhang 외

Large language models (LLMs) have shown great promise in machine translation, but they still struggle with contextually dependent terms, such as new or domain-specific words. This leads to inconsistencies and errors that…

Machine TranslationRAGRetrieval-augmented GenerationTranslation

Language Graph Distillation for Low-Resource Machine Translation

2019-08-17 · Tianyu He, Jiale Chen, Xu Tan, Tao Qin

Neural machine translation on low-resource language is challenging due to the lack of bilingual sentence pairs. Previous works usually solve the low-resource translation problem with knowledge transfer in a multilingual …

Knowledge DistillationMachine TranslationSentenceTransfer Learning+1

A Survey of Orthographic Information in Machine Translation

2020-08-04 · Bharathi Raja Chakravarthi, Priya Rani, Mihael Arcan, John P. McCrae

Machine translation is one of the applications of natural language processing which has been explored in different languages. Recently researchers started paying attention towards machine translation for resource-poor la…

Bilingual Lexicon InductionMachine TranslationSurveyTranslation

KG-BERTScore: Incorporating Knowledge Graph into BERTScore for Reference-Free Machine Translation Evaluation

2023-01-30 · Zhanglin Wu, Min Zhang, Ming Zhu, Yinglu Li 외

BERTScore is an effective and robust automatic metric for referencebased machine translation evaluation. In this paper, we incorporate multilingual knowledge graph into BERTScore and propose a metric named KG-BERTScore, …

Machine TranslationTranslation

Towards Cross-Cultural Machine Translation with Retrieval-Augmented Generation from Multilingual Knowledge Graphs

2024-10-17 · Simone Conia, Daniel Lee, Min Li, Umar Farooq Minhas 외

Translating text that contains entity names is a challenging task, as cultural-related references can vary significantly across languages. These variations may also be caused by transcreation, an adaptation process that …

Knowledge GraphsMachine TranslationRetrievalRetrieval-augmented Generation+3