A Simple Recipe towards Reducing Hallucination in Neural Surface Realisation
Recent neural language generation systems often \textit{hallucinate} contents (i.e., producing irrelevant or contradicted facts), especially when trained on loosely corresponding pairs of the input structure and text. To mitigate this issue, we propose to integrate a language understanding module for data refinement with self-training iterations to effectively induce strong equivalence between the input data and the paired text. Experiments on the E2E challenge dataset show that our proposed framework can reduce more than 50{\%} relative unaligned noise from the original data-text pairs. A vanilla sequence-to-sequence neural NLG model trained on the refined data has improved on content correctness compared with the current state-of-the-art ensemble generator.
Code (0)
등록된 구현이 없습니다.
Tasks
HallucinationText GenerationSimilar Papers 제목 키워드 기반
Surface Realisation Using Full Delexicalisation
Surface realisation (SR) maps a meaning representation to a sentence and can be viewed as consisting of three subtasks: word ordering, morphological inflection and contraction generation (e.g., clitic attachment in Portu…
Morphological InflectionSentenceSimpleNLG-TI: Adapting SimpleNLG to Tibetan
Surface realisation is the last but not the least phase of Natural Language Generation, which aims to produce high-quality natural language text based on meaning representations. In this article, we present our work on S…
Text GenerationGoing Dutch: Creating SimpleNLG-NL
This paper presents SimpleNLG-NL, an adaptation of the SimpleNLG surface realisation engine for the Dutch language. It describes a novel method for determining and testing the grammatical constructions to be implemented,…
Text GenerationLORIA / Lorraine University at Multilingual Surface Realisation 2019
This paper presents the LORIA / Lorraine University submission at the Multilingual Surface Realisation shared task 2019 for the shallow track. We outline our approach and evaluate it on 11 languages covered by the shared…
The Proof is in the Pudding: Using Automated Theorem Proving to Generate Cooking Recipes
This paper presents FASTFOOD, a rule-based Natural Language Generation Program for cooking recipes. Recipes are generated by using an Automated Theorem Proving procedure to select the ingredients and instructions, with i…
Automated Theorem ProvingText Generation