Automatic Fact-guided Sentence Modification
Online encyclopediae like Wikipedia contain large amounts of text that need frequent corrections and updates. The new information may contradict existing content in encyclopediae. In this paper, we focus on rewriting such dynamically changing articles. This is a challenging constrained generation task, as the output must be consistent with the new information and fit into the rest of the existing document. To this end, we propose a two-step solution: (1) We identify and remove the contradicting components in a target text for a given claim, using a neutralizing stance model; (2) We expand the remaining text to be consistent with the given claim, using a novel two-encoder sequence-to-sequence model with copy attention. Applied to a Wikipedia fact update dataset, our method successfully generates updated sentences for new claims, achieving the highest SARI score. Furthermore, we demonstrate that generating synthetic data through such rewritten sentences can successfully augment the FEVER fact-checking training dataset, leading to a relative error reduction of 13%.
Code (3)
Tasks
ArticlesFact CheckingSentenceSimilar Papers 제목 키워드 기반
TimpaTeks: Automatic In-place Text Sequence Modification via Diffusion Language Model Steering
We extend activation steering to diffusion language models (DLMs) and study a novel problem that arose due to the inference mechanism of DLMs: Modifying a text in-place to manifest a different concept. We propose TimpaTe…
Warped Language Models for Noise Robust Language Understanding
Masked Language Models (MLM) are self-supervised neural networks trained to fill in the blanks in a given sentence with masked tokens. Despite the tremendous success of MLMs for various text based tasks, they are not rob…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Natural Language UnderstandingSentence+3Learning Sentiment Memories for Sentiment Modification without Parallel Data
The task of sentiment modification requires reversing the sentiment of the input and preserving the sentiment-independent content. However, aligned sentences with the same content but different sentiments are usually una…
Text Style TransferLinguistic Features of Helpfulness in Automated Support for Creative Writing
We examine an emerging NLP application that supports creative writing by automatically suggesting continuing sentences in a story. The application tracks users{'} modifications to generated sentences, which can be used t…
Grammatical Error CorrectionStory GenerationText GenerationSemantic Consistency-Based Uncertainty Quantification for Factuality in Radiology Report Generation
Radiology report generation (RRG) has shown great potential in assisting radiologists by automating the labor-intensive task of report writing. While recent advancements have improved the quality and coherence of generat…
DiagnosticSentenceUncertainty Quantification