Multi-Task Learning for Coherence Modeling
We address the task of assessing discourse coherence, an aspect of text quality that is essential for many NLP tasks, such as summarization and language assessment. We propose a hierarchical neural network trained in a multi-task fashion that learns to predict a document-level coherence score (at the network's top layers) along with word-level grammatical roles (at the bottom layers), taking advantage of inductive transfer between the two tasks. We assess the extent to which our framework generalizes to different domains and prediction tasks, and demonstrate its effectiveness not only on standard binary evaluation coherence tasks, but also on real-world tasks involving the prediction of varying degrees of coherence, achieving a new state of the art.
Code (1)
Tasks
Multi-Task LearningSimilar Papers 제목 키워드 기반
Skeleton-based Coherence Modeling in Narratives
Modeling coherence in text has been a task that has excited NLP researchers since a long time. It has applications in detecting incoherent structures and helping the author fix them. There has been recent work in using n…
Story GenerationA Neural Graph-based Local Coherence Model
Entity grids and entity graphs are two frameworks for modeling local coherence. These frameworks represent entity relations between sentences and then extract features from such representations to encode coherence. The b…
Coherence EvaluationmodelSentenceSentence OrderingRethinking Coherence Modeling: Synthetic vs. Downstream Tasks
Although coherence modeling has come a long way in developing novel models, their evaluation on downstream applications for which they are purportedly developed has largely been neglected. With the advancements made by n…
BenchmarkingCoherence EvaluationLanguage ModellingMachine Translation+5Leveraging Weak Cross-Modal Guidance for Coherence Modelling via Iterative Learning
Cross-modal coherence modeling is essential for intelligent systems to help them organize and structure information, thereby understanding and creating content of the physical world coherently like human-beings. Previous…
Two-Level Transformer and Auxiliary Coherence Modeling for Improved Text Segmentation
Breaking down the structure of long texts into semantically coherent segments makes the texts more readable and supports downstream applications like summarization and retrieval. Starting from an apparent link between te…
Cross-Lingual Word EmbeddingsMulti-Task LearningRetrievalSegmentation+4