paper-with-me

홈 › Papers

Joint Semantic Analysis with Document-Level Cross-Task Coherence Rewards

2020-10-12 · Rahul Aralikatte, Mostafa Abdou, Heather Lent, Daniel Hershcovich, Anders Søgaard

Coreference resolution and semantic role labeling are NLP tasks that capture different aspects of semantics, indicating respectively, which expressions refer to the same entity, and what semantic roles expressions serve in the sentence. However, they are often closely interdependent, and both generally necessitate natural language understanding. Do they form a coherent abstract representation of documents? We present a neural network architecture for joint coreference resolution and semantic role labeling for English, and train graph neural networks to model the 'coherence' of the combined shallow semantic graph. Using the resulting coherence score as a reward for our joint semantic analyzer, we use reinforcement learning to encourage global coherence over the document and between semantic annotations. This leads to improvements on both tasks in multiple datasets from different domains, and across a range of encoders of different expressivity, calling, we believe, for a more holistic approach to semantics in NLP.

📄 PDF Abstract BibTeX arXiv:2010.05567

Code (1)

rahular/joint-coref-srl 공식 구현 pytorch

Tasks

coreference-resolutionCoreference ResolutionNatural Language UnderstandingSemantic Role LabelingSentence

Similar Papers 제목 키워드 기반

Multilingual Models for Compositional Distributed Semantics

2014-04-17 · ACL 2014 6 · Karl Moritz Hermann, Phil Blunsom

We present a novel technique for learning semantic representations, which extends the distributional hypothesis to multilingual data and joint-space embeddings. Our models leverage parallel data and learn to strongly ali…

Cross-Lingual Document ClassificationDocument ClassificationGeneral ClassificationLearning Semantic Representations

Do the Benefits of Joint Models for Relation Extraction Extend to Document-level Tasks?

2023-10-01 · Pratik Saini, Tapas Nayak, Indrajit Bhattacharya

Two distinct approaches have been proposed for relational triple extraction - pipeline and joint. Joint models, which capture interactions across triples, are the more recent development, and have been shown to outperfor…

RelationRelation ExtractionSentence

VLCDoC: Vision-Language Contrastive Pre-Training Model for Cross-Modal Document Classification

2022-05-24 · Souhail Bakkali, Zuheng Ming, Mickael Coustaty, Marçal Rusiñol 외

Multimodal learning from document data has achieved great success lately as it allows to pre-train semantically meaningful features as a prior into a learnable downstream task. In this paper, we approach the document cla…

Document ClassificationDocument Image Classification

A Joint Model for Entity Analysis: Coreference, Typing, and Linking

2014-01-01 · TACL 2014 1 · Greg Durrett, Dan Klein

We present a joint model of three core tasks in the entity analysis stack: coreference resolution (within-document clustering), named entity recognition (coarse semantic typing), and entity linking (matching to Wikipedia…

Clusteringcoreference-resolutionCoreference ResolutionEntity Linking+3

Enhanced Knowledge Selection for Grounded Dialogues via Document Semantic Graphs

2022-06-15 · Sha Li, Mahdi Namazifar, Di Jin, Mohit Bansal 외

Providing conversation models with background knowledge has been shown to make open-domain dialogues more informative and engaging. Existing models treat knowledge selection as a sentence ranking or classification proble…

Multi-Task LearningResponse GenerationSentence