Randomized Deep Structured Prediction for Discourse-Level Processing
Expressive text encoders such as RNNs and Transformer Networks have been at the center of NLP models in recent work. Most of the effort has focused on sentence-level tasks, capturing the dependencies between words in a single sentence, or pairs of sentences. However, certain tasks, such as argumentation mining, require accounting for longer texts and complicated structural dependencies between them. Deep structured prediction is a general framework to combine the complementary strengths of expressive neural encoders and structured inference for highly structured domains. Nevertheless, when the need arises to go beyond sentences, most work relies on combining the output scores of independently trained classifiers. One of the main reasons for this is that constrained inference comes at a high computational cost. In this paper, we explore the use of randomized inference to alleviate this concern and show that we can efficiently leverage deep structured prediction and expressive neural encoders for a set of tasks involving complicated argumentative structures.
Code (0)
등록된 구현이 없습니다.
Tasks
PredictionSentenceStructured PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
RST Discourse Parsing with Second-Stage EDU-Level Pre-training
Pre-trained language models (PLMs) have shown great potentials in natural language processing (NLP) including rhetorical structure theory (RST) discourse parsing.Current PLMs are obtained by sentence-level pre-training, …
Discourse Marker PredictionDiscourse ParsingSentenceExploring Joint Neural Model for Sentence Level Discourse Parsing and Sentiment Analysis
Discourse Parsing and Sentiment Analysis are two fundamental tasks in Natural Language Processing that have been shown to be mutually beneficial. In this work, we design and compare two Neural Based models for jointly le…
Discourse ParsingPredictionRelation PredictionSentence+1Learning Randomly Perturbed Structured Predictors for Direct Loss Minimization
Direct loss minimization is a popular approach for learning predictors over structured label spaces. This approach is computationally appealing as it replaces integration with optimization and allows to propagate gradien…
PredictionStructured PredictionG^2C-MT: Graph-Guided Context Selection for Document-Level Machine Translation
Effective document-level machine translation (DocMT) requires capturing long-range discourse dependencies. Recent work has explored retrieval-based and discourse-aware context selection. However, these approaches often l…
Machine TranslationSemantic SimilarityA Review of Mechanistic Models of Event Comprehension
This review examines theoretical assumptions and computational models of event comprehension, tracing the evolution from discourse comprehension theories to contemporary event cognition frameworks. The review covers key …
Event SegmentationRepresentation Learning