paper-with-me

홈 › Papers

Randomized Deep Structured Prediction for Discourse-Level Processing

2021-01-25 · EACL 2021 2 · Manuel Widmoser, Maria Leonor Pacheco, Jean Honorio, Dan Goldwasser

Expressive text encoders such as RNNs and Transformer Networks have been at the center of NLP models in recent work. Most of the effort has focused on sentence-level tasks, capturing the dependencies between words in a single sentence, or pairs of sentences. However, certain tasks, such as argumentation mining, require accounting for longer texts and complicated structural dependencies between them. Deep structured prediction is a general framework to combine the complementary strengths of expressive neural encoders and structured inference for highly structured domains. Nevertheless, when the need arises to go beyond sentences, most work relies on combining the output scores of independently trained classifiers. One of the main reasons for this is that constrained inference comes at a high computational cost. In this paper, we explore the use of randomized inference to alleviate this concern and show that we can efficiently leverage deep structured prediction and expressive neural encoders for a set of tasks involving complicated argumentative structures.

📄 PDF Abstract BibTeX arXiv:2101.10435

Code (0)

등록된 구현이 없습니다.

Tasks

PredictionSentenceStructured Prediction

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

RST Discourse Parsing with Second-Stage EDU-Level Pre-training

2022-05-01 · ACL 2022 5 · Nan Yu, Meishan Zhang, Guohong Fu, Min Zhang

Pre-trained language models (PLMs) have shown great potentials in natural language processing (NLP) including rhetorical structure theory (RST) discourse parsing.Current PLMs are obtained by sentence-level pre-training, …

Discourse Marker PredictionDiscourse ParsingSentence

Exploring Joint Neural Model for Sentence Level Discourse Parsing and Sentiment Analysis

2017-08-01 · WS 2017 8 · Bita Nejat, Giuseppe Carenini, Raymond Ng

Discourse Parsing and Sentiment Analysis are two fundamental tasks in Natural Language Processing that have been shown to be mutually beneficial. In this work, we design and compare two Neural Based models for jointly le…

Discourse ParsingPredictionRelation PredictionSentence+1

Learning Randomly Perturbed Structured Predictors for Direct Loss Minimization

2020-07-11 · Hedda Cohen Indelman, Tamir Hazan

Direct loss minimization is a popular approach for learning predictors over structured label spaces. This approach is computationally appealing as it replaces integration with optimization and allows to propagate gradien…

PredictionStructured Prediction

G^2C-MT: Graph-Guided Context Selection for Document-Level Machine Translation

2026-06-02 · Baijun Ji, Zixuan Zhou, Xiangyu Duan, Yu Liu 외 arxiv

Effective document-level machine translation (DocMT) requires capturing long-range discourse dependencies. Recent work has explored retrieval-based and discourse-aware context selection. However, these approaches often l…

Machine TranslationSemantic Similarity

A Review of Mechanistic Models of Event Comprehension

2024-09-17 · Tan T. Nguyen

This review examines theoretical assumptions and computational models of event comprehension, tracing the evolution from discourse comprehension theories to contemporary event cognition frameworks. The review covers key …

Event SegmentationRepresentation Learning