paper-with-me

Papers

PASTE: A Tagging-Free Decoding Framework Using Pointer Networks for Aspect Sentiment Triplet Extraction

2021-10-10 · EMNLP 2021 11 · Rajdeep Mukherjee, Tapas Nayak, Yash Butala, Sourangshu Bhattacharya, Pawan Goyal

Aspect Sentiment Triplet Extraction (ASTE) deals with extracting opinion triplets, consisting of an opinion target or aspect, its associated sentiment, and the corresponding opinion term/span explaining the rationale behind the sentiment. Existing research efforts are majorly tagging-based. Among the methods taking a sequence tagging approach, some fail to capture the strong interdependence between the three opinion factors, whereas others fall short of identifying triplets with overlapping aspect/opinion spans. A recent grid tagging approach on the other hand fails to capture the span-level semantics while predicting the sentiment between an aspect-opinion pair. Different from these, we present a tagging-free solution for the task, while addressing the limitations of the existing works. We adapt an encoder-decoder architecture with a Pointer Network-based decoding framework that generates an entire opinion triplet at each time step thereby making our solution end-to-end. Interactions between the aspects and opinions are effectively captured by the decoder by considering their entire detected spans while predicting their connecting sentiment. Extensive experiments on several benchmark datasets establish the better efficacy of our proposed approach, especially in the recall, and in predicting multiple and aspect/opinion-overlapped triplets from the same review sentence. We report our results both with and without BERT and also demonstrate the utility of domain-specific BERT post-training for the task.

📄 PDF Abstract BibTeX arXiv:2110.04794

Code (1)

rajdeep345/paste 공식 구현 pytorch

Tasks

Aspect Sentiment Triplet ExtractionDecoderSentenceTriplet

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
WordPiece 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Similar Papers 제목 키워드 기반

Felix: Flexible Text Editing Through Tagging and Insertion

2020-03-24 · Findings of the Association for Computational Linguistics 2020 · Jonathan Mallinson, Aliaksei Severyn, Eric Malmi, Guillermo Garrido

We present Felix --- a flexible text-editing approach for generation, designed to derive the maximum benefit from the ideas of decoding with bi-directional contexts and self-supervised pre-training. In contrast to conven…

Automatic Post-EditingLanguage ModelingLanguage ModellingMachine Translation+4

STN4DST: A Scalable Dialogue State Tracking based on Slot Tagging Navigation

2020-10-21 · Puhai Yang, Heyan Huang, Xianling Mao

Scalability for handling unknown slot values is a important problem in dialogue state tracking (DST). As far as we know, previous scalable DST approaches generally rely on either the candidate generation from slot taggin…

Dialogue State TrackingPosition

A Pointer Network Architecture for Joint Morphological Segmentation and Tagging

2020-11-01 · Findings of the Association for Computational Linguistics 2020 · Amit Seker, Reut Tsarfaty

Morphologically Rich Languages (MRLs) such as Arabic, Hebrew and Turkish often require Morphological Disambiguation (MD), i.e., the prediction of morphological decomposition of tokens into morphemes, early in the pipelin…

Morphological Disambiguation

POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training

2020-05-01 · EMNLP 2020 11 · Yizhe Zhang, Guoyin Wang, Chunyuan Li, Zhe Gan 외

Large-scale pre-trained language models, such as BERT and GPT-2, have achieved excellent performance in language representation learning and free-form text generation. However, these models cannot be directly employed to…

Language ModellingRepresentation LearningText Generation

Pointer Networks with Q-Learning for Combinatorial Optimization

2023-11-05 · Alessandro Barro

We introduce the Pointer Q-Network (PQN), a hybrid neural architecture that integrates model-free Q-value policy approximation with Pointer Networks (Ptr-Nets) to enhance the optimality of attention-based sequence genera…

Combinatorial OptimizationGraph EmbeddingQ-LearningReinforcement Learning (RL)