Encoding Syntactic Constituency Paths for Frame-Semantic Parsing with Graph Convolutional Networks

2020-11-26 · Emanuele Bastianelli, Andrea Vanzo, Oliver Lemon

We study the problem of integrating syntactic information from constituency trees into a neural model in Frame-semantic parsing sub-tasks, namely Target Identification (TI), FrameIdentification (FI), and Semantic Role Labeling (SRL). We use a Graph Convolutional Network to learn specific representations of constituents, such that each constituent is profiled as the production grammar rule it corresponds to. We leverage these representations to build syntactic features for each word in a sentence, computed as the sum of all the constituents on the path between a word and a task-specific node in the tree, e.g. the target predicate for SRL. Our approach improves state-of-the-art results on the TI and SRL of ~1%and~3.5% points, respectively (+2.5% additional points are gained with BERT as input), when tested on FrameNet 1.5, while yielding comparable results on the CoNLL05 dataset to other syntax-aware systems.

📄 PDF Abstract BibTeX arXiv:2011.13210

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic Parsing Semantic Role LabelingSentence

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Adam 설명 없음

Residual Connection 설명 없음

Attention 설명 없음

Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Syntactic Structure Processing in the Brain while Listening

2023-02-16 · Subba Reddy Oota, Mounika Marreddy, Manish Gupta, Bapi Raju Surampud

Syntactic parsing is the task of assigning a syntactic structure to a sentence. There are two popular syntactic parsing methods: constituency and dependency parsing. Recent works have used syntactic embeddings based on c…

Activity Prediction Dependency Parsing Sentence

Graph-based Syntactic Word Embeddings

2020-12-01 · COLING (TextGraphs) 2020 12 · Ragheb Al-Ghezi, Mikko Kurimo

We propose a simple and efficient framework to learn syntactic embeddings based on information derived from constituency parse trees. Using biased random walk methods, our embeddings not only encode syntactic information…

POS POS Tagging Word Embeddings

Exploiting Rich Syntactic Information for Semantic Parsing with Graph-to-Sequence Model

2018-08-23 · EMNLP 2018 10 · Kun Xu, Lingfei Wu, Zhiguo Wang, Mo Yu 외

Existing neural semantic parsers mainly utilize a sequence encoder, i.e., a sequential LSTM, to extract word order features while neglecting other valuable syntactic information such as dependency graph or constituent tr…

Graph-to-Sequence Semantic Parsing

How to best use Syntax in Semantic Role Labelling

2019-06-01 · ACL 2019 7 · Yufei Wang, Mark Johnson, Stephen Wan, Yifang Sun 외

There are many different ways in which external information might be used in an NLP task. This paper investigates how external syntactic information can be used most effectively in the Semantic Role Labeling (SRL) task. …

Semantic Role Labeling

Constituency Lattice Encoding for Aspect Term Extraction

2020-12-01 · COLING 2020 8 · Yunyi Yang, Kun Li, Xiaojun Quan, Weizhou Shen 외

One of the remaining challenges for aspect term extraction in sentiment analysis resides in the extraction of phrase-level aspect terms, which is non-trivial to determine the boundaries of such terms. In this paper, we a…

Aspect Term Extraction and Sentiment Classification Sentence Sentiment Analysis Term Extraction