paper-with-me

홈 › Papers

Encoding Sentences with Graph Convolutional Networks for Semantic Role Labeling

2017-03-14 · EMNLP 2017 9 · Diego Marcheggiani, Ivan Titov

Semantic role labeling (SRL) is the task of identifying the predicate-argument structure of a sentence. It is typically regarded as an important step in the standard NLP pipeline. As the semantic representations are closely related to syntactic ones, we exploit syntactic information in our model. We propose a version of graph convolutional networks (GCNs), a recent class of neural networks operating on graphs, suited to model syntactic dependency graphs. GCNs over syntactic dependency trees are used as sentence encoders, producing latent feature representations of words in a sentence. We observe that GCN layers are complementary to LSTM ones: when we stack both GCN and LSTM layers, we obtain a substantial improvement over an already state-of-the-art LSTM SRL model, resulting in the best reported scores on the standard benchmark (CoNLL-2009) both for Chinese and English.

📄 PDF Abstract BibTeX arXiv:1703.04826

Code (2)

diegma/neural-dep-srl 공식 구현
kervyRivas/Graph-convolutional- pytorch

Tasks

Semantic Role LabelingSentence

Methods 이 논문이 사용한 방법론

Graph Convolutional Networks 설명 없음
Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Exploiting Semantics in Neural Machine Translation with Graph Convolutional Networks

2018-04-23 · NAACL 2018 6 · Diego Marcheggiani, Jasmijn Bastings, Ivan Titov

Semantic representations have long been argued as potentially useful for enforcing meaning preservation and improving generalization performance of machine translation methods. In this work, we are the first to incorpora…

Machine TranslationSentenceTranslation

Deep Binaries: Encoding Semantic-Rich Cues for Efficient Textual-Visual Cross Retrieval

2017-08-08 · ICCV 2017 10 · Yuming Shen, Li Liu, Ling Shao, Jingkuan Song

Cross-modal hashing is usually regarded as an effective technique for large-scale textual-visual cross retrieval, where data from different modalities are mapped into a shared Hamming space for matching. Most of the trad…

Cross-Modal RetrievalDescriptiveRetrieval

Multiplex Graph Neural Network for Extractive Text Summarization

2021-08-29 · EMNLP 2021 11 · Baoyu Jing, Zeyu You, Tao Yang, Wei Fan 외

Extractive text summarization aims at extracting the most representative sentences from a given document as its summary. To extract a good summary from a long text document, sentence embedding plays an important role. Re…

Extractive Text SummarizationGraph Neural NetworkSemantic SimilaritySemantic Textual Similarity+4

Reasoning Over Semantic-Level Graph for Fact Checking

2019-09-09 · ACL 2020 6 · Wanjun Zhong, Jingjing Xu, Duyu Tang, Zenan Xu 외

Fact checking is a challenging task because verifying the truthfulness of a claim requires reasoning about multiple retrievable evidence. In this work, we present a method suitable for reasoning about the semantic-level …

Claim VerificationFact CheckingFact VerificationGraph Attention+3

Efficient Purely Convolutional Text Encoding

2018-08-03 · Szymon Malik, Adrian Lancucki, Jan Chorowski

In this work, we focus on a lightweight convolutional architecture that creates fixed-size vector embeddings of sentences. Such representations are useful for building NLP systems, including conversational agents. Our wo…