paper-with-me

홈 › Papers

Graph Neural Networks for Natural Language Processing: A Survey

2021-06-10 · Lingfei Wu, Yu Chen, Kai Shen, Xiaojie Guo, Hanning Gao, Shucheng Li, Jian Pei, Bo Long

Deep learning has become the dominant approach in coping with various tasks in Natural LanguageProcessing (NLP). Although text inputs are typically represented as a sequence of tokens, there isa rich variety of NLP problems that can be best expressed with a graph structure. As a result, thereis a surge of interests in developing new deep learning techniques on graphs for a large numberof NLP tasks. In this survey, we present a comprehensive overview onGraph Neural Networks(GNNs) for Natural Language Processing. We propose a new taxonomy of GNNs for NLP, whichsystematically organizes existing research of GNNs for NLP along three axes: graph construction,graph representation learning, and graph based encoder-decoder models. We further introducea large number of NLP applications that are exploiting the power of GNNs and summarize thecorresponding benchmark datasets, evaluation metrics, and open-source codes. Finally, we discussvarious outstanding challenges for making the full use of GNNs for NLP as well as future researchdirections. To the best of our knowledge, this is the first comprehensive overview of Graph NeuralNetworks for Natural Language Processing.

📄 PDF Abstract BibTeX arXiv:2106.06090

Code (1)

graph4ai/graph4nlp 공식 구현 pytorch

Tasks

Decodergraph constructionGraph Representation LearningRepresentation LearningSurvey

Similar Papers 제목 키워드 기반

A Survey of Embedding Space Alignment Methods for Language and Knowledge Graphs

2020-10-26 · Alexander Kalinowski, Yuan An

Neural embedding approaches have become a staple in the fields of computer vision, natural language processing, and more recently, graph analytics. Given the pervasive nature of these algorithms, the natural question bec…

Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsSentence+1

A Decade of Knowledge Graphs in Natural Language Processing: A Survey

2022-09-30 · Phillip Schneider, Tim Schopf, Juraj Vladika, Mikhail Galkin 외

In pace with developments in the research field of artificial intelligence, knowledge graphs (KGs) have attracted a surge of interest from both academia and industry. As a representation of semantic relations between ent…

Knowledge Graphs

A Primer on Neural Network Models for Natural Language Processing

2015-10-02 · Yoav Goldberg

Over the past few years, neural networks have re-emerged as powerful machine-learning models, yielding state-of-the-art results in fields such as image recognition and speech processing. More recently, neural network mod…

BIG-bench Machine Learning

Graph Neural Networks for Text Classification: A Survey

2023-04-23 · Kunze Wang, Yihao Ding, Soyeon Caren Han

Text Classification is the most essential and fundamental problem in Natural Language Processing. While numerous recent text classification models applied the sequential deep learning technique, graph neural network-base…

Classificationgraph constructionGraph Neural NetworkSurvey+2

A survey of embedding models of entities and relationships for knowledge graph completion

2017-03-23 · COLING (TextGraphs) 2020 12 · Dat Quoc Nguyen

Knowledge graphs (KGs) of real-world facts about entities and their relationships are useful resources for a variety of natural language processing tasks. However, because knowledge graphs are typically incomplete, it is…

Knowledge Base CompletionKnowledge Graph CompletionKnowledge GraphsLink Prediction