paper-with-me

홈 › Papers

Compositionality-Aware Graph2Seq Learning

2022-01-28 · Takeshi D. Itoh, Takatomi Kubo, Kazushi Ikeda

Graphs are a highly expressive data structure, but it is often difficult for humans to find patterns from a complex graph. Hence, generating human-interpretable sequences from graphs have gained interest, called graph2seq learning. It is expected that the compositionality in a graph can be associated to the compositionality in the output sequence in many graph2seq tasks. Therefore, applying compositionality-aware GNN architecture would improve the model performance. In this study, we adopt the multi-level attention pooling (MLAP) architecture, that can aggregate graph representations from multiple levels of information localities. As a real-world example, we take up the extreme source code summarization task, where a model estimate the name of a program function from its source code. We demonstrate that the model having the MLAP architecture outperform the previous state-of-the-art model with more than seven times fewer parameters than it.

📄 PDF Abstract BibTeX arXiv:2201.12178

Code (1)

itakeshi/mlap-graph2seq 공식 구현 pytorch

Tasks

Code SummarizationSource Code Summarization

Methods 이 논문이 사용한 방법론

Attention Pooling 설명 없음

Similar Papers 제목 키워드 기반

Towards Equipping Transformer with the Ability of Systematic Compositionality

2023-12-12 · Chen Huang, Peixin Qin, Wenqiang Lei, Jiancheng Lv

One of the key factors in language productivity and human cognition is the ability of systematic compositionality, which refers to understanding composed unseen examples of seen primitives. However, recent evidence revea…

Neural-Symbolic Inference for Robust Autoregressive Graph Parsing via Compositional Uncertainty Quantification

2023-01-26 · Zi Lin, Jeremiah Liu, Jingbo Shang

Pre-trained seq2seq models excel at graph semantic parsing with rich annotated data, but generalize worse to out-of-distribution (OOD) and long-tail examples. In comparison, symbolic parsers under-perform on population-l…

Semantic ParsingUncertainty Quantification

Paraphrase-Supervised Models of Compositionality

2018-01-31 · Avneesh Saluja, Chris Dyer, Jean-David Ruvini

Compositional vector space models of meaning promise new solutions to stubborn language understanding problems. This paper makes two contributions toward this end: (i) it uses automatically-extracted paraphrase examples …

Machine TranslationTranslation

Iterative collaborative routing among equivariant capsules for transformation-robust capsule networks

2022-10-20 · Sai Raam Venkataraman, S. Balasubramanian, R. Raghunatha Sarma

Transformation-robustness is an important feature for machine learning models that perform image classification. Many methods aim to bestow this property to models by the use of data augmentation strategies, while more f…

Data Augmentationimage-classificationImage Classification

Intrinsically Motivated Compositional Language Emergence

2020-12-09 · Rishi Hazra, Sonu Dixit, Sayambhu Sen

Recently, there has been a great deal of research in emergent communication on artificial agents interacting in simulated environments. Recent studies have revealed that, in general, emergent languages do not follow the …

Language Acquisition