paper-with-me

홈 › Papers

Modeling Hierarchical Syntax Structure with Triplet Position for Source Code Summarization

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Automatic code summarization, which aims to describe the source code in natural language, has become an essential task in software maintenance. Our fellow researchers have attempted to achieve such a purpose through various machine learning-based approaches. One key challenge keeping these approaches from being practical lies in the lacking of retaining the semantic structure of source code, which has unfortunately been overlooked by the state-of-the-art. Existing approaches resort to representing the syntax structure of code by modeling the Abstract Syntax Trees (ASTs). However, the hierarchical structures of ASTs have not been well explored. In this paper, we propose CODESCRIBE to model the hierarchical syntax structure of code by introducing a novel triplet position for code summarization. Specifically, CODESCRIBE leverages the graph neural network and Transformer to preserve the structural and sequential information of code, respectively. In addition, we propose a pointer-generator network that pays attention to both the structure and sequential tokens of code for a better summary generation. Experiments on two real-world datasets in Java and Python demonstrate the effectiveness of our proposed approach when compared with several state-of-the-art baselines.

📄 PDF Abstract BibTeX

Code (1)

gjcexp/codescribe 공식 구현 pytorch

Tasks

Code SummarizationGraph Neural NetworkPositionSource Code SummarizationTriplet

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Graph Neural Network 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Modeling Hierarchical Syntax Structure with Triplet Position for Source Code Summarization

2022-05-01 · ACL 2022 5 · Juncai Guo, Jin Liu, Yao Wan, Li Li 외

Automatic code summarization, which aims to describe the source code in natural language, has become an essential task in software maintenance. Our fellow researchers have attempted to achieve such a purpose through vari…

Code SummarizationGraph Neural NetworkPositionSource Code Summarization+1

Towards Better Modeling Hierarchical Structure for Self-Attention with Ordered Neurons

2019-09-04 · IJCNLP 2019 11 · Jie Hao, Xing Wang, Shuming Shi, Jinfeng Zhang 외

Recent studies have shown that a hybrid of self-attention networks (SANs) and recurrent neural networks (RNNs) outperforms both individual architectures, while not much is known about why the hybrid models work. With the…

Inductive BiasMachine TranslationTranslation

Exergetic Port-Hamiltonian Systems Modeling Language

2024-02-27 · Markus Lohmayer, Owen Lynch, Sigrid Leyendecker

Mathematical modeling of real-world physical systems requires the consistent combination of a multitude of physical laws and phenomenological models. This challenging task can be greatly simplified by hierarchically deco…

Seamlessly Integrating Tree-Based Positional Embeddings into Transformer Models for Source Code Representation

2025-07-05 · Patryk Bartkowiak, Filip Graliński arxiv

Transformer-based models have demonstrated significant success in various source code representation tasks. Nonetheless, traditional positional embeddings employed by these models inadequately capture the hierarchical st…

Shadow of the (Hierarchical) Tree: Reconciling Symbolic and Predictive Components of the Neural Code for Syntax

2024-12-02 · Elliot Murphy

Natural language syntax can serve as a major test for how to integrate two infamously distinct frameworks: symbolic representations and connectionist neural networks. Building on a recent neurocomputational architecture …