paper-with-me

홈 › Papers

Statement-based Memory for Neural Source Code Summarization

2023-07-21 · Aakash Bansal, Siyuan Jiang, Sakib Haque, Collin McMillan

Source code summarization is the task of writing natural language descriptions of source code behavior. Code summarization underpins software documentation for programmers. Short descriptions of code help programmers understand the program quickly without having to read the code itself. Lately, neural source code summarization has emerged as the frontier of research into automated code summarization techniques. By far the most popular targets for summarization are program subroutines. The idea, in a nutshell, is to train an encoder-decoder neural architecture using large sets of examples of subroutines extracted from code repositories. The encoder represents the code and the decoder represents the summary. However, most current approaches attempt to treat the subroutine as a single unit. For example, by taking the entire subroutine as input to a Transformer or RNN-based encoder. But code behavior tends to depend on the flow from statement to statement. Normally dynamic analysis may shed light on this flow, but dynamic analysis on hundreds of thousands of examples in large datasets is not practical. In this paper, we present a statement-based memory encoder that learns the important elements of flow during training, leading to a statement-based subroutine representation without the need for dynamic analysis. We implement our encoder for code summarization and demonstrate a significant improvement over the state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2307.11709

Code (1)

aakashba/smncode2022 공식 구현 tf

Tasks

Code SummarizationDecoderSource Code Summarization

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Multi-Head Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

An Extractive-and-Abstractive Framework for Source Code Summarization

2022-06-15 · Weisong Sun, Chunrong Fang, Yuchen Chen, Quanjun Zhang 외

(Source) Code summarization aims to automatically generate summaries/comments for a given code snippet in the form of natural language. Such summaries play a key role in helping developers understand and maintain source …

Code SummarizationMachine TranslationRetrievalSource Code Summarization

ISQA: Informative Factuality Feedback for Scientific Summarization

2024-04-20 · Zekai Li, Yanxia Qin, Qian Liu, Min-Yen Kan

We propose Iterative Facuality Refining on Informative Scientific Question-Answering (ISQA) feedback\footnote{Code is available at \url{https://github.com/lizekai-richard/isqa}}, a method following human learning theorie…

Question Answering

SEval-Ex: A Statement-Level Framework for Explainable Summarization Evaluation

2025-05-04 · Tanguy Herserant, Vincent Guigue

Evaluating text summarization quality remains a critical challenge in Natural Language Processing. Current approaches face a trade-off between performance and interpretability. We present SEval-Ex, a framework that bridg…

HallucinationText Summarization

Negative Statements Considered Useful

2020-01-13 · Hiba Arnaout, Simon Razniewski, Gerhard Weikum, Jeff Z. Pan

Knowledge bases (KBs) about notable entities and their properties are an important asset in applications such as search, question answering and dialogue. All popular KBs capture virtually only positive statements, and ab…

Question Answering

From Attribution to Abstention: Training-Free Attention-Based Auditing for Clinical Summarization

2026-01-23 · Qianqi Yan, Huy Nguyen, Sumana Srivatsa, Hari Bandi 외 arxiv

Deploying multimodal large language models (MLLMs) for clinical summarization demands not only fluent generation but also transparency about where each statement originates-and a mechanism to flag when statements lack ev…

Domain Adaptation