paper-with-me

홈 › Papers

Revisiting File Context for Source Code Summarization

2023-09-05 · Aakash Bansal, Chia-Yi Su, Collin McMillan

Source code summarization is the task of writing natural language descriptions of source code. A typical use case is generating short summaries of subroutines for use in API documentation. The heart of almost all current research into code summarization is the encoder-decoder neural architecture, and the encoder input is almost always a single subroutine or other short code snippet. The problem with this setup is that the information needed to describe the code is often not present in the code itself -- that information often resides in other nearby code. In this paper, we revisit the idea of ``file context'' for code summarization. File context is the idea of encoding select information from other subroutines in the same file. We propose a novel modification of the Transformer architecture that is purpose-built to encode file context and demonstrate its improvement over several baselines. We find that file context helps on a subset of challenging examples where traditional approaches struggle.

📄 PDF Abstract BibTeX arXiv:2309.02326

Code (1)

apcl-research/transformerfc 공식 구현 tf

Tasks

Code SummarizationDecoderSource Code Summarization

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy

2021-09-17 · EMNLP 2021 11 · Colin B. Clement, Shuai Lu, Xiaoyu Liu, Michele Tufano 외

Statistical language modeling and translation with transformers have found many successful applications in program understanding and generation tasks, setting high benchmarks for tools in modern software development envi…

Code CompletionCode GenerationCode SummarizationLanguage Modeling+3

Project-Level Encoding for Neural Source Code Summarization of Subroutines

2021-03-22 · Aakash Bansal, Sakib Haque, Collin McMillan

Source code summarization of a subroutine is the task of writing a short, natural language description of that subroutine. The description usually serves in documentation aimed at programmers, where even brief phrase (e.…

Code SummarizationDecoderSource Code Summarization

Hierarchical Repository-Level Code Summarization for Business Applications Using Local LLMs

2025-01-14 · Nilesh Dhulshette, Sapan Shah, Vinay Kulkarni

In large-scale software development, understanding the functionality and intent behind complex codebases is critical for effective development and maintenance. While code summarization has been widely studied, existing m…

Code Summarization

Revisiting Cross-Lingual Summarization: A Corpus-based Study and A New Benchmark with Improved Annotation

2023-07-08 · Yulong Chen, Huajian Zhang, Yijie Zhou, Xuefeng Bai 외

Most existing cross-lingual summarization (CLS) work constructs CLS corpora by simply and directly translating pre-annotated summaries from one language to another, which can contain errors from both summarization and tr…

Conversation Summarization

Natural Language Summarization Enables Multi-Repository Bug Localization by LLMs in Microservice Architectures

2025-12-05 · Amirkia Rafiei Oskooei, S. Selcan Yukcu, Mehmet Cevheri Bozoglan, Mehmet S. Aktas arxiv

Bug localization in multi-repository microservice architectures is challenging due to the semantic gap between natural language bug reports and code, LLM context limitations, and the need to first identify the correct re…

Cross-Modal Retrieval